2026-03-28 22:00:09 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 22:00:09 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 22:00:09 [bca.uk] INFO: Starting spider bca.uk
2026-03-28 22:00:09 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-28 22:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 22:00:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-28 22:00:09 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 22:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 22:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /SpiderData()?$filter=PartitionKey%20eq%20%27BCAUk%27%20and%20RowKey%20eq%20%27cookies%27 HTTP/1.1" 200 None
2026-03-28 22:00:09 [bca.uk] INFO: No cached cookies found, will perform fresh login
2026-03-28 22:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /SpiderData()?$filter=PartitionKey%20eq%20%27BCAUk%27%20and%20RowKey%20eq%20%27auth_token%27 HTTP/1.1" 200 None
2026-03-28 22:00:09 [bca.uk] INFO: Loaded cached Auth0 token from Azure Tables (length=1492)
2026-03-28 22:00:09 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 22:00:09 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 22:00:09 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 22:00:09 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 22:00:09 [scrapy.extensions.telnet] INFO: Telnet Password: 62ef4dd709d88632
2026-03-28 22:00:09 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-28 22:00:09 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/bca.uk/task_51_2026-03-28T22_00_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-28 22:00:09 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 22:00:09 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 22:00:09 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 22:00:10 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 22:00:10 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 22:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:00:10 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 22:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 22:00:10 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 22:00:10 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 22:00:10 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 22:00:10 [scrapy.core.engine] INFO: Spider opened
2026-03-28 22:00:10 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 22:00:10 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-28 22:00:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-28 22:00:10 [scrapy-playwright] INFO: Starting download handler
2026-03-28 22:00:10 [scrapy-playwright] INFO: Starting download handler
2026-03-28 22:00:10 [scrapy-playwright] INFO: Launching 1 startup context(s)
2026-03-28 22:00:10 [scrapy-playwright] INFO: Launching browser chromium
2026-03-28 22:00:10 [scrapy-playwright] INFO: Launching 1 startup context(s)
2026-03-28 22:00:10 [scrapy-playwright] INFO: Launching browser chromium
2026-03-28 22:00:10 [scrapy-playwright] INFO: Browser chromium launched
2026-03-28 22:00:10 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-28 22:00:10 [scrapy-playwright] INFO: Startup context(s) launched
2026-03-28 22:00:10 [scrapy-playwright] INFO: Browser chromium launched
2026-03-28 22:00:10 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-28 22:00:10 [scrapy-playwright] INFO: Startup context(s) launched
2026-03-28 22:00:15 [bca.uk] INFO: No cached cookies available, starting login process with credentials
2026-03-28 22:00:15 [bca.uk] INFO: Zyte login attempt 1/3
2026-03-28 22:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 22:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/> (referer: None) ['zyte-api']
2026-03-28 22:00:54 [bca.uk] INFO: Action 0 (waitForTimeout): status=success, elapsed=5.001s
2026-03-28 22:00:54 [bca.uk] INFO: Action 1 (waitForSelector): status=success, elapsed=0.007s
2026-03-28 22:00:54 [bca.uk] INFO: Action 2 (evaluate): status=success, elapsed=0.002s
2026-03-28 22:00:54 [bca.uk] INFO: Action 3 (waitForTimeout): status=success, elapsed=1s
2026-03-28 22:00:54 [bca.uk] INFO: Action 4 (click): status=success, elapsed=2.828s
2026-03-28 22:00:54 [bca.uk] INFO: Action 5 (waitForSelector): status=success, elapsed=0.838s
2026-03-28 22:00:54 [bca.uk] INFO: Action 6 (waitForTimeout): status=success, elapsed=0.999s
2026-03-28 22:00:54 [bca.uk] INFO: Action 7 (click): status=success, elapsed=2.276s
2026-03-28 22:00:54 [bca.uk] INFO: Action 8 (type): status=success, elapsed=0.02s
2026-03-28 22:00:54 [bca.uk] INFO: Action 9 (waitForTimeout): status=success, elapsed=1s
2026-03-28 22:00:54 [bca.uk] INFO: Action 10 (click): status=success, elapsed=2.282s
2026-03-28 22:00:54 [bca.uk] INFO: Action 11 (type): status=success, elapsed=0.019s
2026-03-28 22:00:54 [bca.uk] INFO: Action 12 (waitForTimeout): status=success, elapsed=1s
2026-03-28 22:00:54 [bca.uk] INFO: Action 13 (click): status=success, elapsed=1.614s
2026-03-28 22:00:54 [bca.uk] INFO: Action 14 (waitForSelector): status=success, elapsed=3.471s
2026-03-28 22:00:54 [bca.uk] INFO: Action 15 (evaluate): status=success, elapsed=0.001s
2026-03-28 22:00:54 [bca.uk] INFO: Action 16 (waitForTimeout): status=success, elapsed=10s
2026-03-28 22:00:54 [bca.uk] INFO: Action 17 (evaluate): status=success, elapsed=0.001s
2026-03-28 22:00:54 [bca.uk] INFO: Page URL after login: https://www.bca.co.uk/
2026-03-28 22:00:54 [bca.uk] INFO: Successfully logged in via Zyte API session
2026-03-28 22:00:54 [bca.uk] INFO: Scrapy-formatted cookies: [{'name': 'dtCookie', 'value': 'v_4_srv_1_sn_9DC31FA2B2ECD5E8DD5114D42C519C94_perc_100000_ol_0_mul_1_app-3A5d68a08db18e8bbb_1_app-3Aea7c4b59f27d43eb_1', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'gpv_pn', 'value': 'auctionview', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'dtSa', 'value': '-', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'INGRESSCOOKIE', 'value': '201d4d7cdb35b651709a73d47c4eaea6|17148814d3d29f21517da122aae4be83', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'ASLBSACORS', 'value': '000323392f7a18bd2b0ff7209c28bb25c0f06dee33a9cf62b65238d7d6868fdf5ddf', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': '__cf_bm', 'value': 'CaWRGzeSAiJwSq4dojJkynW882Cl4GgYT44.blIpvNA-1774735216.0315707-1.0.1.1-mWTXml39O6f.fVeJyLbXa18S.1wJ3eUpM5pzelnhaVRV2hdiJyuWJL24si.GjI.CztVplrepgSOUP3D_7EF9v_P5yLQSKYIJw6K7LOcYHN.a7YLZkg2cS9f9uw8Q.ebwc3krSBA1sYYxRpCjNvu30w', 'domain': '.bca.co.uk', 'path': '/'}, {'name': '_legacy_auth0.VS7z7E8b9vqJ2LYaGXEbb1f5CP1SGRLD.is.authenticated', 'value': 'true', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'OptanonAlertBoxClosed', 'value': '2026-03-28T22:00:25.193Z', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'AMCVS_E5F2C8A15481C0E20A4C98BC%40AdobeOrg', 'value': '1', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 's_sq', 'value': '%5B%5BB%5D%5D', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'sc_dslv_s', 'value': 'First%20Visit', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'OptanonConsent', 'value': 'isGpcEnabled=0&datestamp=Sat+Mar+28+2026+18%3A00%3A41+GMT-0400+(Eastern+Daylight+Time)&version=202510.1.0&browserGpcFlag=0&isIABGlobal=false&hosts=&consentId=85110371-8379-42d1-b2a5-4e704d3fa72b&interactionCount=1&isAnonUser=1&landingPath=NotLandingPage&groups=C0001%3A1%2CC0003%3A1%2CC0004%3A1%2CC0002%3A1&intType=1&geolocation=US%3BUT&AwaitingReconsent=false', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'ASLBSA', 'value': '000323392f7a18bd2b0ff7209c28bb25c0f06dee33a9cf62b65238d7d6868fdf5ddf', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'dest', 'value': 'https://www.bca.co.uk/', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'csrf', 'value': 'q4BW8y5SHircD7CSxZsWWNGGVTipfE6cgcwFNoCrMJgRd74AAlZYyb840KTE1fpfgH4Nh-fUjeWpyS6X15usDA:AAABnTZ2T2U:IVuTlKcslsNMZq4wlt47Mw', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'auth0.VS7z7E8b9vqJ2LYaGXEbb1f5CP1SGRLD.is.authenticated', 'value': 'true', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'rxVisitor', 'value': '1774735217668EMUKP8AMAQV1HCC1VEFDHA7J540VTBKN', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'rxvt', 'value': '1774737042274|1774735217669', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'dtPC', 'value': '1$535241555_535h-vUJHTEQUBHCDMCAFPADGCRUHTBVFHPTFG-0e0', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'AMCV_E5F2C8A15481C0E20A4C98BC%40AdobeOrg', 'value': '179643557%7CMCIDTS%7C20541%7CMCMID%7C84308657473883267122374660582521709602%7CMCAAMLH-1775340030%7C7%7CMCAAMB-1775340030%7C6G1ynYcLPuiQxYZrsz_pkqfLG9yMXBpb2zX5dvJdYQJzPXImdj0y%7CMCOPTOUT-1774742430s%7CNONE%7CMCSYNCSOP%7C411-20548%7CvVersion%7C5.5.0', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 's_cc', 'value': 'true', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'sc_dslv', 'value': '1774735242389', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'JSESSIONID', 'value': '519A039170E43BA77F956397FAD11C70', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 's_getNewRepeat', 'value': '1774735242390-New', 'domain': '.bca.co.uk', 'path': '/'}]
2026-03-28 22:00:54 [bca.uk] INFO: Extracted 24 cookies from Zyte login response
2026-03-28 22:00:54 [bca.uk] INFO: Merged 15 browser cookies, total: 24
2026-03-28 22:00:54 [bca.uk] INFO: Auth0 token capture: token=yes, error=client-created
2026-03-28 22:00:54 [bca.uk] INFO: Got Auth0 access token via dynamic SDK (length=1492)
2026-03-28 22:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='BCAUk',RowKey='auth_token') HTTP/1.1" 204 0
2026-03-28 22:00:54 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded
2026-03-28 22:00:54 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 22:00:54 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 22:00:54 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 22:00:54 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 22:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 22:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 22:00:56 [bca.uk] INFO: Total items found: 100
2026-03-28 22:00:56 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded
2026-03-28 22:00:56 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 22:00:56 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 22:00:56 [bca.uk] INFO: Found listing with ID: KS17%20LFM
2026-03-28 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS17%2520LFM%27 HTTP/1.1" 200 None
2026-03-28 22:00:56 [bca.uk] INFO: Scrape type for KS17%20LFM: 2
2026-03-28 22:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7e7267c-3859-58ff-bb8b-d88955b93932 with identifier: KS17%20LFM
2026-03-28 22:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7e7267c-3859-58ff-bb8b-d88955b93932 with scrape type 2
2026-03-28 22:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7e7267c-3859-58ff-bb8b-d88955b93932 with scrape type 2
2026-03-28 22:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a7e7267c-3859-58ff-bb8b-d88955b93932, identifier: KS17%20LFM
2026-03-28 22:00:57 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 22:00:57 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 22:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a7e7267c-3859-58ff-bb8b-d88955b93932 with identifier: KS17%20LFM
2026-03-28 22:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 22:00:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 22:00:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 22:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 22:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 22:00:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2026-03-28 22:00:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 22:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 22:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a7e7267c-3859-58ff-bb8b-d88955b93932 with identifier: KS17%20LFM
2026-03-28 22:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a7e7267c-3859-58ff-bb8b-d88955b93932 with identifier: KS17%20LFM to the API
2026-03-28 22:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KS17%20LFM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.1L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a7e7267c-3859-58ff-bb8b-d88955b93932',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KS17 LFM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KS17%20LFM&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'MERCEDES-BENZ',
'model': 'C220 D',
'odometer': 54967,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C220 D 2.1 SPORT 9G Saloon',
'transmission': 'manual',
'trim': 'SPORT 9G',
'vin': 'WDD2050042R277834',
'year': 2017}
2026-03-28 22:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS17%2520LFM%27 HTTP/1.1" 200 None
2026-03-28 22:00:57 [bca.uk] INFO: Saving data for KS17%20LFM: {'auction_closing_time': 1774864800.0, 'created_time': 1774621325.060619, 'last_price_update_time': 1774735257.688781}
2026-03-28 22:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KS17%2520LFM') HTTP/1.1" 204 0
2026-03-28 22:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 22:00:57 [bca.uk] INFO: Found listing with ID: DS64%20KUP
2026-03-28 22:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS64%2520KUP%27 HTTP/1.1" 200 None
2026-03-28 22:00:57 [bca.uk] INFO: Scrape type for DS64%20KUP: 2
2026-03-28 22:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff597d53-a947-58e9-aa57-dc9ae1cfe4df with identifier: DS64%20KUP
2026-03-28 22:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff597d53-a947-58e9-aa57-dc9ae1cfe4df with scrape type 2
2026-03-28 22:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff597d53-a947-58e9-aa57-dc9ae1cfe4df with scrape type 2
2026-03-28 22:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ff597d53-a947-58e9-aa57-dc9ae1cfe4df, identifier: DS64%20KUP
2026-03-28 22:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ff597d53-a947-58e9-aa57-dc9ae1cfe4df with identifier: DS64%20KUP
2026-03-28 22:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ff597d53-a947-58e9-aa57-dc9ae1cfe4df with identifier: DS64%20KUP
2026-03-28 22:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ff597d53-a947-58e9-aa57-dc9ae1cfe4df with identifier: DS64%20KUP to the API
2026-03-28 22:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 98,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DS64%20KUP-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'ff597d53-a947-58e9-aa57-dc9ae1cfe4df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DS64 KUP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DS64%20KUP&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'VAUXHALL',
'model': 'INSIGNIA',
'odometer': 174991,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VAUXHALL INSIGNIA 2.0 CDTI E/F 140 ELITE Hatchback',
'transmission': 'manual',
'trim': 'CDTI E/F 140 ELITE',
'vin': 'W0LGT6ES0E1188666',
'year': 2015}
2026-03-28 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS64%2520KUP%27 HTTP/1.1" 200 None
2026-03-28 22:00:58 [bca.uk] INFO: Saving data for DS64%20KUP: {'auction_closing_time': 1774864800.0, 'created_time': 1774621319.366533, 'last_price_update_time': 1774735258.817672}
2026-03-28 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DS64%2520KUP') HTTP/1.1" 204 0
2026-03-28 22:00:58 [bca.uk] INFO: Found listing with ID: DY61%20NHM
2026-03-28 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY61%2520NHM%27 HTTP/1.1" 200 None
2026-03-28 22:00:58 [bca.uk] INFO: Scrape type for DY61%20NHM: 0
2026-03-28 22:00:58 [bca.uk] INFO: Found listing with ID: EU12%20RAX
2026-03-28 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU12%2520RAX%27 HTTP/1.1" 200 None
2026-03-28 22:00:58 [bca.uk] INFO: Scrape type for EU12%20RAX: 0
2026-03-28 22:00:58 [bca.uk] INFO: Found listing with ID: FG12%20NLT
2026-03-28 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG12%2520NLT%27 HTTP/1.1" 200 None
2026-03-28 22:00:58 [bca.uk] INFO: Scrape type for FG12%20NLT: 2
2026-03-28 22:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa26ba11-51d0-5aa4-bedc-fa00c3caea9b with identifier: FG12%20NLT
2026-03-28 22:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa26ba11-51d0-5aa4-bedc-fa00c3caea9b with scrape type 2
2026-03-28 22:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa26ba11-51d0-5aa4-bedc-fa00c3caea9b with scrape type 2
2026-03-28 22:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: aa26ba11-51d0-5aa4-bedc-fa00c3caea9b, identifier: FG12%20NLT
2026-03-28 22:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: aa26ba11-51d0-5aa4-bedc-fa00c3caea9b with identifier: FG12%20NLT
2026-03-28 22:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: aa26ba11-51d0-5aa4-bedc-fa00c3caea9b with identifier: FG12%20NLT
2026-03-28 22:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: aa26ba11-51d0-5aa4-bedc-fa00c3caea9b with identifier: FG12%20NLT to the API
2026-03-28 22:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 189,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FG12%20NLT-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'aa26ba11-51d0-5aa4-bedc-fa00c3caea9b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FG12 NLT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FG12%20NLT&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'HYUNDAI',
'model': 'IX35',
'odometer': 137263,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'HYUNDAI IX35 2.0 CRDI PREMIUM 4WD StationWagon',
'transmission': 'automatic',
'trim': 'CRDI PREMIUM 4WD',
'vin': 'TMAJU81VSCJ285868',
'year': 2012}
2026-03-28 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG12%2520NLT%27 HTTP/1.1" 200 None
2026-03-28 22:00:59 [bca.uk] INFO: Saving data for FG12%20NLT: {'auction_closing_time': 1774864800.0, 'created_time': 1774621317.605293, 'last_price_update_time': 1774735259.366998}
2026-03-28 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FG12%2520NLT') HTTP/1.1" 204 0
2026-03-28 22:00:59 [bca.uk] INFO: Found listing with ID: YF62%20DGV
2026-03-28 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF62%2520DGV%27 HTTP/1.1" 200 None
2026-03-28 22:00:59 [bca.uk] INFO: Scrape type for YF62%20DGV: 2
2026-03-28 22:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78515709-8a71-57cf-9588-b30df6d723f8 with identifier: YF62%20DGV
2026-03-28 22:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78515709-8a71-57cf-9588-b30df6d723f8 with scrape type 2
2026-03-28 22:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78515709-8a71-57cf-9588-b30df6d723f8 with scrape type 2
2026-03-28 22:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 78515709-8a71-57cf-9588-b30df6d723f8, identifier: YF62%20DGV
2026-03-28 22:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 78515709-8a71-57cf-9588-b30df6d723f8 with identifier: YF62%20DGV
2026-03-28 22:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 78515709-8a71-57cf-9588-b30df6d723f8 with identifier: YF62%20DGV
2026-03-28 22:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 78515709-8a71-57cf-9588-b30df6d723f8 with identifier: YF62%20DGV to the API
2026-03-28 22:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YF62%20DGV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '78515709-8a71-57cf-9588-b30df6d723f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YF62 DGV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YF62%20DGV&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'RENAULT',
'model': 'GRAND SCENIC',
'odometer': 105373,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'RENAULT GRAND SCENIC 1.5 DCI 110 DYNAMIQUE TOM TOM MPV',
'transmission': 'manual',
'trim': 'DCI 110 DYNAMIQUE TOM TOM',
'vin': 'VF1JZS4B648275815',
'year': 2012}
2026-03-28 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF62%2520DGV%27 HTTP/1.1" 200 None
2026-03-28 22:00:59 [bca.uk] INFO: Saving data for YF62%20DGV: {'auction_closing_time': 1774864800.0, 'created_time': 1774621331.351693, 'last_price_update_time': 1774735259.836606}
2026-03-28 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YF62%2520DGV') HTTP/1.1" 204 0
2026-03-28 22:00:59 [bca.uk] INFO: Found listing with ID: YG66%20MEV
2026-03-28 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG66%2520MEV%27 HTTP/1.1" 200 None
2026-03-28 22:00:59 [bca.uk] INFO: Scrape type for YG66%20MEV: 0
2026-03-28 22:00:59 [bca.uk] INFO: Found listing with ID: DP64%20OFX
2026-03-28 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP64%2520OFX%27 HTTP/1.1" 200 None
2026-03-28 22:00:59 [bca.uk] INFO: Scrape type for DP64%20OFX: 0
2026-03-28 22:00:59 [bca.uk] INFO: Found listing with ID: VA62%20BTY
2026-03-28 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA62%2520BTY%27 HTTP/1.1" 200 None
2026-03-28 22:00:59 [bca.uk] INFO: Scrape type for VA62%20BTY: 1
2026-03-28 22:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44fab252-6185-51e4-87e9-3f4c2a42edd8 with identifier: VA62%20BTY
2026-03-28 22:00:59 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 44fab252-6185-51e4-87e9-3f4c2a42edd8
2026-03-28 22:00:59 [bca.uk] INFO: Found listing with ID: VO13%20UKS
2026-03-28 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO13%2520UKS%27 HTTP/1.1" 200 None
2026-03-28 22:00:59 [bca.uk] INFO: Scrape type for VO13%20UKS: 2
2026-03-28 22:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eec3315a-de1c-520f-8211-a4488a48f56d with identifier: VO13%20UKS
2026-03-28 22:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eec3315a-de1c-520f-8211-a4488a48f56d with scrape type 2
2026-03-28 22:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eec3315a-de1c-520f-8211-a4488a48f56d with scrape type 2
2026-03-28 22:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: eec3315a-de1c-520f-8211-a4488a48f56d, identifier: VO13%20UKS
2026-03-28 22:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: eec3315a-de1c-520f-8211-a4488a48f56d with identifier: VO13%20UKS
2026-03-28 22:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 22:01:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 22:01:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 22:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 22:01:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2026-03-28 22:01:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 22:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: eec3315a-de1c-520f-8211-a4488a48f56d with identifier: VO13%20UKS
2026-03-28 22:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: eec3315a-de1c-520f-8211-a4488a48f56d with identifier: VO13%20UKS to the API
2026-03-28 22:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO13%20UKS-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'eec3315a-de1c-520f-8211-a4488a48f56d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VO13 UKS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VO13%20UKS&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 74667,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 16V ENERGY Hatchback',
'transmission': 'manual',
'trim': '16V ENERGY',
'vin': 'W0L0SDL08D4115440',
'year': 2013}
2026-03-28 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO13%2520UKS%27 HTTP/1.1" 200 None
2026-03-28 22:01:00 [bca.uk] INFO: Saving data for VO13%20UKS: {'auction_closing_time': 1774864800.0, 'created_time': 1774620798.556471, 'last_price_update_time': 1774735260.701564}
2026-03-28 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VO13%2520UKS') HTTP/1.1" 204 0
2026-03-28 22:01:00 [bca.uk] INFO: Found listing with ID: DS09%20KHK
2026-03-28 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS09%2520KHK%27 HTTP/1.1" 200 None
2026-03-28 22:01:00 [bca.uk] INFO: Scrape type for DS09%20KHK: 0
2026-03-28 22:01:00 [bca.uk] INFO: Found listing with ID: DY59%20OYL
2026-03-28 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY59%2520OYL%27 HTTP/1.1" 200 None
2026-03-28 22:01:00 [bca.uk] INFO: Scrape type for DY59%20OYL: 2
2026-03-28 22:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cb56991-e767-5f50-9e1e-b3b6fde8ef25 with identifier: DY59%20OYL
2026-03-28 22:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cb56991-e767-5f50-9e1e-b3b6fde8ef25 with scrape type 2
2026-03-28 22:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cb56991-e767-5f50-9e1e-b3b6fde8ef25 with scrape type 2
2026-03-28 22:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4cb56991-e767-5f50-9e1e-b3b6fde8ef25, identifier: DY59%20OYL
2026-03-28 22:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4cb56991-e767-5f50-9e1e-b3b6fde8ef25 with identifier: DY59%20OYL
2026-03-28 22:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 22:01:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 22:01:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 22:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 22:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4cb56991-e767-5f50-9e1e-b3b6fde8ef25 with identifier: DY59%20OYL
2026-03-28 22:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4cb56991-e767-5f50-9e1e-b3b6fde8ef25 with identifier: DY59%20OYL to the API
2026-03-28 22:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DY59%20OYL-GB',
'category': 'Car',
'color': 'green',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4cb56991-e767-5f50-9e1e-b3b6fde8ef25',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DY59 OYL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DY59%20OYL&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VOLVO',
'model': 'C30',
'odometer': 129529,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VOLVO C30 1.6 D DRIVE R DESIGN Coupe',
'transmission': 'manual',
'trim': 'D DRIVE R DESIGN',
'vin': 'YV1MK76F2A2174340',
'year': 2009}
2026-03-28 22:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY59%2520OYL%27 HTTP/1.1" 200 None
2026-03-28 22:01:01 [bca.uk] INFO: Saving data for DY59%20OYL: {'auction_closing_time': 1774864800.0, 'created_time': 1773930107.415081, 'last_price_update_time': 1774735261.378221}
2026-03-28 22:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DY59%2520OYL') HTTP/1.1" 204 0
2026-03-28 22:01:01 [bca.uk] INFO: Found listing with ID: KS09%20VZK
2026-03-28 22:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS09%2520VZK%27 HTTP/1.1" 200 None
2026-03-28 22:01:01 [bca.uk] INFO: Scrape type for KS09%20VZK: 2
2026-03-28 22:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47fbd3e7-334b-55ca-adcc-a150029eb84e with identifier: KS09%20VZK
2026-03-28 22:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47fbd3e7-334b-55ca-adcc-a150029eb84e with scrape type 2
2026-03-28 22:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47fbd3e7-334b-55ca-adcc-a150029eb84e with scrape type 2
2026-03-28 22:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 47fbd3e7-334b-55ca-adcc-a150029eb84e, identifier: KS09%20VZK
2026-03-28 22:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 47fbd3e7-334b-55ca-adcc-a150029eb84e with identifier: KS09%20VZK
2026-03-28 22:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 47fbd3e7-334b-55ca-adcc-a150029eb84e with identifier: KS09%20VZK
2026-03-28 22:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 47fbd3e7-334b-55ca-adcc-a150029eb84e with identifier: KS09%20VZK to the API
2026-03-28 22:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 162,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KS09%20VZK-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '47fbd3e7-334b-55ca-adcc-a150029eb84e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KS09 VZK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KS09%20VZK&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'MERCEDES-BENZ',
'model': 'A160',
'odometer': 120327,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A160 1.5 ELEGANCE SE Hatchback',
'transmission': 'automatic',
'trim': 'ELEGANCE SE',
'vin': 'WDD1690312J757696',
'year': 2009}
2026-03-28 22:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS09%2520VZK%27 HTTP/1.1" 200 None
2026-03-28 22:01:01 [bca.uk] INFO: Saving data for KS09%20VZK: {'auction_closing_time': 1774864800.0, 'created_time': 1774621318.332009, 'last_price_update_time': 1774735261.999243}
2026-03-28 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KS09%2520VZK') HTTP/1.1" 204 0
2026-03-28 22:01:02 [bca.uk] INFO: Found listing with ID: KU60%20XCH
2026-03-28 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU60%2520XCH%27 HTTP/1.1" 200 None
2026-03-28 22:01:02 [bca.uk] INFO: Scrape type for KU60%20XCH: 2
2026-03-28 22:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac60bf19-8e22-5b08-a6d1-6fe027aedebf with identifier: KU60%20XCH
2026-03-28 22:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac60bf19-8e22-5b08-a6d1-6fe027aedebf with scrape type 2
2026-03-28 22:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac60bf19-8e22-5b08-a6d1-6fe027aedebf with scrape type 2
2026-03-28 22:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ac60bf19-8e22-5b08-a6d1-6fe027aedebf, identifier: KU60%20XCH
2026-03-28 22:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ac60bf19-8e22-5b08-a6d1-6fe027aedebf with identifier: KU60%20XCH
2026-03-28 22:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ac60bf19-8e22-5b08-a6d1-6fe027aedebf with identifier: KU60%20XCH
2026-03-28 22:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ac60bf19-8e22-5b08-a6d1-6fe027aedebf with identifier: KU60%20XCH to the API
2026-03-28 22:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 179,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KU60%20XCH-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'ac60bf19-8e22-5b08-a6d1-6fe027aedebf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KU60 XCH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KU60%20XCH&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'AUDI',
'model': 'Q5',
'odometer': 130823,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'AUDI Q5 2.0 TDI 170 QUATTRO SE S-T StationWagon',
'transmission': 'automatic',
'trim': 'TDI 170 QUATTRO SE S-T',
'vin': 'WAUZZZ8R1BA024273',
'year': 2010}
2026-03-28 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU60%2520XCH%27 HTTP/1.1" 200 None
2026-03-28 22:01:02 [bca.uk] INFO: Saving data for KU60%20XCH: {'auction_closing_time': 1774864800.0, 'created_time': 1774478641.414568, 'last_price_update_time': 1774735262.505841}
2026-03-28 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KU60%2520XCH') HTTP/1.1" 204 0
2026-03-28 22:01:02 [bca.uk] INFO: Found listing with ID: LY10%20BTE
2026-03-28 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY10%2520BTE%27 HTTP/1.1" 200 None
2026-03-28 22:01:02 [bca.uk] INFO: Scrape type for LY10%20BTE: 2
2026-03-28 22:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6698f5fc-274b-50e1-95fb-b175f76efb4c with identifier: LY10%20BTE
2026-03-28 22:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6698f5fc-274b-50e1-95fb-b175f76efb4c with scrape type 2
2026-03-28 22:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6698f5fc-274b-50e1-95fb-b175f76efb4c with scrape type 2
2026-03-28 22:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6698f5fc-274b-50e1-95fb-b175f76efb4c, identifier: LY10%20BTE
2026-03-28 22:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 22:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6698f5fc-274b-50e1-95fb-b175f76efb4c with identifier: LY10%20BTE
2026-03-28 22:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 22:01:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 22:01:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 22:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6698f5fc-274b-50e1-95fb-b175f76efb4c with identifier: LY10%20BTE
2026-03-28 22:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6698f5fc-274b-50e1-95fb-b175f76efb4c with identifier: LY10%20BTE to the API
2026-03-28 22:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LY10%20BTE-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '6698f5fc-274b-50e1-95fb-b175f76efb4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LY10 BTE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LY10%20BTE&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'CITROEN',
'model': 'C3',
'odometer': 72965,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'CITROEN C3 1.6 HDI 90 EXCLUSIVE Hatchback',
'transmission': 'manual',
'trim': 'HDI 90 EXCLUSIVE',
'vin': 'VF7SC9HXCAA577332',
'year': 2010}
2026-03-28 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY10%2520BTE%27 HTTP/1.1" 200 None
2026-03-28 22:01:03 [bca.uk] INFO: Saving data for LY10%20BTE: {'auction_closing_time': 1774864800.0, 'created_time': 1774620805.19089, 'last_price_update_time': 1774735263.194984}
2026-03-28 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LY10%2520BTE') HTTP/1.1" 204 0
2026-03-28 22:01:03 [bca.uk] INFO: Found listing with ID: MV60%20OCJ
2026-03-28 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV60%2520OCJ%27 HTTP/1.1" 200 None
2026-03-28 22:01:03 [bca.uk] INFO: Scrape type for MV60%20OCJ: 0
2026-03-28 22:01:03 [bca.uk] INFO: Found listing with ID: ND62%20EWM
2026-03-28 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND62%2520EWM%27 HTTP/1.1" 200 None
2026-03-28 22:01:03 [bca.uk] INFO: Scrape type for ND62%20EWM: 1
2026-03-28 22:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fc2a305-976b-5d20-86ca-43ed711c23db with identifier: ND62%20EWM
2026-03-28 22:01:03 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1fc2a305-976b-5d20-86ca-43ed711c23db
2026-03-28 22:01:03 [bca.uk] INFO: Found listing with ID: OV07%20NNA
2026-03-28 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV07%2520NNA%27 HTTP/1.1" 200 None
2026-03-28 22:01:03 [bca.uk] INFO: Scrape type for OV07%20NNA: 2
2026-03-28 22:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0406c53-da78-545a-93b7-f05f99baea7e with identifier: OV07%20NNA
2026-03-28 22:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0406c53-da78-545a-93b7-f05f99baea7e with scrape type 2
2026-03-28 22:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0406c53-da78-545a-93b7-f05f99baea7e with scrape type 2
2026-03-28 22:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c0406c53-da78-545a-93b7-f05f99baea7e, identifier: OV07%20NNA
2026-03-28 22:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c0406c53-da78-545a-93b7-f05f99baea7e with identifier: OV07%20NNA
2026-03-28 22:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c0406c53-da78-545a-93b7-f05f99baea7e with identifier: OV07%20NNA
2026-03-28 22:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c0406c53-da78-545a-93b7-f05f99baea7e with identifier: OV07%20NNA to the API
2026-03-28 22:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 207,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV07%20NNA-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c0406c53-da78-545a-93b7-f05f99baea7e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OV07 NNA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OV07%20NNA&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'SUBARU',
'model': 'LEGACY OUTBACK',
'odometer': 143535,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'SUBARU LEGACY OUTBACK 2.5 173 SEN SPORT TOURER Estate',
'transmission': 'automatic',
'trim': '173 SEN SPORT TOURER',
'vin': 'JF1BP9KLA7G048237',
'year': 2007}
2026-03-28 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV07%2520NNA%27 HTTP/1.1" 200 None
2026-03-28 22:01:03 [bca.uk] INFO: Saving data for OV07%20NNA: {'auction_closing_time': 1774864800.0, 'created_time': 1774524274.223216, 'last_price_update_time': 1774735263.675995}
2026-03-28 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OV07%2520NNA') HTTP/1.1" 204 0
2026-03-28 22:01:03 [bca.uk] INFO: Total items found: 100
2026-03-28 22:01:03 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded
2026-03-28 22:01:03 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 22:01:03 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 22:01:03 [bca.uk] INFO: Found listing with ID: OY14%20LMF
2026-03-28 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY14%2520LMF%27 HTTP/1.1" 200 None
2026-03-28 22:01:03 [bca.uk] INFO: Scrape type for OY14%20LMF: 0
2026-03-28 22:01:03 [bca.uk] INFO: Found listing with ID: P60%20GOB
2026-03-28 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27P60%2520GOB%27 HTTP/1.1" 200 None
2026-03-28 22:01:03 [bca.uk] INFO: Scrape type for P60%20GOB: 2
2026-03-28 22:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a6c66a3-5609-50c9-bc1e-1b6e2c8d4e7c with identifier: P60%20GOB
2026-03-28 22:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a6c66a3-5609-50c9-bc1e-1b6e2c8d4e7c with scrape type 2
2026-03-28 22:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a6c66a3-5609-50c9-bc1e-1b6e2c8d4e7c with scrape type 2
2026-03-28 22:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2a6c66a3-5609-50c9-bc1e-1b6e2c8d4e7c, identifier: P60%20GOB
2026-03-28 22:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2a6c66a3-5609-50c9-bc1e-1b6e2c8d4e7c with identifier: P60%20GOB
2026-03-28 22:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 22:01:03 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 22:01:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 22:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2a6c66a3-5609-50c9-bc1e-1b6e2c8d4e7c with identifier: P60%20GOB
2026-03-28 22:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2a6c66a3-5609-50c9-bc1e-1b6e2c8d4e7c with identifier: P60%20GOB to the API
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=P60%20GOB-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2a6c66a3-5609-50c9-bc1e-1b6e2c8d4e7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'P60 GOB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=P60%20GOB&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'CITROEN',
'model': 'DS4',
'odometer': 124652,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'CITROEN DS4 2.0 HDI 160 DSTYLE Hatchback',
'transmission': 'manual',
'trim': 'HDI 160 DSTYLE',
'vin': 'VF7NXRHH8CY614488',
'year': 2012}
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27P60%2520GOB%27 HTTP/1.1" 200 None
2026-03-28 22:01:04 [bca.uk] INFO: Saving data for P60%20GOB: {'auction_closing_time': 1774864800.0, 'created_time': 1774622489.588226, 'last_price_update_time': 1774735264.297431}
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='P60%2520GOB') HTTP/1.1" 204 0
2026-03-28 22:01:04 [bca.uk] INFO: Found listing with ID: GN15%20TXC
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN15%2520TXC%27 HTTP/1.1" 200 None
2026-03-28 22:01:04 [bca.uk] INFO: Scrape type for GN15%20TXC: 0
2026-03-28 22:01:04 [bca.uk] INFO: Found listing with ID: DY15%20MXL
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY15%2520MXL%27 HTTP/1.1" 200 None
2026-03-28 22:01:04 [bca.uk] INFO: Scrape type for DY15%20MXL: 0
2026-03-28 22:01:04 [bca.uk] INFO: Found listing with ID: VA57%20MMV
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA57%2520MMV%27 HTTP/1.1" 200 None
2026-03-28 22:01:04 [bca.uk] INFO: Scrape type for VA57%20MMV: 2
2026-03-28 22:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04f0d7cf-f3c1-57e5-aa5b-17da875086d9 with identifier: VA57%20MMV
2026-03-28 22:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04f0d7cf-f3c1-57e5-aa5b-17da875086d9 with scrape type 2
2026-03-28 22:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04f0d7cf-f3c1-57e5-aa5b-17da875086d9 with scrape type 2
2026-03-28 22:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 04f0d7cf-f3c1-57e5-aa5b-17da875086d9, identifier: VA57%20MMV
2026-03-28 22:01:04 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 22:01:04 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 22:01:04 [bca.uk] INFO: Found listing with ID: PJ12%20NEO
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ12%2520NEO%27 HTTP/1.1" 200 None
2026-03-28 22:01:04 [bca.uk] INFO: Scrape type for PJ12%20NEO: 1
2026-03-28 22:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf9384a7-c2b5-5829-81c5-0ab07891768a with identifier: PJ12%20NEO
2026-03-28 22:01:04 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cf9384a7-c2b5-5829-81c5-0ab07891768a
2026-03-28 22:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 04f0d7cf-f3c1-57e5-aa5b-17da875086d9 with identifier: VA57%20MMV
2026-03-28 22:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 04f0d7cf-f3c1-57e5-aa5b-17da875086d9 with identifier: VA57%20MMV
2026-03-28 22:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 04f0d7cf-f3c1-57e5-aa5b-17da875086d9 with identifier: VA57%20MMV to the API
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 174,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VA57%20MMV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '04f0d7cf-f3c1-57e5-aa5b-17da875086d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VA57 MMV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VA57%20MMV&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 120211,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.4 TSI 170 GT SPORT DSG Hatchback',
'transmission': 'automatic',
'trim': 'TSI 170 GT SPORT DSG',
'vin': 'WVWZZZ1KZ8W158019',
'year': 2007}
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA57%2520MMV%27 HTTP/1.1" 200 None
2026-03-28 22:01:04 [bca.uk] INFO: Saving data for VA57%20MMV: {'auction_closing_time': 1774951200.0, 'created_time': 1774610845.093, 'last_price_update_time': 1774735264.776256}
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VA57%2520MMV') HTTP/1.1" 204 0
2026-03-28 22:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 22:01:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VA62BTY/42810684?sv=2020-08-04&st=2026-03-28T22%3A01%3A03Z&se=2026-03-28T22%3A26%3A03Z&sr=b&sp=r&sig=N35MQzuEGC1T9OsmIXtmUT3IIUk5%2F7R2XsmdyzT4d0M%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VA62%20BTY-GB>
2026-03-28 22:01:04 [bca.uk] INFO: Found listing with ID: AV03%20RSZ
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV03%2520RSZ%27 HTTP/1.1" 200 None
2026-03-28 22:01:04 [bca.uk] INFO: Scrape type for AV03%20RSZ: 1
2026-03-28 22:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8076e5d-cb8b-5578-9e3b-020e67e6d8b5 with identifier: AV03%20RSZ
2026-03-28 22:01:04 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d8076e5d-cb8b-5578-9e3b-020e67e6d8b5
2026-03-28 22:01:04 [bca.uk] INFO: Found listing with ID: SA62%20FAO
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA62%2520FAO%27 HTTP/1.1" 200 None
2026-03-28 22:01:04 [bca.uk] INFO: Scrape type for SA62%20FAO: 0
2026-03-28 22:01:04 [bca.uk] INFO: Found listing with ID: AP17%20LGF
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP17%2520LGF%27 HTTP/1.1" 200 None
2026-03-28 22:01:04 [bca.uk] INFO: Scrape type for AP17%20LGF: 2
2026-03-28 22:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2acfb3fd-c70f-5159-a4ef-29be5c93f30b with identifier: AP17%20LGF
2026-03-28 22:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2acfb3fd-c70f-5159-a4ef-29be5c93f30b with scrape type 2
2026-03-28 22:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2acfb3fd-c70f-5159-a4ef-29be5c93f30b with scrape type 2
2026-03-28 22:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2acfb3fd-c70f-5159-a4ef-29be5c93f30b, identifier: AP17%20LGF
2026-03-28 22:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2acfb3fd-c70f-5159-a4ef-29be5c93f30b with identifier: AP17%20LGF
2026-03-28 22:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2acfb3fd-c70f-5159-a4ef-29be5c93f30b with identifier: AP17%20LGF
2026-03-28 22:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2acfb3fd-c70f-5159-a4ef-29be5c93f30b with identifier: AP17%20LGF to the API
2026-03-28 22:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AP17%20LGF-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2acfb3fd-c70f-5159-a4ef-29be5c93f30b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AP17 LGF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AP17%20LGF&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 64346,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 100 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'E/B 100 ZETEC',
'vin': 'WF0CXXGAKCHU58671',
'year': 2017}
2026-03-28 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP17%2520LGF%27 HTTP/1.1" 200 None
2026-03-28 22:01:05 [bca.uk] INFO: Saving data for AP17%20LGF: {'auction_closing_time': 1774864800.0, 'created_time': 1774622495.894769, 'last_price_update_time': 1774735265.359726}
2026-03-28 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AP17%2520LGF') HTTP/1.1" 204 0
2026-03-28 22:01:05 [bca.uk] INFO: Found listing with ID: GC14%20BYZ
2026-03-28 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GC14%2520BYZ%27 HTTP/1.1" 200 None
2026-03-28 22:01:05 [bca.uk] INFO: Scrape type for GC14%20BYZ: 2
2026-03-28 22:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcd8052e-f089-5d60-ac6b-712aed7f241e with identifier: GC14%20BYZ
2026-03-28 22:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcd8052e-f089-5d60-ac6b-712aed7f241e with scrape type 2
2026-03-28 22:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcd8052e-f089-5d60-ac6b-712aed7f241e with scrape type 2
2026-03-28 22:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fcd8052e-f089-5d60-ac6b-712aed7f241e, identifier: GC14%20BYZ
2026-03-28 22:01:05 [bca.uk] INFO: Found listing with ID: BD57%20OLK
2026-03-28 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD57%2520OLK%27 HTTP/1.1" 200 None
2026-03-28 22:01:05 [bca.uk] INFO: Scrape type for BD57%20OLK: 1
2026-03-28 22:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f1a744f-dcf7-513c-adf2-49d9ca828470 with identifier: BD57%20OLK
2026-03-28 22:01:05 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8f1a744f-dcf7-513c-adf2-49d9ca828470
2026-03-28 22:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fcd8052e-f089-5d60-ac6b-712aed7f241e with identifier: GC14%20BYZ
2026-03-28 22:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fcd8052e-f089-5d60-ac6b-712aed7f241e with identifier: GC14%20BYZ
2026-03-28 22:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fcd8052e-f089-5d60-ac6b-712aed7f241e with identifier: GC14%20BYZ to the API
2026-03-28 22:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 169,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GC14%20BYZ-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fcd8052e-f089-5d60-ac6b-712aed7f241e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GC14 BYZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GC14%20BYZ&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 31958,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FOCUS 2.0 T E/B 250 ST-2 Hatchback',
'transmission': 'manual',
'trim': 'T E/B 250 ST-2',
'vin': 'WF0KXXGCBKEM32085',
'year': 2014}
2026-03-28 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GC14%2520BYZ%27 HTTP/1.1" 200 None
2026-03-28 22:01:05 [bca.uk] INFO: Saving data for GC14%20BYZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774621670.131004, 'last_price_update_time': 1774735265.902338}
2026-03-28 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GC14%2520BYZ') HTTP/1.1" 204 0
2026-03-28 22:01:05 [bca.uk] INFO: Found listing with ID: GJ09%20KHA
2026-03-28 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ09%2520KHA%27 HTTP/1.1" 200 None
2026-03-28 22:01:05 [bca.uk] INFO: Scrape type for GJ09%20KHA: 2
2026-03-28 22:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4b8e4ec-0fff-5766-bf2c-1dd6848b6a5f with identifier: GJ09%20KHA
2026-03-28 22:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4b8e4ec-0fff-5766-bf2c-1dd6848b6a5f with scrape type 2
2026-03-28 22:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4b8e4ec-0fff-5766-bf2c-1dd6848b6a5f with scrape type 2
2026-03-28 22:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f4b8e4ec-0fff-5766-bf2c-1dd6848b6a5f, identifier: GJ09%20KHA
2026-03-28 22:01:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ12NEO/42811151?sv=2020-08-04&st=2026-03-28T22%3A01%3A05Z&se=2026-03-28T22%3A26%3A05Z&sr=b&sp=r&sig=62h1oUPBDkzrRTgiSRZPyg2OGFZw9gvgjM6%2Bng4Eeco%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ12%20NEO-GB>
2026-03-28 22:01:06 [bca.uk] INFO: Found listing with ID: CN63%20OLH
2026-03-28 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN63%2520OLH%27 HTTP/1.1" 200 None
2026-03-28 22:01:06 [bca.uk] INFO: Scrape type for CN63%20OLH: 1
2026-03-28 22:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39f18d5c-38c9-5802-bc90-29e03976b40f with identifier: CN63%20OLH
2026-03-28 22:01:06 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 39f18d5c-38c9-5802-bc90-29e03976b40f
2026-03-28 22:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f4b8e4ec-0fff-5766-bf2c-1dd6848b6a5f with identifier: GJ09%20KHA
2026-03-28 22:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f4b8e4ec-0fff-5766-bf2c-1dd6848b6a5f with identifier: GJ09%20KHA
2026-03-28 22:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f4b8e4ec-0fff-5766-bf2c-1dd6848b6a5f with identifier: GJ09%20KHA to the API
2026-03-28 22:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ09%20KHA-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f4b8e4ec-0fff-5766-bf2c-1dd6848b6a5f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ09 KHA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ09%20KHA&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'CITROEN',
'model': 'C4 PICASSO',
'odometer': 56631,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'CITROEN C4 PICASSO 1.6 HDI 110 VTR+ EGS MPV',
'transmission': 'automatic',
'trim': 'HDI 110 VTR+ EGS',
'vin': 'VF7UD9HZH45398350',
'year': 2009}
2026-03-28 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ09%2520KHA%27 HTTP/1.1" 200 None
2026-03-28 22:01:06 [bca.uk] INFO: Saving data for GJ09%20KHA: {'auction_closing_time': 1774864800.0, 'created_time': 1774620808.47365, 'last_price_update_time': 1774735266.451176}
2026-03-28 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ09%2520KHA') HTTP/1.1" 204 0
2026-03-28 22:01:06 [bca.uk] INFO: Found listing with ID: GK60%20ZSE
2026-03-28 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK60%2520ZSE%27 HTTP/1.1" 200 None
2026-03-28 22:01:06 [bca.uk] INFO: Scrape type for GK60%20ZSE: 0
2026-03-28 22:01:06 [bca.uk] INFO: Found listing with ID: LO10%20GWV
2026-03-28 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO10%2520GWV%27 HTTP/1.1" 200 None
2026-03-28 22:01:06 [bca.uk] INFO: Scrape type for LO10%20GWV: 2
2026-03-28 22:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0f5e6c9-06ba-5b09-9ec6-f7043019979d with identifier: LO10%20GWV
2026-03-28 22:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0f5e6c9-06ba-5b09-9ec6-f7043019979d with scrape type 2
2026-03-28 22:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0f5e6c9-06ba-5b09-9ec6-f7043019979d with scrape type 2
2026-03-28 22:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a0f5e6c9-06ba-5b09-9ec6-f7043019979d, identifier: LO10%20GWV
2026-03-28 22:01:06 [bca.uk] INFO: Found listing with ID: DA64%20WPD
2026-03-28 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA64%2520WPD%27 HTTP/1.1" 200 None
2026-03-28 22:01:06 [bca.uk] INFO: Scrape type for DA64%20WPD: 0
2026-03-28 22:01:06 [bca.uk] INFO: Found listing with ID: OY18%20OKJ
2026-03-28 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY18%2520OKJ%27 HTTP/1.1" 200 None
2026-03-28 22:01:06 [bca.uk] INFO: Scrape type for OY18%20OKJ: 0
2026-03-28 22:01:06 [bca.uk] INFO: Found listing with ID: PJ18%20YMZ
2026-03-28 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ18%2520YMZ%27 HTTP/1.1" 200 None
2026-03-28 22:01:06 [bca.uk] INFO: Scrape type for PJ18%20YMZ: 0
2026-03-28 22:01:06 [bca.uk] INFO: Found listing with ID: RX68%20XHM
2026-03-28 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX68%2520XHM%27 HTTP/1.1" 200 None
2026-03-28 22:01:06 [bca.uk] INFO: Scrape type for RX68%20XHM: 1
2026-03-28 22:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 502dec79-4436-5ea8-b8a4-1afd151a13a2 with identifier: RX68%20XHM
2026-03-28 22:01:06 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 502dec79-4436-5ea8-b8a4-1afd151a13a2
2026-03-28 22:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a0f5e6c9-06ba-5b09-9ec6-f7043019979d with identifier: LO10%20GWV
2026-03-28 22:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 22:01:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=grey HTTP/1.1" 200 None
2026-03-28 22:01:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 22:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a0f5e6c9-06ba-5b09-9ec6-f7043019979d with identifier: LO10%20GWV
2026-03-28 22:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a0f5e6c9-06ba-5b09-9ec6-f7043019979d with identifier: LO10%20GWV to the API
2026-03-28 22:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LO10%20GWV-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a0f5e6c9-06ba-5b09-9ec6-f7043019979d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LO10 GWV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LO10%20GWV&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 106149,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.4 85 SE DSG Hatchback',
'transmission': 'automatic',
'trim': '85 SE DSG',
'vin': 'WVWZZZ6RZAY271820',
'year': 2010}
2026-03-28 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO10%2520GWV%27 HTTP/1.1" 200 None
2026-03-28 22:01:07 [bca.uk] INFO: Saving data for LO10%20GWV: {'auction_closing_time': 1774864800.0, 'created_time': 1774621670.893105, 'last_price_update_time': 1774735267.282272}
2026-03-28 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LO10%2520GWV') HTTP/1.1" 204 0
2026-03-28 22:01:07 [bca.uk] INFO: Found listing with ID: PY60%20HJF
2026-03-28 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY60%2520HJF%27 HTTP/1.1" 200 None
2026-03-28 22:01:07 [bca.uk] INFO: Scrape type for PY60%20HJF: 2
2026-03-28 22:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3059609-afec-5b3f-8103-70b92c282897 with identifier: PY60%20HJF
2026-03-28 22:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3059609-afec-5b3f-8103-70b92c282897 with scrape type 2
2026-03-28 22:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3059609-afec-5b3f-8103-70b92c282897 with scrape type 2
2026-03-28 22:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e3059609-afec-5b3f-8103-70b92c282897, identifier: PY60%20HJF
2026-03-28 22:01:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND62EWM/42810799?sv=2020-08-04&st=2026-03-28T22%3A01%3A06Z&se=2026-03-28T22%3A26%3A06Z&sr=b&sp=r&sig=KD3C6SJzwrdEgIjlL7QRYHJfSgh8rbJ%2FPC%2F%2BEfVah7k%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND62%20EWM-GB>
2026-03-28 22:01:07 [bca.uk] INFO: Found listing with ID: HT19%20CVS
2026-03-28 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT19%2520CVS%27 HTTP/1.1" 200 None
2026-03-28 22:01:07 [bca.uk] INFO: Scrape type for HT19%20CVS: 1
2026-03-28 22:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2b3f5c4-70ca-530a-a56a-701b7ee98ebe with identifier: HT19%20CVS
2026-03-28 22:01:07 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d2b3f5c4-70ca-530a-a56a-701b7ee98ebe
2026-03-28 22:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e3059609-afec-5b3f-8103-70b92c282897 with identifier: PY60%20HJF
2026-03-28 22:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e3059609-afec-5b3f-8103-70b92c282897 with identifier: PY60%20HJF
2026-03-28 22:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e3059609-afec-5b3f-8103-70b92c282897 with identifier: PY60%20HJF to the API
2026-03-28 22:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PY60%20HJF-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e3059609-afec-5b3f-8103-70b92c282897',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PY60 HJF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PY60%20HJF&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MAZDA',
'model': '2',
'odometer': 59802,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'MAZDA 2 1.3 TAMURA Hatchback',
'transmission': 'manual',
'trim': 'TAMURA',
'vin': 'JMZDEA4J200403062',
'year': 2011}
2026-03-28 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY60%2520HJF%27 HTTP/1.1" 200 None
2026-03-28 22:01:07 [bca.uk] INFO: Saving data for PY60%20HJF: {'auction_closing_time': 1774864800.0, 'created_time': 1774622490.854148, 'last_price_update_time': 1774735267.838982}
2026-03-28 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PY60%2520HJF') HTTP/1.1" 204 0
2026-03-28 22:01:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD57OLK/42810740?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=6hm7fODnR3wBKimIVKSkEorWvM8%2B5kHNq4nMJt6A%2BvY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BD57%20OLK-GB>
2026-03-28 22:01:07 [bca.uk] INFO: Found listing with ID: SM62%20CJZ
2026-03-28 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM62%2520CJZ%27 HTTP/1.1" 200 None
2026-03-28 22:01:07 [bca.uk] INFO: Scrape type for SM62%20CJZ: 0
2026-03-28 22:01:07 [bca.uk] INFO: Found listing with ID: FV69%20BJO
2026-03-28 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV69%2520BJO%27 HTTP/1.1" 200 None
2026-03-28 22:01:07 [bca.uk] INFO: Scrape type for FV69%20BJO: 1
2026-03-28 22:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbce9e71-f6f9-5b70-87a1-2cf7e0368db6 with identifier: FV69%20BJO
2026-03-28 22:01:07 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item fbce9e71-f6f9-5b70-87a1-2cf7e0368db6
2026-03-28 22:01:07 [bca.uk] INFO: Found listing with ID: LT70%20TDO
2026-03-28 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT70%2520TDO%27 HTTP/1.1" 200 None
2026-03-28 22:01:07 [bca.uk] INFO: Scrape type for LT70%20TDO: 1
2026-03-28 22:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d540cd8f-d715-5405-a8d5-11721b31b439 with identifier: LT70%20TDO
2026-03-28 22:01:07 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d540cd8f-d715-5405-a8d5-11721b31b439
2026-03-28 22:01:07 [bca.uk] INFO: Found listing with ID: YS68%20WCC
2026-03-28 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS68%2520WCC%27 HTTP/1.1" 200 None
2026-03-28 22:01:07 [bca.uk] INFO: Scrape type for YS68%20WCC: 2
2026-03-28 22:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de869e9c-857e-550f-abd9-12553d63d9ad with identifier: YS68%20WCC
2026-03-28 22:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de869e9c-857e-550f-abd9-12553d63d9ad with scrape type 2
2026-03-28 22:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de869e9c-857e-550f-abd9-12553d63d9ad with scrape type 2
2026-03-28 22:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: de869e9c-857e-550f-abd9-12553d63d9ad, identifier: YS68%20WCC
2026-03-28 22:01:08 [bca.uk] INFO: Found listing with ID: BJ68%20UWN
2026-03-28 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ68%2520UWN%27 HTTP/1.1" 200 None
2026-03-28 22:01:08 [bca.uk] INFO: Scrape type for BJ68%20UWN: 1
2026-03-28 22:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f05d113-747f-52ed-a1ad-9799bad35377 with identifier: BJ68%20UWN
2026-03-28 22:01:08 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7f05d113-747f-52ed-a1ad-9799bad35377
2026-03-28 22:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: de869e9c-857e-550f-abd9-12553d63d9ad with identifier: YS68%20WCC
2026-03-28 22:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: de869e9c-857e-550f-abd9-12553d63d9ad with identifier: YS68%20WCC
2026-03-28 22:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: de869e9c-857e-550f-abd9-12553d63d9ad with identifier: YS68%20WCC to the API
2026-03-28 22:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YS68%20WCC-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'de869e9c-857e-550f-abd9-12553d63d9ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YS68 WCC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YS68%20WCC&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'ALFA ROMEO',
'model': 'STELVIO',
'odometer': 50497,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'ALFA ROMEO STELVIO 2.2 D 190 AWD NERO EDIZIONE StationWagon',
'transmission': 'automatic',
'trim': 'D 190 AWD NERO EDIZIONE',
'vin': 'ZARPAHGX5K7C38748',
'year': 2019}
2026-03-28 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS68%2520WCC%27 HTTP/1.1" 200 None
2026-03-28 22:01:08 [bca.uk] INFO: Saving data for YS68%20WCC: {'auction_closing_time': 1774864800.0, 'created_time': 1774339630.137103, 'last_price_update_time': 1774735268.44445}
2026-03-28 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YS68%2520WCC') HTTP/1.1" 204 0
2026-03-28 22:01:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX68XHM/42809660?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=LehtVWZLTGCUq%2FHVaWaxVcM6eZjoYBHWl7BsrTTno54%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RX68%20XHM-GB>
2026-03-28 22:01:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV03RSZ/42811210?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=XPdxTou37%2FSrb2139PEgleDE82DPAqY3LhSbwh%2FScoQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV03%20RSZ-GB>
2026-03-28 22:01:08 [bca.uk] INFO: Found listing with ID: AV68%20JYU
2026-03-28 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV68%2520JYU%27 HTTP/1.1" 200 None
2026-03-28 22:01:08 [bca.uk] INFO: Scrape type for AV68%20JYU: 2
2026-03-28 22:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e48c561-f5d3-5b6d-8454-2d5fa2b7d67a with identifier: AV68%20JYU
2026-03-28 22:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e48c561-f5d3-5b6d-8454-2d5fa2b7d67a with scrape type 2
2026-03-28 22:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e48c561-f5d3-5b6d-8454-2d5fa2b7d67a with scrape type 2
2026-03-28 22:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2e48c561-f5d3-5b6d-8454-2d5fa2b7d67a, identifier: AV68%20JYU
2026-03-28 22:01:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT19CVS/42811387?sv=2020-08-04&st=2026-03-28T22%3A01%3A08Z&se=2026-03-28T22%3A26%3A08Z&sr=b&sp=r&sig=Xezo2YoS0t9x6abxzIwcxCNA1wXAbFztVA4zM%2F%2Bntk8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HT19%20CVS-GB>
2026-03-28 22:01:08 [bca.uk] INFO: Found listing with ID: BJ70%20EHU
2026-03-28 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ70%2520EHU%27 HTTP/1.1" 200 None
2026-03-28 22:01:08 [bca.uk] INFO: Scrape type for BJ70%20EHU: 1
2026-03-28 22:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf35b337-845e-537f-a976-08188cca66f3 with identifier: BJ70%20EHU
2026-03-28 22:01:08 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cf35b337-845e-537f-a976-08188cca66f3
2026-03-28 22:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2e48c561-f5d3-5b6d-8454-2d5fa2b7d67a with identifier: AV68%20JYU
2026-03-28 22:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2e48c561-f5d3-5b6d-8454-2d5fa2b7d67a with identifier: AV68%20JYU
2026-03-28 22:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2e48c561-f5d3-5b6d-8454-2d5fa2b7d67a with identifier: AV68%20JYU to the API
2026-03-28 22:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV68%20JYU-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2e48c561-f5d3-5b6d-8454-2d5fa2b7d67a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV68 JYU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV68%20JYU&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FORD',
'model': 'KUGA',
'odometer': 110935,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FORD KUGA 1.5 TDCI 120 2WD TITANIUM StationWagon',
'transmission': 'manual',
'trim': 'TDCI 120 2WD TITANIUM',
'vin': 'WF0AXXWPMAJU50726',
'year': 2018}
2026-03-28 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV68%2520JYU%27 HTTP/1.1" 200 None
2026-03-28 22:01:08 [bca.uk] INFO: Saving data for AV68%20JYU: {'auction_closing_time': 1774864800.0, 'created_time': 1774621500.990708, 'last_price_update_time': 1774735268.975707}
2026-03-28 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV68%2520JYU') HTTP/1.1" 204 0
2026-03-28 22:01:08 [bca.uk] INFO: Found listing with ID: BU64%20FFW
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU64%2520FFW%27 HTTP/1.1" 200 None
2026-03-28 22:01:09 [bca.uk] INFO: Scrape type for BU64%20FFW: 0
2026-03-28 22:01:09 [bca.uk] INFO: Found listing with ID: FD64%20DKV
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD64%2520DKV%27 HTTP/1.1" 200 None
2026-03-28 22:01:09 [bca.uk] INFO: Scrape type for FD64%20DKV: 0
2026-03-28 22:01:09 [bca.uk] INFO: Found listing with ID: ML18%20SVE
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML18%2520SVE%27 HTTP/1.1" 200 None
2026-03-28 22:01:09 [bca.uk] INFO: Scrape type for ML18%20SVE: 0
2026-03-28 22:01:09 [bca.uk] INFO: Found listing with ID: MM17%20ZZL
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM17%2520ZZL%27 HTTP/1.1" 200 None
2026-03-28 22:01:09 [bca.uk] INFO: Scrape type for MM17%20ZZL: 0
2026-03-28 22:01:09 [bca.uk] INFO: Found listing with ID: ND64%20WZO
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND64%2520WZO%27 HTTP/1.1" 200 None
2026-03-28 22:01:09 [bca.uk] INFO: Scrape type for ND64%20WZO: 0
2026-03-28 22:01:09 [bca.uk] INFO: Found listing with ID: PE15%20LHF
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE15%2520LHF%27 HTTP/1.1" 200 None
2026-03-28 22:01:09 [bca.uk] INFO: Scrape type for PE15%20LHF: 2
2026-03-28 22:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53b360f8-e28e-5066-a3a2-3aa59cee10b7 with identifier: PE15%20LHF
2026-03-28 22:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53b360f8-e28e-5066-a3a2-3aa59cee10b7 with scrape type 2
2026-03-28 22:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53b360f8-e28e-5066-a3a2-3aa59cee10b7 with scrape type 2
2026-03-28 22:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 53b360f8-e28e-5066-a3a2-3aa59cee10b7, identifier: PE15%20LHF
2026-03-28 22:01:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV69BJO/42810768?sv=2020-08-04&st=2026-03-28T22%3A01%3A08Z&se=2026-03-28T22%3A26%3A08Z&sr=b&sp=r&sig=RhBgWIDbmwF%2F8XqW9pjzomUmOVaJM8ThWq2ap8w7j1M%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FV69%20BJO-GB>
2026-03-28 22:01:09 [bca.uk] INFO: Found listing with ID: KJ73%20EOT
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ73%2520EOT%27 HTTP/1.1" 200 None
2026-03-28 22:01:09 [bca.uk] INFO: Scrape type for KJ73%20EOT: 1
2026-03-28 22:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab2f45d0-e564-5ded-8cb4-0288835f055c with identifier: KJ73%20EOT
2026-03-28 22:01:09 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ab2f45d0-e564-5ded-8cb4-0288835f055c
2026-03-28 22:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 53b360f8-e28e-5066-a3a2-3aa59cee10b7 with identifier: PE15%20LHF
2026-03-28 22:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 53b360f8-e28e-5066-a3a2-3aa59cee10b7 with identifier: PE15%20LHF
2026-03-28 22:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 53b360f8-e28e-5066-a3a2-3aa59cee10b7 with identifier: PE15%20LHF to the API
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 182,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PE15%20LHF-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '53b360f8-e28e-5066-a3a2-3aa59cee10b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PE15 LHF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PE15%20LHF&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'LAND ROVER',
'model': 'RANGE ROVER',
'odometer': 123563,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'LAND ROVER RANGE ROVER 3.0 TDV6 VOGUE StationWagon',
'transmission': 'manual',
'trim': 'TDV6 VOGUE',
'vin': 'SALGA2KE4FA221757',
'year': 2015}
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE15%2520LHF%27 HTTP/1.1" 200 None
2026-03-28 22:01:09 [bca.uk] INFO: Saving data for PE15%20LHF: {'auction_closing_time': 1774864800.0, 'created_time': 1774389709.115778, 'last_price_update_time': 1774735269.558009}
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PE15%2520LHF') HTTP/1.1" 204 0
2026-03-28 22:01:09 [bca.uk] INFO: Found listing with ID: VO71%20XBU
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO71%2520XBU%27 HTTP/1.1" 200 None
2026-03-28 22:01:09 [bca.uk] INFO: Scrape type for VO71%20XBU: 0
2026-03-28 22:01:09 [bca.uk] INFO: Found listing with ID: YK65%20OXD
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK65%2520OXD%27 HTTP/1.1" 200 None
2026-03-28 22:01:09 [bca.uk] INFO: Scrape type for YK65%20OXD: 0
2026-03-28 22:01:09 [bca.uk] INFO: Found listing with ID: WP63%20XYK
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP63%2520XYK%27 HTTP/1.1" 200 None
2026-03-28 22:01:09 [bca.uk] INFO: Scrape type for WP63%20XYK: 0
2026-03-28 22:01:09 [bca.uk] INFO: Found listing with ID: YK21%20DGC
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK21%2520DGC%27 HTTP/1.1" 200 None
2026-03-28 22:01:09 [bca.uk] INFO: Scrape type for YK21%20DGC: 0
2026-03-28 22:01:09 [bca.uk] INFO: Found listing with ID: YR13%20ZXN
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR13%2520ZXN%27 HTTP/1.1" 200 None
2026-03-28 22:01:09 [bca.uk] INFO: Scrape type for YR13%20ZXN: 0
2026-03-28 22:01:09 [bca.uk] INFO: Found listing with ID: DK63%20WMY
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK63%2520WMY%27 HTTP/1.1" 200 None
2026-03-28 22:01:09 [bca.uk] INFO: Scrape type for DK63%20WMY: 2
2026-03-28 22:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d10fd0ff-e651-505e-98ff-e4147b34f850 with identifier: DK63%20WMY
2026-03-28 22:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d10fd0ff-e651-505e-98ff-e4147b34f850 with scrape type 2
2026-03-28 22:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d10fd0ff-e651-505e-98ff-e4147b34f850 with scrape type 2
2026-03-28 22:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d10fd0ff-e651-505e-98ff-e4147b34f850, identifier: DK63%20WMY
2026-03-28 22:01:09 [bca.uk] INFO: Found listing with ID: BP15%20GZB
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP15%2520GZB%27 HTTP/1.1" 200 None
2026-03-28 22:01:09 [bca.uk] INFO: Scrape type for BP15%20GZB: 1
2026-03-28 22:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 283b6c92-cce2-544a-9b3b-da049a06ca33 with identifier: BP15%20GZB
2026-03-28 22:01:09 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 283b6c92-cce2-544a-9b3b-da049a06ca33
2026-03-28 22:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d10fd0ff-e651-505e-98ff-e4147b34f850 with identifier: DK63%20WMY
2026-03-28 22:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d10fd0ff-e651-505e-98ff-e4147b34f850 with identifier: DK63%20WMY
2026-03-28 22:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d10fd0ff-e651-505e-98ff-e4147b34f850 with identifier: DK63%20WMY to the API
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 152,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DK63%20WMY-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd10fd0ff-e651-505e-98ff-e4147b34f850',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DK63 WMY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DK63%20WMY&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'VOLKSWAGEN',
'model': 'CADDY MAXI LIFE',
'odometer': 192168,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN CADDY MAXI LIFE 1.6 TDI 102 DSG MPV',
'transmission': 'automatic',
'trim': 'TDI 102 DSG',
'vin': 'WV2ZZZ2KZEX039850',
'year': 2013}
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK63%2520WMY%27 HTTP/1.1" 200 None
2026-03-28 22:01:10 [bca.uk] INFO: Saving data for DK63%20WMY: {'auction_closing_time': 1774864800.0, 'created_time': 1774621664.124209, 'last_price_update_time': 1774735270.282113}
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DK63%2520WMY') HTTP/1.1" 204 0
2026-03-28 22:01:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT70TDO/42811400?sv=2020-08-04&st=2026-03-28T22%3A01%3A09Z&se=2026-03-28T22%3A26%3A09Z&sr=b&sp=r&sig=sz4G2m%2Bww1tbH3aSNvJ2DJLyecaaL3NNq%2FlejxEYTpI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT70%20TDO-GB>
2026-03-28 22:01:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN63OLH/42810834?sv=2020-08-04&st=2026-03-28T22%3A01%3A09Z&se=2026-03-28T22%3A26%3A09Z&sr=b&sp=r&sig=NMpNDT8TSdoKfgfMWv1wobNIeXn3SgscjQpSI5aPQXk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CN63%20OLH-GB>
2026-03-28 22:01:10 [bca.uk] INFO: Found listing with ID: DY10%20SSJ
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY10%2520SSJ%27 HTTP/1.1" 200 None
2026-03-28 22:01:10 [bca.uk] INFO: Scrape type for DY10%20SSJ: 2
2026-03-28 22:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0f8dcd8-cbe5-57fc-95b2-a1d208cc3fad with identifier: DY10%20SSJ
2026-03-28 22:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0f8dcd8-cbe5-57fc-95b2-a1d208cc3fad with scrape type 2
2026-03-28 22:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0f8dcd8-cbe5-57fc-95b2-a1d208cc3fad with scrape type 2
2026-03-28 22:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a0f8dcd8-cbe5-57fc-95b2-a1d208cc3fad, identifier: DY10%20SSJ
2026-03-28 22:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VA62BTY/42810684?sv=2020-08-04&st=2026-03-28T22%3A01%3A03Z&se=2026-03-28T22%3A26%3A03Z&sr=b&sp=r&sig=N35MQzuEGC1T9OsmIXtmUT3IIUk5%2F7R2XsmdyzT4d0M%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:10 [scrapy.extensions.logstats] INFO: Crawled 4 pages (at 4 pages/min), scraped 21 items (at 21 items/min)
2026-03-28 22:01:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-28 22:01:10 [bca.uk] INFO: Found listing with ID: VX52%20YYH
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX52%2520YYH%27 HTTP/1.1" 200 None
2026-03-28 22:01:10 [bca.uk] INFO: Scrape type for VX52%20YYH: 1
2026-03-28 22:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08d9ff90-12a7-5f3d-86ac-c640dc2351b5 with identifier: VX52%20YYH
2026-03-28 22:01:10 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 08d9ff90-12a7-5f3d-86ac-c640dc2351b5
2026-03-28 22:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a0f8dcd8-cbe5-57fc-95b2-a1d208cc3fad with identifier: DY10%20SSJ
2026-03-28 22:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a0f8dcd8-cbe5-57fc-95b2-a1d208cc3fad with identifier: DY10%20SSJ
2026-03-28 22:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a0f8dcd8-cbe5-57fc-95b2-a1d208cc3fad with identifier: DY10%20SSJ to the API
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DY10%20SSJ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a0f8dcd8-cbe5-57fc-95b2-a1d208cc3fad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DY10 SSJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DY10%20SSJ&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'AUDI',
'model': 'TT',
'odometer': 197639,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'AUDI TT 2.0 TDI QUATTRO S LINE Coupe',
'transmission': 'manual',
'trim': 'TDI QUATTRO S LINE',
'vin': 'TRUZZZ8J4A1013348',
'year': 2010}
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY10%2520SSJ%27 HTTP/1.1" 200 None
2026-03-28 22:01:10 [bca.uk] INFO: Saving data for DY10%20SSJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774621551.995077, 'last_price_update_time': 1774735270.763715}
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DY10%2520SSJ') HTTP/1.1" 204 0
2026-03-28 22:01:10 [bca.uk] INFO: Found listing with ID: FH08%20ABU
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH08%2520ABU%27 HTTP/1.1" 200 None
2026-03-28 22:01:10 [bca.uk] INFO: Scrape type for FH08%20ABU: 0
2026-03-28 22:01:10 [bca.uk] INFO: Found listing with ID: FL14%20OFC
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL14%2520OFC%27 HTTP/1.1" 200 None
2026-03-28 22:01:10 [bca.uk] INFO: Scrape type for FL14%20OFC: 0
2026-03-28 22:01:10 [bca.uk] INFO: Found listing with ID: KX09%20PFF
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX09%2520PFF%27 HTTP/1.1" 200 None
2026-03-28 22:01:10 [bca.uk] INFO: Scrape type for KX09%20PFF: 0
2026-03-28 22:01:10 [bca.uk] INFO: Found listing with ID: LG61%20TGV
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG61%2520TGV%27 HTTP/1.1" 200 None
2026-03-28 22:01:10 [bca.uk] INFO: Scrape type for LG61%20TGV: 2
2026-03-28 22:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 889b94fe-dd95-5dd8-8d9a-cdf1267e6762 with identifier: LG61%20TGV
2026-03-28 22:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 889b94fe-dd95-5dd8-8d9a-cdf1267e6762 with scrape type 2
2026-03-28 22:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 889b94fe-dd95-5dd8-8d9a-cdf1267e6762 with scrape type 2
2026-03-28 22:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 889b94fe-dd95-5dd8-8d9a-cdf1267e6762, identifier: LG61%20TGV
2026-03-28 22:01:10 [bca.uk] INFO: Found listing with ID: WU66%20XNV
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU66%2520XNV%27 HTTP/1.1" 200 None
2026-03-28 22:01:10 [bca.uk] INFO: Scrape type for WU66%20XNV: 1
2026-03-28 22:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51da0f1d-592f-5dda-b1f6-cadeb5cfb790 with identifier: WU66%20XNV
2026-03-28 22:01:10 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 51da0f1d-592f-5dda-b1f6-cadeb5cfb790
2026-03-28 22:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 889b94fe-dd95-5dd8-8d9a-cdf1267e6762 with identifier: LG61%20TGV
2026-03-28 22:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 889b94fe-dd95-5dd8-8d9a-cdf1267e6762 with identifier: LG61%20TGV
2026-03-28 22:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 889b94fe-dd95-5dd8-8d9a-cdf1267e6762 with identifier: LG61%20TGV to the API
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 243,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LG61%20TGV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '889b94fe-dd95-5dd8-8d9a-cdf1267e6762',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LG61 TGV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LG61%20TGV&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 133385,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 3.0 TDV6 HSE StationWagon',
'transmission': 'automatic',
'trim': 'TDV6 HSE',
'vin': 'SALLSAAG3BA716346',
'year': 2011}
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG61%2520TGV%27 HTTP/1.1" 200 None
2026-03-28 22:01:11 [bca.uk] INFO: Saving data for LG61%20TGV: {'auction_closing_time': 1774864800.0, 'created_time': 1774610901.826446, 'last_price_update_time': 1774735271.331999}
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LG61%2520TGV') HTTP/1.1" 204 0
2026-03-28 22:01:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ68UWN/42811039?sv=2020-08-04&st=2026-03-28T22%3A01%3A10Z&se=2026-03-28T22%3A26%3A10Z&sr=b&sp=r&sig=1ZiFBHKVUwguyFOSNXk0RG8MN%2BDlXzRukHPnqyWqOFk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ68%20UWN-GB>
2026-03-28 22:01:11 [bca.uk] INFO: Found listing with ID: NU65%20OJO
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU65%2520OJO%27 HTTP/1.1" 200 None
2026-03-28 22:01:11 [bca.uk] INFO: Scrape type for NU65%20OJO: 0
2026-03-28 22:01:11 [bca.uk] INFO: Found listing with ID: PK10%20NKU
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK10%2520NKU%27 HTTP/1.1" 200 None
2026-03-28 22:01:11 [bca.uk] INFO: Scrape type for PK10%20NKU: 0
2026-03-28 22:01:11 [bca.uk] INFO: Found listing with ID: PO61%20YVU
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PO61%2520YVU%27 HTTP/1.1" 200 None
2026-03-28 22:01:11 [bca.uk] INFO: Scrape type for PO61%20YVU: 0
2026-03-28 22:01:11 [bca.uk] INFO: Found listing with ID: MK19%20LHL
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK19%2520LHL%27 HTTP/1.1" 200 None
2026-03-28 22:01:11 [bca.uk] INFO: Scrape type for MK19%20LHL: 0
2026-03-28 22:01:11 [bca.uk] INFO: Found listing with ID: AV17%20OFO
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV17%2520OFO%27 HTTP/1.1" 200 None
2026-03-28 22:01:11 [bca.uk] INFO: Scrape type for AV17%20OFO: 2
2026-03-28 22:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62da7e4a-f128-5b70-86d8-39fd060a8d23 with identifier: AV17%20OFO
2026-03-28 22:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62da7e4a-f128-5b70-86d8-39fd060a8d23 with scrape type 2
2026-03-28 22:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62da7e4a-f128-5b70-86d8-39fd060a8d23 with scrape type 2
2026-03-28 22:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 62da7e4a-f128-5b70-86d8-39fd060a8d23, identifier: AV17%20OFO
2026-03-28 22:01:11 [bca.uk] INFO: Found listing with ID: DS15%20KUO
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS15%2520KUO%27 HTTP/1.1" 200 None
2026-03-28 22:01:11 [bca.uk] INFO: Scrape type for DS15%20KUO: 0
2026-03-28 22:01:11 [bca.uk] INFO: Found listing with ID: FP65%20EUR
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP65%2520EUR%27 HTTP/1.1" 200 None
2026-03-28 22:01:11 [bca.uk] INFO: Scrape type for FP65%20EUR: 0
2026-03-28 22:01:11 [bca.uk] INFO: Found listing with ID: LL16%20FYY
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL16%2520FYY%27 HTTP/1.1" 200 None
2026-03-28 22:01:11 [bca.uk] INFO: Scrape type for LL16%20FYY: 0
2026-03-28 22:01:11 [bca.uk] INFO: Found listing with ID: MV65%20CCA
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV65%2520CCA%27 HTTP/1.1" 200 None
2026-03-28 22:01:11 [bca.uk] INFO: Scrape type for MV65%20CCA: 0
2026-03-28 22:01:11 [bca.uk] INFO: Found listing with ID: PE16%20VRM
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE16%2520VRM%27 HTTP/1.1" 200 None
2026-03-28 22:01:11 [bca.uk] INFO: Scrape type for PE16%20VRM: 0
2026-03-28 22:01:11 [bca.uk] INFO: Found listing with ID: FG66%20KHH
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG66%2520KHH%27 HTTP/1.1" 200 None
2026-03-28 22:01:11 [bca.uk] INFO: Scrape type for FG66%20KHH: 0
2026-03-28 22:01:11 [bca.uk] INFO: Found listing with ID: FP11%20OHH
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP11%2520OHH%27 HTTP/1.1" 200 None
2026-03-28 22:01:11 [bca.uk] INFO: Scrape type for FP11%20OHH: 1
2026-03-28 22:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9153a9c4-5990-5981-85ad-c93a9119ac4b with identifier: FP11%20OHH
2026-03-28 22:01:11 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9153a9c4-5990-5981-85ad-c93a9119ac4b
2026-03-28 22:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 62da7e4a-f128-5b70-86d8-39fd060a8d23 with identifier: AV17%20OFO
2026-03-28 22:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 62da7e4a-f128-5b70-86d8-39fd060a8d23 with identifier: AV17%20OFO
2026-03-28 22:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 62da7e4a-f128-5b70-86d8-39fd060a8d23 with identifier: AV17%20OFO to the API
2026-03-28 22:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 105,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV17%20OFO-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '62da7e4a-f128-5b70-86d8-39fd060a8d23',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV17 OFO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV17%20OFO&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 78923,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 100 ZETEC EDITION Hatchback',
'transmission': 'manual',
'trim': 'E/B 100 ZETEC EDITION',
'vin': 'WF05XXGCC5HU49279',
'year': 2017}
2026-03-28 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV17%2520OFO%27 HTTP/1.1" 200 None
2026-03-28 22:01:12 [bca.uk] INFO: Saving data for AV17%20OFO: {'auction_closing_time': 1774864800.0, 'created_time': 1774621506.603336, 'last_price_update_time': 1774735272.155707}
2026-03-28 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV17%2520OFO') HTTP/1.1" 204 0
2026-03-28 22:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 22:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 22:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542021d0>
2026-03-28 22:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 22:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-28 22:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 22:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44fab252-6185-51e4-87e9-3f4c2a42edd8/44fab252-6185-51e4-87e9-3f4c2a42edd8_expert_report_file_94673aa7-642d-46ca-8329-8a567d1592d1.pdf HTTP/1.1" 201 0
2026-03-28 22:01:12 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 44fab252-6185-51e4-87e9-3f4c2a42edd8
2026-03-28 22:01:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44fab252-6185-51e4-87e9-3f4c2a42edd8, skipping ID generation
2026-03-28 22:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 44fab252-6185-51e4-87e9-3f4c2a42edd8
2026-03-28 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DVA62BTY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VA62BTY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:12 [bca.uk] INFO: Found listing with ID: NG16%20RUC
2026-03-28 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG16%2520RUC%27 HTTP/1.1" 200 None
2026-03-28 22:01:12 [bca.uk] INFO: Scrape type for NG16%20RUC: 2
2026-03-28 22:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f24d578-38f3-5587-ad8d-873caa79348d with identifier: NG16%20RUC
2026-03-28 22:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f24d578-38f3-5587-ad8d-873caa79348d with scrape type 2
2026-03-28 22:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f24d578-38f3-5587-ad8d-873caa79348d with scrape type 2
2026-03-28 22:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1f24d578-38f3-5587-ad8d-873caa79348d, identifier: NG16%20RUC
2026-03-28 22:01:12 [bca.uk] INFO: Found listing with ID: YB66%20SGO
2026-03-28 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB66%2520SGO%27 HTTP/1.1" 200 None
2026-03-28 22:01:12 [bca.uk] INFO: Scrape type for YB66%20SGO: 2
2026-03-28 22:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72028644-e7e8-53a8-a690-b78abf0d7020 with identifier: YB66%20SGO
2026-03-28 22:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72028644-e7e8-53a8-a690-b78abf0d7020 with scrape type 2
2026-03-28 22:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72028644-e7e8-53a8-a690-b78abf0d7020 with scrape type 2
2026-03-28 22:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 72028644-e7e8-53a8-a690-b78abf0d7020, identifier: YB66%20SGO
2026-03-28 22:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1f24d578-38f3-5587-ad8d-873caa79348d with identifier: NG16%20RUC
2026-03-28 22:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1f24d578-38f3-5587-ad8d-873caa79348d with identifier: NG16%20RUC
2026-03-28 22:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1f24d578-38f3-5587-ad8d-873caa79348d with identifier: NG16%20RUC to the API
2026-03-28 22:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 93,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NG16%20RUC-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1f24d578-38f3-5587-ad8d-873caa79348d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NG16 RUC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NG16%20RUC&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 98007,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.5 DCI 90 ACENTA Hatchback',
'transmission': 'manual',
'trim': 'DCI 90 ACENTA',
'vin': 'SJNTCAE12U1163110',
'year': 2016}
2026-03-28 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG16%2520RUC%27 HTTP/1.1" 200 None
2026-03-28 22:01:13 [bca.uk] INFO: Saving data for NG16%20RUC: {'auction_closing_time': 1774864800.0, 'created_time': 1774621505.106301, 'last_price_update_time': 1774735273.194939}
2026-03-28 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NG16%2520RUC') HTTP/1.1" 204 0
2026-03-28 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698965995%27 HTTP/1.1" 200 None
2026-03-28 22:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698965995 not downloaded yet
2026-03-28 22:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 22:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ12NEO/42811151?sv=2020-08-04&st=2026-03-28T22%3A01%3A05Z&se=2026-03-28T22%3A26%3A05Z&sr=b&sp=r&sig=62h1oUPBDkzrRTgiSRZPyg2OGFZw9gvgjM6%2Bng4Eeco%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD57OLK/42810740?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=6hm7fODnR3wBKimIVKSkEorWvM8%2B5kHNq4nMJt6A%2BvY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND62EWM/42810799?sv=2020-08-04&st=2026-03-28T22%3A01%3A06Z&se=2026-03-28T22%3A26%3A06Z&sr=b&sp=r&sig=KD3C6SJzwrdEgIjlL7QRYHJfSgh8rbJ%2FPC%2F%2BEfVah7k%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV69BJO/42810768?sv=2020-08-04&st=2026-03-28T22%3A01%3A08Z&se=2026-03-28T22%3A26%3A08Z&sr=b&sp=r&sig=RhBgWIDbmwF%2F8XqW9pjzomUmOVaJM8ThWq2ap8w7j1M%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ70EHU/42811341?sv=2020-08-04&st=2026-03-28T22%3A01%3A12Z&se=2026-03-28T22%3A26%3A12Z&sr=b&sp=r&sig=jIMEwQ1nhHjk3xUWtYxp4DaMU%2Fd7rUcdJRYrXhJEbps%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ70%20EHU-GB>
2026-03-28 22:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 72028644-e7e8-53a8-a690-b78abf0d7020 with identifier: YB66%20SGO
2026-03-28 22:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 72028644-e7e8-53a8-a690-b78abf0d7020 with identifier: YB66%20SGO
2026-03-28 22:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 72028644-e7e8-53a8-a690-b78abf0d7020 with identifier: YB66%20SGO to the API
2026-03-28 22:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 103,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YB66%20SGO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '72028644-e7e8-53a8-a690-b78abf0d7020',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YB66 SGO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YB66%20SGO&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'BMW',
'model': '116D',
'odometer': 61376,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'BMW 116D 1.5 SPORT Hatchback',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'WBA1V720805D51334',
'year': 2017}
2026-03-28 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB66%2520SGO%27 HTTP/1.1" 200 None
2026-03-28 22:01:13 [bca.uk] INFO: Saving data for YB66%20SGO: {'auction_closing_time': 1774864800.0, 'created_time': 1774621719.418673, 'last_price_update_time': 1774735273.577071}
2026-03-28 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YB66%2520SGO') HTTP/1.1" 204 0
2026-03-28 22:01:13 [bca.uk] INFO: Found listing with ID: SG15%20UVN
2026-03-28 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG15%2520UVN%27 HTTP/1.1" 200 None
2026-03-28 22:01:13 [bca.uk] INFO: Scrape type for SG15%20UVN: 2
2026-03-28 22:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b221976-219b-5fe1-b558-0adb253a35c9 with identifier: SG15%20UVN
2026-03-28 22:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b221976-219b-5fe1-b558-0adb253a35c9 with scrape type 2
2026-03-28 22:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b221976-219b-5fe1-b558-0adb253a35c9 with scrape type 2
2026-03-28 22:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4b221976-219b-5fe1-b558-0adb253a35c9, identifier: SG15%20UVN
2026-03-28 22:01:13 [bca.uk] INFO: Found listing with ID: BG16%20XLF
2026-03-28 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG16%2520XLF%27 HTTP/1.1" 200 None
2026-03-28 22:01:13 [bca.uk] INFO: Scrape type for BG16%20XLF: 1
2026-03-28 22:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1 with identifier: BG16%20XLF
2026-03-28 22:01:13 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1
2026-03-28 22:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4b221976-219b-5fe1-b558-0adb253a35c9 with identifier: SG15%20UVN
2026-03-28 22:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4b221976-219b-5fe1-b558-0adb253a35c9 with identifier: SG15%20UVN
2026-03-28 22:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4b221976-219b-5fe1-b558-0adb253a35c9 with identifier: SG15%20UVN to the API
2026-03-28 22:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SG15%20UVN-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4b221976-219b-5fe1-b558-0adb253a35c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SG15 UVN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SG15%20UVN&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'SKODA',
'model': 'FABIA',
'odometer': 105020,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'SKODA FABIA 1.2 TSI 90 SE Estate',
'transmission': 'manual',
'trim': 'TSI 90 SE',
'vin': 'TMBKM6NJ5FZ016779',
'year': 2015}
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG15%2520UVN%27 HTTP/1.1" 200 None
2026-03-28 22:01:14 [bca.uk] INFO: Saving data for SG15%20UVN: {'auction_closing_time': 1774864800.0, 'created_time': 1774621523.097573, 'last_price_update_time': 1774735274.071553}
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SG15%2520UVN') HTTP/1.1" 204 0
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698966001%27 HTTP/1.1" 200 None
2026-03-28 22:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966001 not downloaded yet
2026-03-28 22:01:14 [bca.uk] INFO: Found listing with ID: YF14%20OCH
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF14%2520OCH%27 HTTP/1.1" 200 None
2026-03-28 22:01:14 [bca.uk] INFO: Scrape type for YF14%20OCH: 2
2026-03-28 22:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ffcf2cb-2013-506c-a876-97bed46c2d21 with identifier: YF14%20OCH
2026-03-28 22:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ffcf2cb-2013-506c-a876-97bed46c2d21 with scrape type 2
2026-03-28 22:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ffcf2cb-2013-506c-a876-97bed46c2d21 with scrape type 2
2026-03-28 22:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7ffcf2cb-2013-506c-a876-97bed46c2d21, identifier: YF14%20OCH
2026-03-28 22:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX68XHM/42809660?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=LehtVWZLTGCUq%2FHVaWaxVcM6eZjoYBHWl7BsrTTno54%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:14 [bca.uk] INFO: Found listing with ID: ET68%20NZV
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET68%2520NZV%27 HTTP/1.1" 200 None
2026-03-28 22:01:14 [bca.uk] INFO: Scrape type for ET68%20NZV: 0
2026-03-28 22:01:14 [bca.uk] INFO: Found listing with ID: FR68%20BNA
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FR68%2520BNA%27 HTTP/1.1" 200 None
2026-03-28 22:01:14 [bca.uk] INFO: Scrape type for FR68%20BNA: 2
2026-03-28 22:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8a20e8b-ecb3-5d71-89a9-3194ce4c0d03 with identifier: FR68%20BNA
2026-03-28 22:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8a20e8b-ecb3-5d71-89a9-3194ce4c0d03 with scrape type 2
2026-03-28 22:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8a20e8b-ecb3-5d71-89a9-3194ce4c0d03 with scrape type 2
2026-03-28 22:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a8a20e8b-ecb3-5d71-89a9-3194ce4c0d03, identifier: FR68%20BNA
2026-03-28 22:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7ffcf2cb-2013-506c-a876-97bed46c2d21 with identifier: YF14%20OCH
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 22:01:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 22:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7ffcf2cb-2013-506c-a876-97bed46c2d21 with identifier: YF14%20OCH
2026-03-28 22:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7ffcf2cb-2013-506c-a876-97bed46c2d21 with identifier: YF14%20OCH to the API
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YF14%20OCH-GB',
'category': 'Car',
'color': 'beige',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7ffcf2cb-2013-506c-a876-97bed46c2d21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YF14 OCH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YF14%20OCH&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'VOLKSWAGEN',
'model': 'TIGUAN',
'odometer': 52645,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN 2.0 TDI 177 BMT 4M MATCH DSG StationWagon',
'transmission': 'automatic',
'trim': 'TDI 177 BMT 4M MATCH DSG',
'vin': 'WVGZZZ5NZEW082934',
'year': 2014}
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF14%2520OCH%27 HTTP/1.1" 200 None
2026-03-28 22:01:14 [bca.uk] INFO: Saving data for YF14%20OCH: {'auction_closing_time': 1774864800.0, 'created_time': 1774621521.751804, 'last_price_update_time': 1774735274.877966}
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YF14%2520OCH') HTTP/1.1" 204 0
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698966008%27 HTTP/1.1" 200 None
2026-03-28 22:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966008 not downloaded yet
2026-03-28 22:01:14 [bca.uk] INFO: Total items found: 100
2026-03-28 22:01:14 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded
2026-03-28 22:01:14 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 22:01:14 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 22:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55436e8d0>
2026-03-28 22:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf9384a7-c2b5-5829-81c5-0ab07891768a/cf9384a7-c2b5-5829-81c5-0ab07891768a_expert_report_file_b5833f2b-ad9a-4b04-9de0-257c9ebeb040.pdf HTTP/1.1" 201 0
2026-03-28 22:01:14 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cf9384a7-c2b5-5829-81c5-0ab07891768a
2026-03-28 22:01:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf9384a7-c2b5-5829-81c5-0ab07891768a, skipping ID generation
2026-03-28 22:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf9384a7-c2b5-5829-81c5-0ab07891768a
2026-03-28 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPJ12NEO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PJ12NEO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54777d1d0>
2026-03-28 22:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f1a744f-dcf7-513c-adf2-49d9ca828470/8f1a744f-dcf7-513c-adf2-49d9ca828470_expert_report_file_6c048fa2-79e2-44e1-a591-6f9d766a8c78.pdf HTTP/1.1" 201 0
2026-03-28 22:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8f1a744f-dcf7-513c-adf2-49d9ca828470
2026-03-28 22:01:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f1a744f-dcf7-513c-adf2-49d9ca828470, skipping ID generation
2026-03-28 22:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f1a744f-dcf7-513c-adf2-49d9ca828470
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBD57OLK-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BD57OLK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54747a910>
2026-03-28 22:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc2a305-976b-5d20-86ca-43ed711c23db/1fc2a305-976b-5d20-86ca-43ed711c23db_expert_report_file_8beb78f4-fca6-492c-8d96-6a99fbac9069.pdf HTTP/1.1" 201 0
2026-03-28 22:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1fc2a305-976b-5d20-86ca-43ed711c23db
2026-03-28 22:01:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1fc2a305-976b-5d20-86ca-43ed711c23db, skipping ID generation
2026-03-28 22:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1fc2a305-976b-5d20-86ca-43ed711c23db
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DND62EWM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ND62EWM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54748d9d0>
2026-03-28 22:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbce9e71-f6f9-5b70-87a1-2cf7e0368db6/fbce9e71-f6f9-5b70-87a1-2cf7e0368db6_expert_report_file_1ef25e8b-f33f-4fe5-afb6-2a0b783ef3a6.pdf HTTP/1.1" 201 0
2026-03-28 22:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item fbce9e71-f6f9-5b70-87a1-2cf7e0368db6
2026-03-28 22:01:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fbce9e71-f6f9-5b70-87a1-2cf7e0368db6, skipping ID generation
2026-03-28 22:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fbce9e71-f6f9-5b70-87a1-2cf7e0368db6
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFV69BJO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FV69BJO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VX52YYH/42811323?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=sBcdU%2Bi00fGyPAIkGghzLoIMWb9WJk%2B0Sty%2BOKRiKzA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VX52%20YYH-GB>
2026-03-28 22:01:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP15GZB/42811287?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=7tUa0hwrEujFHU3KRxrEE1EA%2FQ%2B2aDgCCCKK2Q5cFLc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BP15%20GZB-GB>
2026-03-28 22:01:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ73EOT/42811363?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=Z275yW1rsbj3FapfEeIfN9OJqcCvXddViu6M84JP7AA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KJ73%20EOT-GB>
2026-03-28 22:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a8a20e8b-ecb3-5d71-89a9-3194ce4c0d03 with identifier: FR68%20BNA
2026-03-28 22:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a8a20e8b-ecb3-5d71-89a9-3194ce4c0d03 with identifier: FR68%20BNA
2026-03-28 22:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a8a20e8b-ecb3-5d71-89a9-3194ce4c0d03 with identifier: FR68%20BNA to the API
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FR68%20BNA-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a8a20e8b-ecb3-5d71-89a9-3194ce4c0d03',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FR68 BNA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FR68%20BNA&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'FORD',
'model': 'KUGA',
'odometer': 72723,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD KUGA 1.5 TDCI 120 2WD TITANIUM ED. StationWagon',
'transmission': 'manual',
'trim': 'TDCI 120 2WD TITANIUM ED.',
'vin': 'WF0AXXWPMAKC87774',
'year': 2019}
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FR68%2520BNA%27 HTTP/1.1" 200 None
2026-03-28 22:01:15 [bca.uk] INFO: Saving data for FR68%20BNA: {'auction_closing_time': 1774864800.0, 'created_time': 1774621705.980413, 'last_price_update_time': 1774735275.613601}
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FR68%2520BNA') HTTP/1.1" 204 0
2026-03-28 22:01:15 [bca.uk] INFO: Found listing with ID: VN63%20OZK
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN63%2520OZK%27 HTTP/1.1" 200 None
2026-03-28 22:01:15 [bca.uk] INFO: Scrape type for VN63%20OZK: 0
2026-03-28 22:01:15 [bca.uk] INFO: Found listing with ID: WG14%20FZH
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG14%2520FZH%27 HTTP/1.1" 200 None
2026-03-28 22:01:15 [bca.uk] INFO: Scrape type for WG14%20FZH: 0
2026-03-28 22:01:15 [bca.uk] INFO: Found listing with ID: WJ62%20DYN
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ62%2520DYN%27 HTTP/1.1" 200 None
2026-03-28 22:01:15 [bca.uk] INFO: Scrape type for WJ62%20DYN: 2
2026-03-28 22:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be37694a-5687-58c3-87cf-ba5e49941ce9 with identifier: WJ62%20DYN
2026-03-28 22:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be37694a-5687-58c3-87cf-ba5e49941ce9 with scrape type 2
2026-03-28 22:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be37694a-5687-58c3-87cf-ba5e49941ce9 with scrape type 2
2026-03-28 22:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: be37694a-5687-58c3-87cf-ba5e49941ce9, identifier: WJ62%20DYN
2026-03-28 22:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV03RSZ/42811210?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=XPdxTou37%2FSrb2139PEgleDE82DPAqY3LhSbwh%2FScoQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:15 [bca.uk] INFO: Found listing with ID: GX18%20JHA
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX18%2520JHA%27 HTTP/1.1" 200 None
2026-03-28 22:01:15 [bca.uk] INFO: Scrape type for GX18%20JHA: 0
2026-03-28 22:01:15 [bca.uk] INFO: Found listing with ID: ML64%20UOC
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML64%2520UOC%27 HTTP/1.1" 200 None
2026-03-28 22:01:15 [bca.uk] INFO: Scrape type for ML64%20UOC: 2
2026-03-28 22:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e88e92d7-3467-57cc-a745-f163ee70bddc with identifier: ML64%20UOC
2026-03-28 22:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e88e92d7-3467-57cc-a745-f163ee70bddc with scrape type 2
2026-03-28 22:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e88e92d7-3467-57cc-a745-f163ee70bddc with scrape type 2
2026-03-28 22:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e88e92d7-3467-57cc-a745-f163ee70bddc, identifier: ML64%20UOC
2026-03-28 22:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: be37694a-5687-58c3-87cf-ba5e49941ce9 with identifier: WJ62%20DYN
2026-03-28 22:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: be37694a-5687-58c3-87cf-ba5e49941ce9 with identifier: WJ62%20DYN
2026-03-28 22:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: be37694a-5687-58c3-87cf-ba5e49941ce9 with identifier: WJ62%20DYN to the API
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 105,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ62%20DYN-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'be37694a-5687-58c3-87cf-ba5e49941ce9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ62 DYN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ62%20DYN&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'RENAULT',
'model': 'GRAND SCENIC',
'odometer': 88395,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'RENAULT GRAND SCENIC 1.5 DCI 110E DYNAMIQUE TOM TOM S/S MPV',
'transmission': 'manual',
'trim': 'DCI 110E DYNAMIQUE TOM TOM S/S',
'vin': 'VF1JZ14B647816987',
'year': 2012}
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ62%2520DYN%27 HTTP/1.1" 200 None
2026-03-28 22:01:16 [bca.uk] INFO: Saving data for WJ62%20DYN: {'auction_closing_time': 1774864800.0, 'created_time': 1774620785.679375, 'last_price_update_time': 1774735276.2238}
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ62%2520DYN') HTTP/1.1" 204 0
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698966012%27 HTTP/1.1" 200 None
2026-03-28 22:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966012 not downloaded yet
2026-03-28 22:01:16 [bca.uk] INFO: Found listing with ID: LN07%20YUR
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN07%2520YUR%27 HTTP/1.1" 200 None
2026-03-28 22:01:16 [bca.uk] INFO: Scrape type for LN07%20YUR: 1
2026-03-28 22:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20c106fd-0836-5717-a42b-17b79fbe25e4 with identifier: LN07%20YUR
2026-03-28 22:01:16 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 20c106fd-0836-5717-a42b-17b79fbe25e4
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058481%27 HTTP/1.1" 200 None
2026-03-28 22:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058481 not downloaded yet
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698965992%27 HTTP/1.1" 200 None
2026-03-28 22:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698965992 not downloaded yet
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981002%27 HTTP/1.1" 200 None
2026-03-28 22:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981002 not downloaded yet
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285758%27 HTTP/1.1" 200 None
2026-03-28 22:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285758 not downloaded yet
2026-03-28 22:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT70TDO/42811400?sv=2020-08-04&st=2026-03-28T22%3A01%3A09Z&se=2026-03-28T22%3A26%3A09Z&sr=b&sp=r&sig=sz4G2m%2Bww1tbH3aSNvJ2DJLyecaaL3NNq%2FlejxEYTpI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e88e92d7-3467-57cc-a745-f163ee70bddc with identifier: ML64%20UOC
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 22:01:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 22:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e88e92d7-3467-57cc-a745-f163ee70bddc with identifier: ML64%20UOC
2026-03-28 22:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e88e92d7-3467-57cc-a745-f163ee70bddc with identifier: ML64%20UOC to the API
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ML64%20UOC-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e88e92d7-3467-57cc-a745-f163ee70bddc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ML64 UOC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ML64%20UOC&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'VOLVO',
'model': 'V40 X-COUNTRY',
'odometer': 50112,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VOLVO V40 X-COUNTRY 1.6 D2 115 LUX P/S Hatchback',
'transmission': 'automatic',
'trim': 'D2 115 LUX P/S',
'vin': 'YV1MZ845BF2065142',
'year': 2014}
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML64%2520UOC%27 HTTP/1.1" 200 None
2026-03-28 22:01:16 [bca.uk] INFO: Saving data for ML64%20UOC: {'auction_closing_time': 1774864800.0, 'created_time': 1774620788.990174, 'last_price_update_time': 1774735276.933388}
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ML64%2520UOC') HTTP/1.1" 204 0
2026-03-28 22:01:16 [bca.uk] INFO: Found listing with ID: WK13%20ORJ
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK13%2520ORJ%27 HTTP/1.1" 200 None
2026-03-28 22:01:16 [bca.uk] INFO: Scrape type for WK13%20ORJ: 2
2026-03-28 22:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72a7b74a-1409-50a7-8a48-9d086ca07816 with identifier: WK13%20ORJ
2026-03-28 22:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72a7b74a-1409-50a7-8a48-9d086ca07816 with scrape type 2
2026-03-28 22:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72a7b74a-1409-50a7-8a48-9d086ca07816 with scrape type 2
2026-03-28 22:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 72a7b74a-1409-50a7-8a48-9d086ca07816, identifier: WK13%20ORJ
2026-03-28 22:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN63OLH/42810834?sv=2020-08-04&st=2026-03-28T22%3A01%3A09Z&se=2026-03-28T22%3A26%3A09Z&sr=b&sp=r&sig=NMpNDT8TSdoKfgfMWv1wobNIeXn3SgscjQpSI5aPQXk%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:17 [bca.uk] INFO: Found listing with ID: DS18%20FJC
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS18%2520FJC%27 HTTP/1.1" 200 None
2026-03-28 22:01:17 [bca.uk] INFO: Scrape type for DS18%20FJC: 0
2026-03-28 22:01:17 [bca.uk] INFO: Found listing with ID: DA57%20XKX
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA57%2520XKX%27 HTTP/1.1" 200 None
2026-03-28 22:01:17 [bca.uk] INFO: Scrape type for DA57%20XKX: 0
2026-03-28 22:01:17 [bca.uk] INFO: Found listing with ID: DK10%20YMG
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK10%2520YMG%27 HTTP/1.1" 200 None
2026-03-28 22:01:17 [bca.uk] INFO: Scrape type for DK10%20YMG: 0
2026-03-28 22:01:17 [bca.uk] INFO: Found listing with ID: DK12%20ZGD
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK12%2520ZGD%27 HTTP/1.1" 200 None
2026-03-28 22:01:17 [bca.uk] INFO: Scrape type for DK12%20ZGD: 0
2026-03-28 22:01:17 [bca.uk] INFO: Found listing with ID: DY63%20HCO
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY63%2520HCO%27 HTTP/1.1" 200 None
2026-03-28 22:01:17 [bca.uk] INFO: Scrape type for DY63%20HCO: 0
2026-03-28 22:01:17 [bca.uk] INFO: Found listing with ID: GK63%20TXV
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK63%2520TXV%27 HTTP/1.1" 200 None
2026-03-28 22:01:17 [bca.uk] INFO: Scrape type for GK63%20TXV: 2
2026-03-28 22:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e40cd5b-90a1-5489-b32b-18d7c5c72182 with identifier: GK63%20TXV
2026-03-28 22:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e40cd5b-90a1-5489-b32b-18d7c5c72182 with scrape type 2
2026-03-28 22:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e40cd5b-90a1-5489-b32b-18d7c5c72182 with scrape type 2
2026-03-28 22:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2e40cd5b-90a1-5489-b32b-18d7c5c72182, identifier: GK63%20TXV
2026-03-28 22:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 72a7b74a-1409-50a7-8a48-9d086ca07816 with identifier: WK13%20ORJ
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-28 22:01:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 22:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 72a7b74a-1409-50a7-8a48-9d086ca07816 with identifier: WK13%20ORJ
2026-03-28 22:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 72a7b74a-1409-50a7-8a48-9d086ca07816 with identifier: WK13%20ORJ to the API
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WK13%20ORJ-GB',
'category': 'Car',
'color': 'orange',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '72a7b74a-1409-50a7-8a48-9d086ca07816',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WK13 ORJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WK13%20ORJ&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'VAUXHALL',
'model': 'ADAM',
'odometer': 67626,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VAUXHALL ADAM 1.4 VVT 87 JAM Hatchback',
'transmission': 'manual',
'trim': 'VVT 87 JAM',
'vin': 'W0L0MAP08D6040511',
'year': 2013}
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK13%2520ORJ%27 HTTP/1.1" 200 None
2026-03-28 22:01:17 [bca.uk] INFO: Saving data for WK13%20ORJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774620787.494127, 'last_price_update_time': 1774735277.706862}
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WK13%2520ORJ') HTTP/1.1" 204 0
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698966018%27 HTTP/1.1" 200 None
2026-03-28 22:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966018 not downloaded yet
2026-03-28 22:01:17 [bca.uk] INFO: Found listing with ID: WV18%20WXN
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV18%2520WXN%27 HTTP/1.1" 200 None
2026-03-28 22:01:17 [bca.uk] INFO: Scrape type for WV18%20WXN: 1
2026-03-28 22:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9706080c-71c1-5f73-bc14-083fec0112e7 with identifier: WV18%20WXN
2026-03-28 22:01:17 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9706080c-71c1-5f73-bc14-083fec0112e7
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058496%27 HTTP/1.1" 200 None
2026-03-28 22:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058496 not downloaded yet
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698965997%27 HTTP/1.1" 200 None
2026-03-28 22:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698965997 not downloaded yet
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981010%27 HTTP/1.1" 200 None
2026-03-28 22:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981010 not downloaded yet
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285765%27 HTTP/1.1" 200 None
2026-03-28 22:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285765 not downloaded yet
2026-03-28 22:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547327850>
2026-03-28 22:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502dec79-4436-5ea8-b8a4-1afd151a13a2/502dec79-4436-5ea8-b8a4-1afd151a13a2_expert_report_file_b97225d5-e2ab-4eda-846b-ef5bee244ee7.pdf HTTP/1.1" 201 0
2026-03-28 22:01:17 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 502dec79-4436-5ea8-b8a4-1afd151a13a2
2026-03-28 22:01:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 502dec79-4436-5ea8-b8a4-1afd151a13a2, skipping ID generation
2026-03-28 22:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 502dec79-4436-5ea8-b8a4-1afd151a13a2
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRX68XHM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RX68XHM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WU66XNV/42811422?sv=2020-08-04&st=2026-03-28T22%3A01%3A16Z&se=2026-03-28T22%3A26%3A16Z&sr=b&sp=r&sig=iEWCiRexucMVz979VRM55ID%2B0dAdHnqV0R4MKdIaGkA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WU66%20XNV-GB>
2026-03-28 22:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2e40cd5b-90a1-5489-b32b-18d7c5c72182 with identifier: GK63%20TXV
2026-03-28 22:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2e40cd5b-90a1-5489-b32b-18d7c5c72182 with identifier: GK63%20TXV
2026-03-28 22:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2e40cd5b-90a1-5489-b32b-18d7c5c72182 with identifier: GK63%20TXV to the API
2026-03-28 22:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GK63%20TXV-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2e40cd5b-90a1-5489-b32b-18d7c5c72182',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GK63 TXV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GK63%20TXV&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 107540,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.2 TSI 85 S Hatchback',
'transmission': 'manual',
'trim': 'TSI 85 S',
'vin': 'WVWZZZAUZEW096389',
'year': 2013}
2026-03-28 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK63%2520TXV%27 HTTP/1.1" 200 None
2026-03-28 22:01:18 [bca.uk] INFO: Saving data for GK63%20TXV: {'auction_closing_time': 1774864800.0, 'created_time': 1774621694.256985, 'last_price_update_time': 1774735278.22018}
2026-03-28 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GK63%2520TXV') HTTP/1.1" 204 0
2026-03-28 22:01:18 [bca.uk] INFO: Found listing with ID: YC61%20FBL
2026-03-28 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC61%2520FBL%27 HTTP/1.1" 200 None
2026-03-28 22:01:18 [bca.uk] INFO: Scrape type for YC61%20FBL: 2
2026-03-28 22:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02c6b227-f167-5666-b1fb-ecc02dc5d047 with identifier: YC61%20FBL
2026-03-28 22:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02c6b227-f167-5666-b1fb-ecc02dc5d047 with scrape type 2
2026-03-28 22:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02c6b227-f167-5666-b1fb-ecc02dc5d047 with scrape type 2
2026-03-28 22:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 02c6b227-f167-5666-b1fb-ecc02dc5d047, identifier: YC61%20FBL
2026-03-28 22:01:18 [bca.uk] INFO: Found listing with ID: MJ12%20UFB
2026-03-28 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ12%2520UFB%27 HTTP/1.1" 200 None
2026-03-28 22:01:18 [bca.uk] INFO: Scrape type for MJ12%20UFB: 2
2026-03-28 22:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b00777e-53b6-528a-adac-a2ef527c4d18 with identifier: MJ12%20UFB
2026-03-28 22:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b00777e-53b6-528a-adac-a2ef527c4d18 with scrape type 2
2026-03-28 22:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b00777e-53b6-528a-adac-a2ef527c4d18 with scrape type 2
2026-03-28 22:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4b00777e-53b6-528a-adac-a2ef527c4d18, identifier: MJ12%20UFB
2026-03-28 22:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 02c6b227-f167-5666-b1fb-ecc02dc5d047 with identifier: YC61%20FBL
2026-03-28 22:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 02c6b227-f167-5666-b1fb-ecc02dc5d047 with identifier: YC61%20FBL
2026-03-28 22:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 02c6b227-f167-5666-b1fb-ecc02dc5d047 with identifier: YC61%20FBL to the API
2026-03-28 22:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 164,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YC61%20FBL-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '02c6b227-f167-5666-b1fb-ecc02dc5d047',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YC61 FBL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YC61%20FBL&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'AUDI',
'model': 'A3 SPORTBACK',
'odometer': 114709,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'AUDI A3 SPORTBACK 1.6 TECHNIK Hatchback',
'transmission': 'manual',
'trim': 'TECHNIK',
'vin': 'WAUZZZ8P5CA085190',
'year': 2012}
2026-03-28 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC61%2520FBL%27 HTTP/1.1" 200 None
2026-03-28 22:01:18 [bca.uk] INFO: Saving data for YC61%20FBL: {'auction_closing_time': 1774864800.0, 'created_time': 1774621484.749848, 'last_price_update_time': 1774735278.82862}
2026-03-28 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YC61%2520FBL') HTTP/1.1" 204 0
2026-03-28 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698966061%27 HTTP/1.1" 200 None
2026-03-28 22:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966061 not downloaded yet
2026-03-28 22:01:18 [bca.uk] INFO: Found listing with ID: WJ15%20ZVL
2026-03-28 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ15%2520ZVL%27 HTTP/1.1" 200 None
2026-03-28 22:01:18 [bca.uk] INFO: Scrape type for WJ15%20ZVL: 2
2026-03-28 22:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ec8d1eb-2bf1-50ab-b27b-39402c98fc53 with identifier: WJ15%20ZVL
2026-03-28 22:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ec8d1eb-2bf1-50ab-b27b-39402c98fc53 with scrape type 2
2026-03-28 22:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ec8d1eb-2bf1-50ab-b27b-39402c98fc53 with scrape type 2
2026-03-28 22:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4ec8d1eb-2bf1-50ab-b27b-39402c98fc53, identifier: WJ15%20ZVL
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058511%27 HTTP/1.1" 200 None
2026-03-28 22:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058511 not downloaded yet
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698966005%27 HTTP/1.1" 200 None
2026-03-28 22:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966005 not downloaded yet
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981022%27 HTTP/1.1" 200 None
2026-03-28 22:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981022 not downloaded yet
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285772%27 HTTP/1.1" 200 None
2026-03-28 22:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285772 not downloaded yet
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699080986%27 HTTP/1.1" 200 None
2026-03-28 22:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699080986 not downloaded yet
2026-03-28 22:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547317650>
2026-03-28 22:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8076e5d-cb8b-5578-9e3b-020e67e6d8b5/d8076e5d-cb8b-5578-9e3b-020e67e6d8b5_expert_report_file_347a9b99-df7c-4f00-ac0f-3f9f04fd3524.pdf HTTP/1.1" 201 0
2026-03-28 22:01:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d8076e5d-cb8b-5578-9e3b-020e67e6d8b5
2026-03-28 22:01:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8076e5d-cb8b-5578-9e3b-020e67e6d8b5, skipping ID generation
2026-03-28 22:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8076e5d-cb8b-5578-9e3b-020e67e6d8b5
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAV03RSZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AV03RSZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473129d0>
2026-03-28 22:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d540cd8f-d715-5405-a8d5-11721b31b439/d540cd8f-d715-5405-a8d5-11721b31b439_expert_report_file_11c27647-3734-4965-93db-996809912791.pdf HTTP/1.1" 201 0
2026-03-28 22:01:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d540cd8f-d715-5405-a8d5-11721b31b439
2026-03-28 22:01:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d540cd8f-d715-5405-a8d5-11721b31b439, skipping ID generation
2026-03-28 22:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d540cd8f-d715-5405-a8d5-11721b31b439
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLT70TDO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LT70TDO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ68UWN/42811039?sv=2020-08-04&st=2026-03-28T22%3A01%3A10Z&se=2026-03-28T22%3A26%3A10Z&sr=b&sp=r&sig=1ZiFBHKVUwguyFOSNXk0RG8MN%2BDlXzRukHPnqyWqOFk%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT19CVS/42811387?sv=2020-08-04&st=2026-03-28T22%3A01%3A08Z&se=2026-03-28T22%3A26%3A08Z&sr=b&sp=r&sig=Xezo2YoS0t9x6abxzIwcxCNA1wXAbFztVA4zM%2F%2Bntk8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP11OHH/42810859?sv=2020-08-04&st=2026-03-28T22%3A01%3A17Z&se=2026-03-28T22%3A26%3A17Z&sr=b&sp=r&sig=b7CgL1od%2BxWYmvFyCkZBnwP%2Fc8hvRbuQDmBfA%2FtGEC4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FP11%20OHH-GB>
2026-03-28 22:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4b00777e-53b6-528a-adac-a2ef527c4d18 with identifier: MJ12%20UFB
2026-03-28 22:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4b00777e-53b6-528a-adac-a2ef527c4d18 with identifier: MJ12%20UFB
2026-03-28 22:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4b00777e-53b6-528a-adac-a2ef527c4d18 with identifier: MJ12%20UFB to the API
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MJ12%20UFB-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4b00777e-53b6-528a-adac-a2ef527c4d18',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MJ12 UFB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MJ12%20UFB&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'FORD',
'model': 'KA',
'odometer': 91180,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD KA 1.2 ZETEC S/S Hatchback',
'transmission': 'manual',
'trim': 'ZETEC S/S',
'vin': 'WF0UXXLTRUCD69649',
'year': 2012}
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ12%2520UFB%27 HTTP/1.1" 200 None
2026-03-28 22:01:19 [bca.uk] INFO: Saving data for MJ12%20UFB: {'auction_closing_time': 1774864800.0, 'created_time': 1774621672.742413, 'last_price_update_time': 1774735279.691184}
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MJ12%2520UFB') HTTP/1.1" 204 0
2026-03-28 22:01:19 [bca.uk] INFO: Found listing with ID: YD15%20XKJ
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD15%2520XKJ%27 HTTP/1.1" 200 None
2026-03-28 22:01:19 [bca.uk] INFO: Scrape type for YD15%20XKJ: 0
2026-03-28 22:01:19 [bca.uk] INFO: Found listing with ID: YE59%20VRX
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE59%2520VRX%27 HTTP/1.1" 200 None
2026-03-28 22:01:19 [bca.uk] INFO: Scrape type for YE59%20VRX: 1
2026-03-28 22:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e840cff7-63ef-534e-a127-ffab51ca54c5 with identifier: YE59%20VRX
2026-03-28 22:01:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e840cff7-63ef-534e-a127-ffab51ca54c5
2026-03-28 22:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4ec8d1eb-2bf1-50ab-b27b-39402c98fc53 with identifier: WJ15%20ZVL
2026-03-28 22:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4ec8d1eb-2bf1-50ab-b27b-39402c98fc53 with identifier: WJ15%20ZVL
2026-03-28 22:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4ec8d1eb-2bf1-50ab-b27b-39402c98fc53 with identifier: WJ15%20ZVL to the API
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 133,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ15%20ZVL-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4ec8d1eb-2bf1-50ab-b27b-39402c98fc53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ15 ZVL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ15%20ZVL&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'MINI',
'model': 'COOPER',
'odometer': 99528,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'MINI COOPER 2.0 230 JOHN COOPER WORKS Hatchback',
'transmission': 'automatic',
'trim': '230 JOHN COOPER WORKS',
'vin': 'WMWXM920102A28169',
'year': 2015}
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ15%2520ZVL%27 HTTP/1.1" 200 None
2026-03-28 22:01:20 [bca.uk] INFO: Saving data for WJ15%20ZVL: {'auction_closing_time': 1774864800.0, 'created_time': 1774044474.914507, 'last_price_update_time': 1774735280.087139}
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ15%2520ZVL') HTTP/1.1" 204 0
2026-03-28 22:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ70EHU/42811341?sv=2020-08-04&st=2026-03-28T22%3A01%3A12Z&se=2026-03-28T22%3A26%3A12Z&sr=b&sp=r&sig=jIMEwQ1nhHjk3xUWtYxp4DaMU%2Fd7rUcdJRYrXhJEbps%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:20 [bca.uk] INFO: Found listing with ID: PE14%20KXO
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE14%2520KXO%27 HTTP/1.1" 200 None
2026-03-28 22:01:20 [bca.uk] INFO: Scrape type for PE14%20KXO: 2
2026-03-28 22:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9dbe1dc-f4cc-54f3-bf21-9f2441bfb711 with identifier: PE14%20KXO
2026-03-28 22:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9dbe1dc-f4cc-54f3-bf21-9f2441bfb711 with scrape type 2
2026-03-28 22:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9dbe1dc-f4cc-54f3-bf21-9f2441bfb711 with scrape type 2
2026-03-28 22:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c9dbe1dc-f4cc-54f3-bf21-9f2441bfb711, identifier: PE14%20KXO
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698966068%27 HTTP/1.1" 200 None
2026-03-28 22:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966068 not downloaded yet
2026-03-28 22:01:20 [bca.uk] INFO: Found listing with ID: VO16%20OOC
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO16%2520OOC%27 HTTP/1.1" 200 None
2026-03-28 22:01:20 [bca.uk] INFO: Scrape type for VO16%20OOC: 1
2026-03-28 22:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a483ecb-536a-5a7a-b51b-bc1d2c782d27 with identifier: VO16%20OOC
2026-03-28 22:01:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5a483ecb-536a-5a7a-b51b-bc1d2c782d27
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058527%27 HTTP/1.1" 200 None
2026-03-28 22:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058527 not downloaded yet
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698966013%27 HTTP/1.1" 200 None
2026-03-28 22:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966013 not downloaded yet
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981039%27 HTTP/1.1" 200 None
2026-03-28 22:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981039 not downloaded yet
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285782%27 HTTP/1.1" 200 None
2026-03-28 22:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285782 not downloaded yet
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699080991%27 HTTP/1.1" 200 None
2026-03-28 22:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699080991 not downloaded yet
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074176%27 HTTP/1.1" 200 None
2026-03-28 22:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074176 not downloaded yet
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126403%27 HTTP/1.1" 200 None
2026-03-28 22:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126403 not downloaded yet
2026-03-28 22:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473955d0>
2026-03-28 22:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39f18d5c-38c9-5802-bc90-29e03976b40f/39f18d5c-38c9-5802-bc90-29e03976b40f_expert_report_file_8795e20d-36cc-4ce2-8133-87a9f26c8864.pdf HTTP/1.1" 201 0
2026-03-28 22:01:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 39f18d5c-38c9-5802-bc90-29e03976b40f
2026-03-28 22:01:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39f18d5c-38c9-5802-bc90-29e03976b40f, skipping ID generation
2026-03-28 22:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 39f18d5c-38c9-5802-bc90-29e03976b40f
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCN63OLH-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CN63OLH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG16XLF/42811219?sv=2020-08-04&st=2026-03-28T22%3A01%3A19Z&se=2026-03-28T22%3A26%3A19Z&sr=b&sp=r&sig=piDa4JVgaWBzjvnw0OZ1irSwQFsxpWFyq8MJd75hPTs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BG16%20XLF-GB>
2026-03-28 22:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c9dbe1dc-f4cc-54f3-bf21-9f2441bfb711 with identifier: PE14%20KXO
2026-03-28 22:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c9dbe1dc-f4cc-54f3-bf21-9f2441bfb711 with identifier: PE14%20KXO
2026-03-28 22:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c9dbe1dc-f4cc-54f3-bf21-9f2441bfb711 with identifier: PE14%20KXO to the API
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PE14%20KXO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c9dbe1dc-f4cc-54f3-bf21-9f2441bfb711',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PE14 KXO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PE14%20KXO&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 40983,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TI-VCT 125 TITANIUM NAVIGATOR Hatchback',
'transmission': 'automatic',
'trim': 'TI-VCT 125 TITANIUM NAVIGATOR',
'vin': 'WF0KXXGCBKES27765',
'year': 2014}
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE14%2520KXO%27 HTTP/1.1" 200 None
2026-03-28 22:01:20 [bca.uk] INFO: Saving data for PE14%20KXO: {'auction_closing_time': 1774864800.0, 'created_time': 1774621700.92926, 'last_price_update_time': 1774735280.784953}
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PE14%2520KXO') HTTP/1.1" 204 0
2026-03-28 22:01:20 [bca.uk] INFO: Found listing with ID: YP07%20ZRX
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP07%2520ZRX%27 HTTP/1.1" 200 None
2026-03-28 22:01:20 [bca.uk] INFO: Scrape type for YP07%20ZRX: 1
2026-03-28 22:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2 with identifier: YP07%20ZRX
2026-03-28 22:01:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2
2026-03-28 22:01:20 [bca.uk] INFO: Found listing with ID: PN57%20XKS
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN57%2520XKS%27 HTTP/1.1" 200 None
2026-03-28 22:01:20 [bca.uk] INFO: Scrape type for PN57%20XKS: 0
2026-03-28 22:01:20 [bca.uk] INFO: Found listing with ID: PY15%20TGO
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY15%2520TGO%27 HTTP/1.1" 200 None
2026-03-28 22:01:20 [bca.uk] INFO: Scrape type for PY15%20TGO: 2
2026-03-28 22:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 830419de-9cf7-53e9-9135-911d8bd5b61a with identifier: PY15%20TGO
2026-03-28 22:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 830419de-9cf7-53e9-9135-911d8bd5b61a with scrape type 2
2026-03-28 22:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 830419de-9cf7-53e9-9135-911d8bd5b61a with scrape type 2
2026-03-28 22:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 830419de-9cf7-53e9-9135-911d8bd5b61a, identifier: PY15%20TGO
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698966077%27 HTTP/1.1" 200 None
2026-03-28 22:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966077 not downloaded yet
2026-03-28 22:01:20 [bca.uk] INFO: Found listing with ID: WJ67%20VEM
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ67%2520VEM%27 HTTP/1.1" 200 None
2026-03-28 22:01:21 [bca.uk] INFO: Scrape type for WJ67%20VEM: 1
2026-03-28 22:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c0b8d3c-494f-51dc-ba6a-63cfe435e086 with identifier: WJ67%20VEM
2026-03-28 22:01:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3c0b8d3c-494f-51dc-ba6a-63cfe435e086
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058536%27 HTTP/1.1" 200 None
2026-03-28 22:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058536 not downloaded yet
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698966027%27 HTTP/1.1" 200 None
2026-03-28 22:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966027 not downloaded yet
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981057%27 HTTP/1.1" 200 None
2026-03-28 22:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981057 not downloaded yet
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285790%27 HTTP/1.1" 200 None
2026-03-28 22:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285790 not downloaded yet
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699081007%27 HTTP/1.1" 200 None
2026-03-28 22:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081007 not downloaded yet
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074183%27 HTTP/1.1" 200 None
2026-03-28 22:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074183 not downloaded yet
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126412%27 HTTP/1.1" 200 None
2026-03-28 22:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126412 not downloaded yet
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994091%27 HTTP/1.1" 200 None
2026-03-28 22:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994091 not downloaded yet
2026-03-28 22:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473da550>
2026-03-28 22:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f05d113-747f-52ed-a1ad-9799bad35377/7f05d113-747f-52ed-a1ad-9799bad35377_expert_report_file_c3ac6563-da9a-4d07-b035-ce34701a17d9.pdf HTTP/1.1" 201 0
2026-03-28 22:01:21 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7f05d113-747f-52ed-a1ad-9799bad35377
2026-03-28 22:01:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f05d113-747f-52ed-a1ad-9799bad35377, skipping ID generation
2026-03-28 22:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7f05d113-747f-52ed-a1ad-9799bad35377
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBJ68UWN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BJ68UWN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54732cb90>
2026-03-28 22:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b3f5c4-70ca-530a-a56a-701b7ee98ebe/d2b3f5c4-70ca-530a-a56a-701b7ee98ebe_expert_report_file_7917b8d7-9b13-45a9-a020-204974c04ad6.pdf HTTP/1.1" 201 0
2026-03-28 22:01:21 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d2b3f5c4-70ca-530a-a56a-701b7ee98ebe
2026-03-28 22:01:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2b3f5c4-70ca-530a-a56a-701b7ee98ebe, skipping ID generation
2026-03-28 22:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2b3f5c4-70ca-530a-a56a-701b7ee98ebe
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHT19CVS-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HT19CVS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 830419de-9cf7-53e9-9135-911d8bd5b61a with identifier: PY15%20TGO
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 22:01:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 22:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 830419de-9cf7-53e9-9135-911d8bd5b61a with identifier: PY15%20TGO
2026-03-28 22:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 830419de-9cf7-53e9-9135-911d8bd5b61a with identifier: PY15%20TGO to the API
2026-03-28 22:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PY15%20TGO-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '830419de-9cf7-53e9-9135-911d8bd5b61a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PY15 TGO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PY15%20TGO&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'FORD',
'model': 'GRAND CONNECT',
'odometer': 133437,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FORD GRAND CONNECT 1.6 TDCI 115 TITANIUM (5ST) MPV',
'transmission': 'manual',
'trim': 'TDCI 115 TITANIUM (5ST)',
'vin': 'WF05XXWPG5FL19077',
'year': 2015}
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY15%2520TGO%27 HTTP/1.1" 200 None
2026-03-28 22:01:22 [bca.uk] INFO: Saving data for PY15%20TGO: {'auction_closing_time': 1774864800.0, 'created_time': 1774621684.690704, 'last_price_update_time': 1774735282.277136}
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PY15%2520TGO') HTTP/1.1" 204 0
2026-03-28 22:01:22 [bca.uk] INFO: Found listing with ID: BF12%20MYT
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF12%2520MYT%27 HTTP/1.1" 200 None
2026-03-28 22:01:22 [bca.uk] INFO: Scrape type for BF12%20MYT: 1
2026-03-28 22:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be3301d1-7f13-5013-82e2-ed3f1a597939 with identifier: BF12%20MYT
2026-03-28 22:01:22 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item be3301d1-7f13-5013-82e2-ed3f1a597939
2026-03-28 22:01:22 [bca.uk] INFO: Found listing with ID: SK13%20XZN
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK13%2520XZN%27 HTTP/1.1" 200 None
2026-03-28 22:01:22 [bca.uk] INFO: Scrape type for SK13%20XZN: 0
2026-03-28 22:01:22 [bca.uk] INFO: Found listing with ID: VO12%20XVT
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO12%2520XVT%27 HTTP/1.1" 200 None
2026-03-28 22:01:22 [bca.uk] INFO: Scrape type for VO12%20XVT: 0
2026-03-28 22:01:22 [bca.uk] INFO: Found listing with ID: YP66%20VYN
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP66%2520VYN%27 HTTP/1.1" 200 None
2026-03-28 22:01:22 [bca.uk] INFO: Scrape type for YP66%20VYN: 0
2026-03-28 22:01:22 [bca.uk] INFO: Found listing with ID: CW58%20JRW
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CW58%2520JRW%27 HTTP/1.1" 200 None
2026-03-28 22:01:22 [bca.uk] INFO: Scrape type for CW58%20JRW: 0
2026-03-28 22:01:22 [bca.uk] INFO: Found listing with ID: LC08%20XBB
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC08%2520XBB%27 HTTP/1.1" 200 None
2026-03-28 22:01:22 [bca.uk] INFO: Scrape type for LC08%20XBB: 1
2026-03-28 22:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f85ebd75-b202-5555-83e0-f40ad749d770 with identifier: LC08%20XBB
2026-03-28 22:01:22 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f85ebd75-b202-5555-83e0-f40ad749d770
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698966081%27 HTTP/1.1" 200 None
2026-03-28 22:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966081 not downloaded yet
2026-03-28 22:01:22 [bca.uk] INFO: Found listing with ID: YS06%20XVF
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS06%2520XVF%27 HTTP/1.1" 200 None
2026-03-28 22:01:22 [bca.uk] INFO: Scrape type for YS06%20XVF: 1
2026-03-28 22:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee972586-3286-5910-8d85-df63dfdcf24d with identifier: YS06%20XVF
2026-03-28 22:01:22 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ee972586-3286-5910-8d85-df63dfdcf24d
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058568%27 HTTP/1.1" 200 None
2026-03-28 22:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058568 not downloaded yet
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698966038%27 HTTP/1.1" 200 None
2026-03-28 22:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966038 not downloaded yet
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981103%27 HTTP/1.1" 200 None
2026-03-28 22:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981103 not downloaded yet
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285802%27 HTTP/1.1" 200 None
2026-03-28 22:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285802 not downloaded yet
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699081014%27 HTTP/1.1" 200 None
2026-03-28 22:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081014 not downloaded yet
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074190%27 HTTP/1.1" 200 None
2026-03-28 22:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074190 not downloaded yet
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126423%27 HTTP/1.1" 200 None
2026-03-28 22:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126423 not downloaded yet
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994106%27 HTTP/1.1" 200 None
2026-03-28 22:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994106 not downloaded yet
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031396%27 HTTP/1.1" 200 None
2026-03-28 22:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031396 not downloaded yet
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126416%27 HTTP/1.1" 200 None
2026-03-28 22:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126416 not downloaded yet
2026-03-28 22:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54725d950>
2026-03-28 22:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf35b337-845e-537f-a976-08188cca66f3/cf35b337-845e-537f-a976-08188cca66f3_expert_report_file_4962b849-fca7-4552-ae53-4b482cfcc83b.pdf HTTP/1.1" 201 0
2026-03-28 22:01:22 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cf35b337-845e-537f-a976-08188cca66f3
2026-03-28 22:01:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf35b337-845e-537f-a976-08188cca66f3, skipping ID generation
2026-03-28 22:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf35b337-845e-537f-a976-08188cca66f3
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBJ70EHU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BJ70EHU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP15GZB/42811287?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=7tUa0hwrEujFHU3KRxrEE1EA%2FQ%2B2aDgCCCKK2Q5cFLc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ73EOT/42811363?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=Z275yW1rsbj3FapfEeIfN9OJqcCvXddViu6M84JP7AA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698965988/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VA62BTY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:01:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698965995/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698965995>
2026-03-28 22:01:22 [bca.uk] INFO: Found listing with ID: EA62%20XPM
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA62%2520XPM%27 HTTP/1.1" 200 None
2026-03-28 22:01:22 [bca.uk] INFO: Scrape type for EA62%20XPM: 0
2026-03-28 22:01:22 [bca.uk] INFO: Found listing with ID: FE14%20AVW
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE14%2520AVW%27 HTTP/1.1" 200 None
2026-03-28 22:01:22 [bca.uk] INFO: Scrape type for FE14%20AVW: 2
2026-03-28 22:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b235e50-3e0e-57b8-82d8-92073950f59f with identifier: FE14%20AVW
2026-03-28 22:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b235e50-3e0e-57b8-82d8-92073950f59f with scrape type 2
2026-03-28 22:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b235e50-3e0e-57b8-82d8-92073950f59f with scrape type 2
2026-03-28 22:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2b235e50-3e0e-57b8-82d8-92073950f59f, identifier: FE14%20AVW
2026-03-28 22:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VX52YYH/42811323?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=sBcdU%2Bi00fGyPAIkGghzLoIMWb9WJk%2B0Sty%2BOKRiKzA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:22 [bca.uk] INFO: Found listing with ID: VKZ%202608
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VKZ%25202608%27 HTTP/1.1" 200 None
2026-03-28 22:01:22 [bca.uk] INFO: Scrape type for VKZ%202608: 1
2026-03-28 22:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0e083fc-0fc7-5652-936e-3a40315f73e3 with identifier: VKZ%202608
2026-03-28 22:01:22 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a0e083fc-0fc7-5652-936e-3a40315f73e3
2026-03-28 22:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2b235e50-3e0e-57b8-82d8-92073950f59f with identifier: FE14%20AVW
2026-03-28 22:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2b235e50-3e0e-57b8-82d8-92073950f59f with identifier: FE14%20AVW
2026-03-28 22:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2b235e50-3e0e-57b8-82d8-92073950f59f with identifier: FE14%20AVW to the API
2026-03-28 22:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FE14%20AVW-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2b235e50-3e0e-57b8-82d8-92073950f59f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FE14 AVW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FE14%20AVW&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 116643,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 125 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 ZETEC',
'vin': 'WF0KXXGCBKEL72438',
'year': 2014}
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE14%2520AVW%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [bca.uk] INFO: Saving data for FE14%20AVW: {'auction_closing_time': 1774864800.0, 'created_time': 1774621482.547477, 'last_price_update_time': 1774735283.146209}
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FE14%2520AVW') HTTP/1.1" 204 0
2026-03-28 22:01:23 [bca.uk] INFO: Found listing with ID: YY56%20ODW
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY56%2520ODW%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [bca.uk] INFO: Scrape type for YY56%20ODW: 1
2026-03-28 22:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc0e7ef8-c401-5590-9e6c-d0083796c0be with identifier: YY56%20ODW
2026-03-28 22:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item dc0e7ef8-c401-5590-9e6c-d0083796c0be
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058600%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058600 not downloaded yet
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698966045%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966045 not downloaded yet
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981145%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981145 not downloaded yet
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285814%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285814 not downloaded yet
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699081034%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081034 not downloaded yet
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074195%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074195 not downloaded yet
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126439%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126439 not downloaded yet
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994130%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994130 not downloaded yet
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031407%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031407 not downloaded yet
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126433%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126433 not downloaded yet
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110796%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110796 not downloaded yet
2026-03-28 22:01:23 [bca.uk] INFO: Found listing with ID: MT07%20FBY
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT07%2520FBY%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [bca.uk] INFO: Scrape type for MT07%20FBY: 1
2026-03-28 22:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5efd40b-81d0-5f93-9693-58ba123af3be with identifier: MT07%20FBY
2026-03-28 22:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b5efd40b-81d0-5f93-9693-58ba123af3be
2026-03-28 22:01:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966001/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966001>
2026-03-28 22:01:23 [bca.uk] INFO: Found listing with ID: AU61%20XXN
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU61%2520XXN%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [bca.uk] INFO: Scrape type for AU61%20XXN: 0
2026-03-28 22:01:23 [bca.uk] INFO: Found listing with ID: AV12%20XOM
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV12%2520XOM%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [bca.uk] INFO: Scrape type for AV12%20XOM: 2
2026-03-28 22:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 530e01d0-f521-59d6-894f-203412bcfac6 with identifier: AV12%20XOM
2026-03-28 22:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 530e01d0-f521-59d6-894f-203412bcfac6 with scrape type 2
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 530e01d0-f521-59d6-894f-203412bcfac6 with scrape type 2
2026-03-28 22:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 530e01d0-f521-59d6-894f-203412bcfac6, identifier: AV12%20XOM
2026-03-28 22:01:23 [bca.uk] INFO: Found listing with ID: AK60%20YGR
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK60%2520YGR%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [bca.uk] INFO: Scrape type for AK60%20YGR: 1
2026-03-28 22:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c199cc4-2b6f-5122-8d05-996d23603f8a with identifier: AK60%20YGR
2026-03-28 22:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1c199cc4-2b6f-5122-8d05-996d23603f8a
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058625%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058625 not downloaded yet
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698966059%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966059 not downloaded yet
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981179%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981179 not downloaded yet
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285828%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285828 not downloaded yet
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699081056%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081056 not downloaded yet
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074200%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074200 not downloaded yet
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126462%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126462 not downloaded yet
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994141%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994141 not downloaded yet
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031421%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031421 not downloaded yet
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126460%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126460 not downloaded yet
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110805%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110805 not downloaded yet
2026-03-28 22:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472d6d90>
2026-03-28 22:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283b6c92-cce2-544a-9b3b-da049a06ca33/283b6c92-cce2-544a-9b3b-da049a06ca33_expert_report_file_da7bc0a7-827f-4761-80cb-24414611eaf4.pdf HTTP/1.1" 201 0
2026-03-28 22:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 283b6c92-cce2-544a-9b3b-da049a06ca33
2026-03-28 22:01:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 283b6c92-cce2-544a-9b3b-da049a06ca33, skipping ID generation
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 283b6c92-cce2-544a-9b3b-da049a06ca33
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBP15GZB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BP15GZB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55422ddd0>
2026-03-28 22:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2f45d0-e564-5ded-8cb4-0288835f055c/ab2f45d0-e564-5ded-8cb4-0288835f055c_expert_report_file_a5e0810c-07de-4d58-897f-a1c928e91275.pdf HTTP/1.1" 201 0
2026-03-28 22:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ab2f45d0-e564-5ded-8cb4-0288835f055c
2026-03-28 22:01:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab2f45d0-e564-5ded-8cb4-0288835f055c, skipping ID generation
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ab2f45d0-e564-5ded-8cb4-0288835f055c
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKJ73EOT-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KJ73EOT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 530e01d0-f521-59d6-894f-203412bcfac6 with identifier: AV12%20XOM
2026-03-28 22:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 530e01d0-f521-59d6-894f-203412bcfac6 with identifier: AV12%20XOM
2026-03-28 22:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 530e01d0-f521-59d6-894f-203412bcfac6 with identifier: AV12%20XOM to the API
2026-03-28 22:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV12%20XOM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '530e01d0-f521-59d6-894f-203412bcfac6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV12 XOM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV12%20XOM&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 130144,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TDCI 115 TITANIUM X Hatchback',
'transmission': 'manual',
'trim': 'TDCI 115 TITANIUM X',
'vin': 'WF0KXXGCBKCC15110',
'year': 2012}
2026-03-28 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV12%2520XOM%27 HTTP/1.1" 200 None
2026-03-28 22:01:24 [bca.uk] INFO: Saving data for AV12%20XOM: {'auction_closing_time': 1774864800.0, 'created_time': 1774621511.117031, 'last_price_update_time': 1774735284.390927}
2026-03-28 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV12%2520XOM') HTTP/1.1" 204 0
2026-03-28 22:01:24 [bca.uk] INFO: Found listing with ID: NX63%20FVZ
2026-03-28 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX63%2520FVZ%27 HTTP/1.1" 200 None
2026-03-28 22:01:24 [bca.uk] INFO: Scrape type for NX63%20FVZ: 0
2026-03-28 22:01:24 [bca.uk] INFO: Found listing with ID: PE59%20LYK
2026-03-28 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE59%2520LYK%27 HTTP/1.1" 200 None
2026-03-28 22:01:24 [bca.uk] INFO: Scrape type for PE59%20LYK: 2
2026-03-28 22:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b47f1f94-f045-5f47-ba01-e11d6a69034f with identifier: PE59%20LYK
2026-03-28 22:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b47f1f94-f045-5f47-ba01-e11d6a69034f with scrape type 2
2026-03-28 22:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b47f1f94-f045-5f47-ba01-e11d6a69034f with scrape type 2
2026-03-28 22:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b47f1f94-f045-5f47-ba01-e11d6a69034f, identifier: PE59%20LYK
2026-03-28 22:01:24 [bca.uk] INFO: Found listing with ID: BG14%20OHU
2026-03-28 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG14%2520OHU%27 HTTP/1.1" 200 None
2026-03-28 22:01:24 [bca.uk] INFO: Scrape type for BG14%20OHU: 2
2026-03-28 22:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adcd49ce-e0fe-5874-8c1b-a8a55d414bd7 with identifier: BG14%20OHU
2026-03-28 22:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adcd49ce-e0fe-5874-8c1b-a8a55d414bd7 with scrape type 2
2026-03-28 22:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adcd49ce-e0fe-5874-8c1b-a8a55d414bd7 with scrape type 2
2026-03-28 22:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: adcd49ce-e0fe-5874-8c1b-a8a55d414bd7, identifier: BG14%20OHU
2026-03-28 22:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b47f1f94-f045-5f47-ba01-e11d6a69034f with identifier: PE59%20LYK
2026-03-28 22:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b47f1f94-f045-5f47-ba01-e11d6a69034f with identifier: PE59%20LYK
2026-03-28 22:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b47f1f94-f045-5f47-ba01-e11d6a69034f with identifier: PE59%20LYK to the API
2026-03-28 22:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PE59%20LYK-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b47f1f94-f045-5f47-ba01-e11d6a69034f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PE59 LYK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PE59%20LYK&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FIAT',
'model': '500',
'odometer': 93581,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'FIAT 500 1.2 POP Hatchback',
'transmission': 'manual',
'trim': 'POP',
'vin': 'ZFA31200000434286',
'year': 2009}
2026-03-28 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE59%2520LYK%27 HTTP/1.1" 200 None
2026-03-28 22:01:24 [bca.uk] INFO: Saving data for PE59%20LYK: {'auction_closing_time': 1774864800.0, 'created_time': 1774621482.029546, 'last_price_update_time': 1774735284.961265}
2026-03-28 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PE59%2520LYK') HTTP/1.1" 204 0
2026-03-28 22:01:24 [bca.uk] INFO: Found listing with ID: AY07%20YBB
2026-03-28 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY07%2520YBB%27 HTTP/1.1" 200 None
2026-03-28 22:01:24 [bca.uk] INFO: Scrape type for AY07%20YBB: 1
2026-03-28 22:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88817b86-325c-592c-b16f-dff4dccb2371 with identifier: AY07%20YBB
2026-03-28 22:01:24 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 88817b86-325c-592c-b16f-dff4dccb2371
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058638%27 HTTP/1.1" 200 None
2026-03-28 22:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058638 not downloaded yet
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698966066%27 HTTP/1.1" 200 None
2026-03-28 22:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966066 not downloaded yet
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981217%27 HTTP/1.1" 200 None
2026-03-28 22:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981217 not downloaded yet
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285845%27 HTTP/1.1" 200 None
2026-03-28 22:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285845 not downloaded yet
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699081079%27 HTTP/1.1" 200 None
2026-03-28 22:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081079 not downloaded yet
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074206%27 HTTP/1.1" 200 None
2026-03-28 22:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074206 not downloaded yet
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126495%27 HTTP/1.1" 200 None
2026-03-28 22:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126495 not downloaded yet
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994151%27 HTTP/1.1" 200 None
2026-03-28 22:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994151 not downloaded yet
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031439%27 HTTP/1.1" 200 None
2026-03-28 22:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031439 not downloaded yet
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126485%27 HTTP/1.1" 200 None
2026-03-28 22:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126485 not downloaded yet
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110815%27 HTTP/1.1" 200 None
2026-03-28 22:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110815 not downloaded yet
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093818%27 HTTP/1.1" 200 None
2026-03-28 22:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093818 not downloaded yet
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110802%27 HTTP/1.1" 200 None
2026-03-28 22:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110802 not downloaded yet
2026-03-28 22:01:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285748/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FV69BJO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: adcd49ce-e0fe-5874-8c1b-a8a55d414bd7 with identifier: BG14%20OHU
2026-03-28 22:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: adcd49ce-e0fe-5874-8c1b-a8a55d414bd7 with identifier: BG14%20OHU
2026-03-28 22:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: adcd49ce-e0fe-5874-8c1b-a8a55d414bd7 with identifier: BG14%20OHU to the API
2026-03-28 22:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BG14%20OHU-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'adcd49ce-e0fe-5874-8c1b-a8a55d414bd7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BG14 OHU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BG14%20OHU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 120908,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI 1.5 DCI 110 TEKNA Hatchback',
'transmission': 'manual',
'trim': 'DCI 110 TEKNA',
'vin': 'SJNFAAJ11U1106884',
'year': 2014}
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG14%2520OHU%27 HTTP/1.1" 200 None
2026-03-28 22:01:26 [bca.uk] INFO: Saving data for BG14%20OHU: {'auction_closing_time': 1774864800.0, 'created_time': 1774621511.709352, 'last_price_update_time': 1774735286.309767}
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BG14%2520OHU') HTTP/1.1" 204 0
2026-03-28 22:01:26 [bca.uk] INFO: Found listing with ID: SL63%20HWN
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL63%2520HWN%27 HTTP/1.1" 200 None
2026-03-28 22:01:26 [bca.uk] INFO: Scrape type for SL63%20HWN: 0
2026-03-28 22:01:26 [bca.uk] INFO: Found listing with ID: WN18%20XOM
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN18%2520XOM%27 HTTP/1.1" 200 None
2026-03-28 22:01:26 [bca.uk] INFO: Scrape type for WN18%20XOM: 0
2026-03-28 22:01:26 [bca.uk] INFO: Found listing with ID: PF68%20ZTH
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF68%2520ZTH%27 HTTP/1.1" 200 None
2026-03-28 22:01:26 [bca.uk] INFO: Scrape type for PF68%20ZTH: 0
2026-03-28 22:01:26 [bca.uk] INFO: Found listing with ID: OY68%20FWV
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY68%2520FWV%27 HTTP/1.1" 200 None
2026-03-28 22:01:26 [bca.uk] INFO: Scrape type for OY68%20FWV: 2
2026-03-28 22:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b5ca7e9-d25c-5689-b351-05dff35dccfa with identifier: OY68%20FWV
2026-03-28 22:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b5ca7e9-d25c-5689-b351-05dff35dccfa with scrape type 2
2026-03-28 22:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b5ca7e9-d25c-5689-b351-05dff35dccfa with scrape type 2
2026-03-28 22:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2b5ca7e9-d25c-5689-b351-05dff35dccfa, identifier: OY68%20FWV
2026-03-28 22:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474f3350>
2026-03-28 22:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d9ff90-12a7-5f3d-86ac-c640dc2351b5/08d9ff90-12a7-5f3d-86ac-c640dc2351b5_expert_report_file_7389229f-bcf3-4801-a073-b37eac82683f.pdf HTTP/1.1" 201 0
2026-03-28 22:01:26 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 08d9ff90-12a7-5f3d-86ac-c640dc2351b5
2026-03-28 22:01:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08d9ff90-12a7-5f3d-86ac-c640dc2351b5, skipping ID generation
2026-03-28 22:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 08d9ff90-12a7-5f3d-86ac-c640dc2351b5
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DVX52YYH-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VX52YYH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:26 [bca.uk] INFO: Found listing with ID: BL12%20HFK
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL12%2520HFK%27 HTTP/1.1" 200 None
2026-03-28 22:01:26 [bca.uk] INFO: Scrape type for BL12%20HFK: 0
2026-03-28 22:01:26 [bca.uk] INFO: Found listing with ID: EK63%20FTA
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK63%2520FTA%27 HTTP/1.1" 200 None
2026-03-28 22:01:26 [bca.uk] INFO: Scrape type for EK63%20FTA: 1
2026-03-28 22:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f3242ee-badd-5243-9618-1a2a403b68bc with identifier: EK63%20FTA
2026-03-28 22:01:26 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0f3242ee-badd-5243-9618-1a2a403b68bc
2026-03-28 22:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2b5ca7e9-d25c-5689-b351-05dff35dccfa with identifier: OY68%20FWV
2026-03-28 22:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2b5ca7e9-d25c-5689-b351-05dff35dccfa with identifier: OY68%20FWV
2026-03-28 22:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2b5ca7e9-d25c-5689-b351-05dff35dccfa with identifier: OY68%20FWV to the API
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 197,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OY68%20FWV-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2b5ca7e9-d25c-5689-b351-05dff35dccfa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OY68 FWV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OY68%20FWV&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'LAND ROVER',
'model': 'DISCOVERY',
'odometer': 68245,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY 2.0 SD4 240 HSE StationWagon',
'transmission': 'automatic',
'trim': 'SD4 240 HSE',
'vin': 'SALRA2AN5KA083764',
'year': 2018}
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY68%2520FWV%27 HTTP/1.1" 200 None
2026-03-28 22:01:26 [bca.uk] INFO: Saving data for OY68%20FWV: {'auction_closing_time': 1774864800.0, 'created_time': 1774621463.820464, 'last_price_update_time': 1774735286.980854}
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OY68%2520FWV') HTTP/1.1" 204 0
2026-03-28 22:01:27 [bca.uk] INFO: Found listing with ID: EO61%20OVX
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO61%2520OVX%27 HTTP/1.1" 200 None
2026-03-28 22:01:27 [bca.uk] INFO: Scrape type for EO61%20OVX: 1
2026-03-28 22:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2337f209-45ff-57b7-b370-ccb04b4d58bb with identifier: EO61%20OVX
2026-03-28 22:01:27 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2337f209-45ff-57b7-b370-ccb04b4d58bb
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699081101%27 HTTP/1.1" 200 None
2026-03-28 22:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081101 not downloaded yet
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074212%27 HTTP/1.1" 200 None
2026-03-28 22:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074212 not downloaded yet
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126527%27 HTTP/1.1" 200 None
2026-03-28 22:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126527 not downloaded yet
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994176%27 HTTP/1.1" 200 None
2026-03-28 22:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994176 not downloaded yet
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031464%27 HTTP/1.1" 200 None
2026-03-28 22:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031464 not downloaded yet
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126505%27 HTTP/1.1" 200 None
2026-03-28 22:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126505 not downloaded yet
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110824%27 HTTP/1.1" 200 None
2026-03-28 22:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110824 not downloaded yet
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093835%27 HTTP/1.1" 200 None
2026-03-28 22:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093835 not downloaded yet
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110816%27 HTTP/1.1" 200 None
2026-03-28 22:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110816 not downloaded yet
2026-03-28 22:01:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698980998/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ND62EWM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:01:27 [bca.uk] INFO: Found listing with ID: AY64%20SVS
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY64%2520SVS%27 HTTP/1.1" 200 None
2026-03-28 22:01:27 [bca.uk] INFO: Scrape type for AY64%20SVS: 0
2026-03-28 22:01:27 [bca.uk] INFO: Found listing with ID: BA15%20AFX
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BA15%2520AFX%27 HTTP/1.1" 200 None
2026-03-28 22:01:27 [bca.uk] INFO: Scrape type for BA15%20AFX: 0
2026-03-28 22:01:27 [bca.uk] INFO: Found listing with ID: DG15%20ONP
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG15%2520ONP%27 HTTP/1.1" 200 None
2026-03-28 22:01:27 [bca.uk] INFO: Scrape type for DG15%20ONP: 0
2026-03-28 22:01:27 [bca.uk] INFO: Found listing with ID: FL17%20BVP
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL17%2520BVP%27 HTTP/1.1" 200 None
2026-03-28 22:01:27 [bca.uk] INFO: Scrape type for FL17%20BVP: 0
2026-03-28 22:01:27 [bca.uk] INFO: Found listing with ID: KT15%20TFY
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT15%2520TFY%27 HTTP/1.1" 200 None
2026-03-28 22:01:27 [bca.uk] INFO: Scrape type for KT15%20TFY: 2
2026-03-28 22:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32e9bff7-981c-5c2d-bf83-e6a0ea8d0c25 with identifier: KT15%20TFY
2026-03-28 22:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32e9bff7-981c-5c2d-bf83-e6a0ea8d0c25 with scrape type 2
2026-03-28 22:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32e9bff7-981c-5c2d-bf83-e6a0ea8d0c25 with scrape type 2
2026-03-28 22:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 32e9bff7-981c-5c2d-bf83-e6a0ea8d0c25, identifier: KT15%20TFY
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093820%27 HTTP/1.1" 200 None
2026-03-28 22:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093820 not downloaded yet
2026-03-28 22:01:27 [bca.uk] INFO: Found listing with ID: EO61%20TBV
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO61%2520TBV%27 HTTP/1.1" 200 None
2026-03-28 22:01:27 [bca.uk] INFO: Scrape type for EO61%20TBV: 0
2026-03-28 22:01:27 [bca.uk] INFO: Found listing with ID: FT61%20VUR
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT61%2520VUR%27 HTTP/1.1" 200 None
2026-03-28 22:01:27 [bca.uk] INFO: Scrape type for FT61%20VUR: 1
2026-03-28 22:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a45df846-9de9-5dca-bfcb-dcf57dc2b59b with identifier: FT61%20VUR
2026-03-28 22:01:27 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a45df846-9de9-5dca-bfcb-dcf57dc2b59b
2026-03-28 22:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 32e9bff7-981c-5c2d-bf83-e6a0ea8d0c25 with identifier: KT15%20TFY
2026-03-28 22:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 32e9bff7-981c-5c2d-bf83-e6a0ea8d0c25 with identifier: KT15%20TFY
2026-03-28 22:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 32e9bff7-981c-5c2d-bf83-e6a0ea8d0c25 with identifier: KT15%20TFY to the API
2026-03-28 22:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 94,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KT15%20TFY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '32e9bff7-981c-5c2d-bf83-e6a0ea8d0c25',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KT15 TFY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KT15%20TFY&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'PEUGEOT',
'model': '308',
'odometer': 88267,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 1.6 BLUEHDI 100 ACTIVE Hatchback',
'transmission': 'manual',
'trim': 'BLUEHDI 100 ACTIVE',
'vin': 'VF3LBBHYBFS139228',
'year': 2015}
2026-03-28 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT15%2520TFY%27 HTTP/1.1" 200 None
2026-03-28 22:01:29 [bca.uk] INFO: Saving data for KT15%20TFY: {'auction_closing_time': 1774864800.0, 'created_time': 1774621469.727066, 'last_price_update_time': 1774735289.761465}
2026-03-28 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KT15%2520TFY') HTTP/1.1" 204 0
2026-03-28 22:01:29 [bca.uk] INFO: Found listing with ID: WN12%20FKU
2026-03-28 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN12%2520FKU%27 HTTP/1.1" 200 None
2026-03-28 22:01:29 [bca.uk] INFO: Scrape type for WN12%20FKU: 1
2026-03-28 22:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30726c84-9b6d-55d7-85ab-840199d36e87 with identifier: WN12%20FKU
2026-03-28 22:01:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 30726c84-9b6d-55d7-85ab-840199d36e87
2026-03-28 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699081138%27 HTTP/1.1" 200 None
2026-03-28 22:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081138 not downloaded yet
2026-03-28 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074220%27 HTTP/1.1" 200 None
2026-03-28 22:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074220 not downloaded yet
2026-03-28 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126555%27 HTTP/1.1" 200 None
2026-03-28 22:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126555 not downloaded yet
2026-03-28 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994196%27 HTTP/1.1" 200 None
2026-03-28 22:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994196 not downloaded yet
2026-03-28 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031495%27 HTTP/1.1" 200 None
2026-03-28 22:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031495 not downloaded yet
2026-03-28 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126531%27 HTTP/1.1" 200 None
2026-03-28 22:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126531 not downloaded yet
2026-03-28 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110837%27 HTTP/1.1" 200 None
2026-03-28 22:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110837 not downloaded yet
2026-03-28 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093851%27 HTTP/1.1" 200 None
2026-03-28 22:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093851 not downloaded yet
2026-03-28 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110825%27 HTTP/1.1" 200 None
2026-03-28 22:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110825 not downloaded yet
2026-03-28 22:01:30 [bca.uk] INFO: Found listing with ID: NC54%20LBO
2026-03-28 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC54%2520LBO%27 HTTP/1.1" 200 None
2026-03-28 22:01:30 [bca.uk] INFO: Scrape type for NC54%20LBO: 2
2026-03-28 22:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8ebf215-e0de-522f-b9a1-9e723f5474a5 with identifier: NC54%20LBO
2026-03-28 22:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8ebf215-e0de-522f-b9a1-9e723f5474a5 with scrape type 2
2026-03-28 22:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8ebf215-e0de-522f-b9a1-9e723f5474a5 with scrape type 2
2026-03-28 22:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b8ebf215-e0de-522f-b9a1-9e723f5474a5, identifier: NC54%20LBO
2026-03-28 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093838%27 HTTP/1.1" 200 None
2026-03-28 22:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093838 not downloaded yet
2026-03-28 22:01:30 [bca.uk] INFO: Found listing with ID: GJ11%20JRU
2026-03-28 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ11%2520JRU%27 HTTP/1.1" 200 None
2026-03-28 22:01:30 [bca.uk] INFO: Scrape type for GJ11%20JRU: 0
2026-03-28 22:01:30 [bca.uk] INFO: Found listing with ID: GU12%20NFM
2026-03-28 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU12%2520NFM%27 HTTP/1.1" 200 None
2026-03-28 22:01:30 [bca.uk] INFO: Scrape type for GU12%20NFM: 0
2026-03-28 22:01:30 [bca.uk] INFO: Found listing with ID: GU59%20RWV
2026-03-28 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU59%2520RWV%27 HTTP/1.1" 200 None
2026-03-28 22:01:30 [bca.uk] INFO: Scrape type for GU59%20RWV: 2
2026-03-28 22:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ad8d91f-b311-579f-a1af-d991c2e4de78 with identifier: GU59%20RWV
2026-03-28 22:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ad8d91f-b311-579f-a1af-d991c2e4de78 with scrape type 2
2026-03-28 22:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ad8d91f-b311-579f-a1af-d991c2e4de78 with scrape type 2
2026-03-28 22:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1ad8d91f-b311-579f-a1af-d991c2e4de78, identifier: GU59%20RWV
2026-03-28 22:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b8ebf215-e0de-522f-b9a1-9e723f5474a5 with identifier: NC54%20LBO
2026-03-28 22:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b8ebf215-e0de-522f-b9a1-9e723f5474a5 with identifier: NC54%20LBO
2026-03-28 22:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b8ebf215-e0de-522f-b9a1-9e723f5474a5 with identifier: NC54%20LBO to the API
2026-03-28 22:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 161,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NC54%20LBO-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b8ebf215-e0de-522f-b9a1-9e723f5474a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NC54 LBO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NC54%20LBO&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 74481,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 LX Hatchback',
'transmission': 'manual',
'trim': 'LX',
'vin': 'WF05XXGCD54T60198',
'year': 2005}
2026-03-28 22:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC54%2520LBO%27 HTTP/1.1" 200 None
2026-03-28 22:01:31 [bca.uk] INFO: Saving data for NC54%20LBO: {'auction_closing_time': 1774864800.0, 'created_time': 1774535339.160858, 'last_price_update_time': 1774735291.811954}
2026-03-28 22:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NC54%2520LBO') HTTP/1.1" 204 0
2026-03-28 22:01:31 [bca.uk] INFO: Found listing with ID: FD70%20LYC
2026-03-28 22:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD70%2520LYC%27 HTTP/1.1" 200 None
2026-03-28 22:01:31 [bca.uk] INFO: Scrape type for FD70%20LYC: 1
2026-03-28 22:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5dbf164-beca-542e-a8d7-8ec419cfcb14 with identifier: FD70%20LYC
2026-03-28 22:01:31 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c5dbf164-beca-542e-a8d7-8ec419cfcb14
2026-03-28 22:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074227%27 HTTP/1.1" 200 None
2026-03-28 22:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074227 not downloaded yet
2026-03-28 22:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126571%27 HTTP/1.1" 200 None
2026-03-28 22:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126571 not downloaded yet
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994217%27 HTTP/1.1" 200 None
2026-03-28 22:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994217 not downloaded yet
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031527%27 HTTP/1.1" 200 None
2026-03-28 22:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031527 not downloaded yet
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126547%27 HTTP/1.1" 200 None
2026-03-28 22:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126547 not downloaded yet
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110850%27 HTTP/1.1" 200 None
2026-03-28 22:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110850 not downloaded yet
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093861%27 HTTP/1.1" 200 None
2026-03-28 22:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093861 not downloaded yet
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110839%27 HTTP/1.1" 200 None
2026-03-28 22:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110839 not downloaded yet
2026-03-28 22:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1ad8d91f-b311-579f-a1af-d991c2e4de78 with identifier: GU59%20RWV
2026-03-28 22:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1ad8d91f-b311-579f-a1af-d991c2e4de78 with identifier: GU59%20RWV
2026-03-28 22:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1ad8d91f-b311-579f-a1af-d991c2e4de78 with identifier: GU59%20RWV to the API
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU59%20RWV-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1ad8d91f-b311-579f-a1af-d991c2e4de78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU59 RWV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GU59%20RWV&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 76415,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.4 LIFE Hatchback',
'transmission': 'manual',
'trim': 'LIFE',
'vin': 'W0L0AHL48A8006280',
'year': 2009}
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU59%2520RWV%27 HTTP/1.1" 200 None
2026-03-28 22:01:32 [bca.uk] INFO: Saving data for GU59%20RWV: {'auction_closing_time': 1774864800.0, 'created_time': 1774621543.978848, 'last_price_update_time': 1774735292.497079}
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GU59%2520RWV') HTTP/1.1" 204 0
2026-03-28 22:01:32 [bca.uk] INFO: Found listing with ID: PO63%20ERY
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PO63%2520ERY%27 HTTP/1.1" 200 None
2026-03-28 22:01:32 [bca.uk] INFO: Scrape type for PO63%20ERY: 0
2026-03-28 22:01:32 [bca.uk] INFO: Found listing with ID: SD61%20OMA
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD61%2520OMA%27 HTTP/1.1" 200 None
2026-03-28 22:01:32 [bca.uk] INFO: Scrape type for SD61%20OMA: 0
2026-03-28 22:01:32 [bca.uk] INFO: Found listing with ID: SK09%20KND
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK09%2520KND%27 HTTP/1.1" 200 None
2026-03-28 22:01:32 [bca.uk] INFO: Scrape type for SK09%20KND: 0
2026-03-28 22:01:32 [bca.uk] INFO: Found listing with ID: ST11%20EOH
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST11%2520EOH%27 HTTP/1.1" 200 None
2026-03-28 22:01:32 [bca.uk] INFO: Scrape type for ST11%20EOH: 0
2026-03-28 22:01:32 [bca.uk] INFO: Found listing with ID: SY59%20TZB
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY59%2520TZB%27 HTTP/1.1" 200 None
2026-03-28 22:01:32 [bca.uk] INFO: Scrape type for SY59%20TZB: 0
2026-03-28 22:01:32 [bca.uk] INFO: Found listing with ID: WK09%20UJC
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK09%2520UJC%27 HTTP/1.1" 200 None
2026-03-28 22:01:32 [bca.uk] INFO: Scrape type for WK09%20UJC: 0
2026-03-28 22:01:32 [bca.uk] INFO: Found listing with ID: YG14%20WCU
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG14%2520WCU%27 HTTP/1.1" 200 None
2026-03-28 22:01:32 [bca.uk] INFO: Scrape type for YG14%20WCU: 0
2026-03-28 22:01:32 [bca.uk] INFO: Found listing with ID: CE10%20VBJ
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE10%2520VBJ%27 HTTP/1.1" 200 None
2026-03-28 22:01:32 [bca.uk] INFO: Scrape type for CE10%20VBJ: 2
2026-03-28 22:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38b4d9eb-4fd2-5ae8-9730-2b4c6e9f8e3e with identifier: CE10%20VBJ
2026-03-28 22:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38b4d9eb-4fd2-5ae8-9730-2b4c6e9f8e3e with scrape type 2
2026-03-28 22:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38b4d9eb-4fd2-5ae8-9730-2b4c6e9f8e3e with scrape type 2
2026-03-28 22:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 38b4d9eb-4fd2-5ae8-9730-2b4c6e9f8e3e, identifier: CE10%20VBJ
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093849%27 HTTP/1.1" 200 None
2026-03-28 22:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093849 not downloaded yet
2026-03-28 22:01:32 [bca.uk] INFO: Found listing with ID: LX14%20YNM
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX14%2520YNM%27 HTTP/1.1" 200 None
2026-03-28 22:01:32 [bca.uk] INFO: Scrape type for LX14%20YNM: 2
2026-03-28 22:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcb438d4-a794-57c3-893d-53a7efa952ba with identifier: LX14%20YNM
2026-03-28 22:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcb438d4-a794-57c3-893d-53a7efa952ba with scrape type 2
2026-03-28 22:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcb438d4-a794-57c3-893d-53a7efa952ba with scrape type 2
2026-03-28 22:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dcb438d4-a794-57c3-893d-53a7efa952ba, identifier: LX14%20YNM
2026-03-28 22:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 38b4d9eb-4fd2-5ae8-9730-2b4c6e9f8e3e with identifier: CE10%20VBJ
2026-03-28 22:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 38b4d9eb-4fd2-5ae8-9730-2b4c6e9f8e3e with identifier: CE10%20VBJ
2026-03-28 22:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 38b4d9eb-4fd2-5ae8-9730-2b4c6e9f8e3e with identifier: CE10%20VBJ to the API
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 133,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CE10%20VBJ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '38b4d9eb-4fd2-5ae8-9730-2b4c6e9f8e3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CE10 VBJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CE10%20VBJ&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 112800,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.2 82 EDGE Hatchback',
'transmission': 'manual',
'trim': '82 EDGE',
'vin': 'WF0GXXGAJGAL62317',
'year': 2010}
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE10%2520VBJ%27 HTTP/1.1" 200 None
2026-03-28 22:01:33 [bca.uk] INFO: Saving data for CE10%20VBJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774447864.409656, 'last_price_update_time': 1774735293.255666}
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CE10%2520VBJ') HTTP/1.1" 204 0
2026-03-28 22:01:33 [bca.uk] INFO: Found listing with ID: WX18%20RKK
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX18%2520RKK%27 HTTP/1.1" 200 None
2026-03-28 22:01:33 [bca.uk] INFO: Scrape type for WX18%20RKK: 1
2026-03-28 22:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4ec4e6f-59e8-58bb-b6e7-08502c0644b2 with identifier: WX18%20RKK
2026-03-28 22:01:33 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a4ec4e6f-59e8-58bb-b6e7-08502c0644b2
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994240%27 HTTP/1.1" 200 None
2026-03-28 22:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994240 not downloaded yet
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031550%27 HTTP/1.1" 200 None
2026-03-28 22:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031550 not downloaded yet
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126568%27 HTTP/1.1" 200 None
2026-03-28 22:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126568 not downloaded yet
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110869%27 HTTP/1.1" 200 None
2026-03-28 22:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110869 not downloaded yet
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093876%27 HTTP/1.1" 200 None
2026-03-28 22:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093876 not downloaded yet
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110845%27 HTTP/1.1" 200 None
2026-03-28 22:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110845 not downloaded yet
2026-03-28 22:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dcb438d4-a794-57c3-893d-53a7efa952ba with identifier: LX14%20YNM
2026-03-28 22:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dcb438d4-a794-57c3-893d-53a7efa952ba with identifier: LX14%20YNM
2026-03-28 22:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dcb438d4-a794-57c3-893d-53a7efa952ba with identifier: LX14%20YNM to the API
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LX14%20YNM-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'dcb438d4-a794-57c3-893d-53a7efa952ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LX14 YNM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LX14%20YNM&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'KIA',
'model': 'VENGA',
'odometer': 137181,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'KIA VENGA 1.6 2 MPV',
'transmission': 'automatic',
'trim': '2',
'vin': 'U5YEH812MEL077162',
'year': 2014}
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX14%2520YNM%27 HTTP/1.1" 200 None
2026-03-28 22:01:33 [bca.uk] INFO: Saving data for LX14%20YNM: {'auction_closing_time': 1774864800.0, 'created_time': 1774621524.170357, 'last_price_update_time': 1774735293.728069}
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LX14%2520YNM') HTTP/1.1" 204 0
2026-03-28 22:01:33 [bca.uk] INFO: Found listing with ID: FE11%20RVF
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE11%2520RVF%27 HTTP/1.1" 200 None
2026-03-28 22:01:33 [bca.uk] INFO: Scrape type for FE11%20RVF: 2
2026-03-28 22:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f95195cb-7767-58a8-9d59-d1ff56b61526 with identifier: FE11%20RVF
2026-03-28 22:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f95195cb-7767-58a8-9d59-d1ff56b61526 with scrape type 2
2026-03-28 22:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f95195cb-7767-58a8-9d59-d1ff56b61526 with scrape type 2
2026-03-28 22:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f95195cb-7767-58a8-9d59-d1ff56b61526, identifier: FE11%20RVF
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093866%27 HTTP/1.1" 200 None
2026-03-28 22:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093866 not downloaded yet
2026-03-28 22:01:34 [bca.uk] INFO: Found listing with ID: OE05%20XXM
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE05%2520XXM%27 HTTP/1.1" 200 None
2026-03-28 22:01:34 [bca.uk] INFO: Scrape type for OE05%20XXM: 2
2026-03-28 22:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f812a82e-f47e-5956-9607-76fa69063190 with identifier: OE05%20XXM
2026-03-28 22:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f812a82e-f47e-5956-9607-76fa69063190 with scrape type 2
2026-03-28 22:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f812a82e-f47e-5956-9607-76fa69063190 with scrape type 2
2026-03-28 22:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f812a82e-f47e-5956-9607-76fa69063190, identifier: OE05%20XXM
2026-03-28 22:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f95195cb-7767-58a8-9d59-d1ff56b61526 with identifier: FE11%20RVF
2026-03-28 22:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f95195cb-7767-58a8-9d59-d1ff56b61526 with identifier: FE11%20RVF
2026-03-28 22:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f95195cb-7767-58a8-9d59-d1ff56b61526 with identifier: FE11%20RVF to the API
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FE11%20RVF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.7L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f95195cb-7767-58a8-9d59-d1ff56b61526',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FE11 RVF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FE11%20RVF&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'VAUXHALL',
'model': 'ZAFIRA',
'odometer': 118581,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'VAUXHALL ZAFIRA 1.7 CDTI 110 E/F EXCLUSIV MPV',
'transmission': 'manual',
'trim': 'CDTI 110 E/F EXCLUSIV',
'vin': 'W0L0AHM75B2079751',
'year': 2011}
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE11%2520RVF%27 HTTP/1.1" 200 None
2026-03-28 22:01:34 [bca.uk] INFO: Saving data for FE11%20RVF: {'auction_closing_time': 1774864800.0, 'created_time': 1774621437.345064, 'last_price_update_time': 1774735294.456305}
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FE11%2520RVF') HTTP/1.1" 204 0
2026-03-28 22:01:34 [bca.uk] INFO: Found listing with ID: RJ71%20WJK
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ71%2520WJK%27 HTTP/1.1" 200 None
2026-03-28 22:01:34 [bca.uk] INFO: Scrape type for RJ71%20WJK: 1
2026-03-28 22:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45e8e181-dc16-5b78-833d-28f874a8334d with identifier: RJ71%20WJK
2026-03-28 22:01:34 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 45e8e181-dc16-5b78-833d-28f874a8334d
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031575%27 HTTP/1.1" 200 None
2026-03-28 22:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031575 not downloaded yet
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126590%27 HTTP/1.1" 200 None
2026-03-28 22:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126590 not downloaded yet
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110886%27 HTTP/1.1" 200 None
2026-03-28 22:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110886 not downloaded yet
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093900%27 HTTP/1.1" 200 None
2026-03-28 22:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093900 not downloaded yet
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110857%27 HTTP/1.1" 200 None
2026-03-28 22:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110857 not downloaded yet
2026-03-28 22:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f812a82e-f47e-5956-9607-76fa69063190 with identifier: OE05%20XXM
2026-03-28 22:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f812a82e-f47e-5956-9607-76fa69063190 with identifier: OE05%20XXM
2026-03-28 22:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f812a82e-f47e-5956-9607-76fa69063190 with identifier: OE05%20XXM to the API
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 271,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OE05%20XXM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.7L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f812a82e-f47e-5956-9607-76fa69063190',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OE05 XXM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OE05%20XXM&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 147106,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 2.7 TDV6 HSE StationWagon',
'transmission': 'automatic',
'trim': 'TDV6 HSE',
'vin': 'SALLSAA135A912604',
'year': 2005}
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE05%2520XXM%27 HTTP/1.1" 200 None
2026-03-28 22:01:34 [bca.uk] INFO: Saving data for OE05%20XXM: {'auction_closing_time': 1774864800.0, 'created_time': 1774620766.769035, 'last_price_update_time': 1774735294.948944}
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OE05%2520XXM') HTTP/1.1" 204 0
2026-03-28 22:01:34 [bca.uk] INFO: Found listing with ID: FY59%20UVB
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY59%2520UVB%27 HTTP/1.1" 200 None
2026-03-28 22:01:34 [bca.uk] INFO: Scrape type for FY59%20UVB: 0
2026-03-28 22:01:34 [bca.uk] INFO: Found listing with ID: FY59%20ZGR
2026-03-28 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY59%2520ZGR%27 HTTP/1.1" 200 None
2026-03-28 22:01:35 [bca.uk] INFO: Scrape type for FY59%20ZGR: 2
2026-03-28 22:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 994ee2aa-d7d8-57e5-82bc-bebcf132587c with identifier: FY59%20ZGR
2026-03-28 22:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 994ee2aa-d7d8-57e5-82bc-bebcf132587c with scrape type 2
2026-03-28 22:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 994ee2aa-d7d8-57e5-82bc-bebcf132587c with scrape type 2
2026-03-28 22:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 994ee2aa-d7d8-57e5-82bc-bebcf132587c, identifier: FY59%20ZGR
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093882%27 HTTP/1.1" 200 None
2026-03-28 22:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093882 not downloaded yet
2026-03-28 22:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG16XLF/42811219?sv=2020-08-04&st=2026-03-28T22%3A01%3A19Z&se=2026-03-28T22%3A26%3A19Z&sr=b&sp=r&sig=piDa4JVgaWBzjvnw0OZ1irSwQFsxpWFyq8MJd75hPTs%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WU66XNV/42811422?sv=2020-08-04&st=2026-03-28T22%3A01%3A16Z&se=2026-03-28T22%3A26%3A16Z&sr=b&sp=r&sig=iEWCiRexucMVz979VRM55ID%2B0dAdHnqV0R4MKdIaGkA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:35 [bca.uk] INFO: Found listing with ID: ST10%20NZU
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST10%2520NZU%27 HTTP/1.1" 200 None
2026-03-28 22:01:35 [bca.uk] INFO: Scrape type for ST10%20NZU: 2
2026-03-28 22:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 834b87d2-3e20-56eb-bc6c-24893d9eeecb with identifier: ST10%20NZU
2026-03-28 22:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 834b87d2-3e20-56eb-bc6c-24893d9eeecb with scrape type 2
2026-03-28 22:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 834b87d2-3e20-56eb-bc6c-24893d9eeecb with scrape type 2
2026-03-28 22:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 834b87d2-3e20-56eb-bc6c-24893d9eeecb, identifier: ST10%20NZU
2026-03-28 22:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 994ee2aa-d7d8-57e5-82bc-bebcf132587c with identifier: FY59%20ZGR
2026-03-28 22:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 994ee2aa-d7d8-57e5-82bc-bebcf132587c with identifier: FY59%20ZGR
2026-03-28 22:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 994ee2aa-d7d8-57e5-82bc-bebcf132587c with identifier: FY59%20ZGR to the API
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 224,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FY59%20ZGR-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '994ee2aa-d7d8-57e5-82bc-bebcf132587c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FY59 ZGR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FY59%20ZGR&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'VOLVO',
'model': 'XC90',
'odometer': 131970,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VOLVO XC90 2.4 D5 185 SE LUX PREMIUM G/T Estate',
'transmission': 'manual',
'trim': 'D5 185 SE LUX PREMIUM G/T',
'vin': 'YV1CZ7146A1544030',
'year': 2009}
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY59%2520ZGR%27 HTTP/1.1" 200 None
2026-03-28 22:01:35 [bca.uk] INFO: Saving data for FY59%20ZGR: {'auction_closing_time': 1774864800.0, 'created_time': 1774621431.194581, 'last_price_update_time': 1774735295.565253}
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FY59%2520ZGR') HTTP/1.1" 204 0
2026-03-28 22:01:35 [bca.uk] INFO: Found listing with ID: WN70%20GXV
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN70%2520GXV%27 HTTP/1.1" 200 None
2026-03-28 22:01:35 [bca.uk] INFO: Scrape type for WN70%20GXV: 1
2026-03-28 22:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e568b76a-20a9-5c16-99a7-ea60aeecf1e0 with identifier: WN70%20GXV
2026-03-28 22:01:35 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e568b76a-20a9-5c16-99a7-ea60aeecf1e0
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110904%27 HTTP/1.1" 200 None
2026-03-28 22:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110904 not downloaded yet
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093929%27 HTTP/1.1" 200 None
2026-03-28 22:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093929 not downloaded yet
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110875%27 HTTP/1.1" 200 None
2026-03-28 22:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110875 not downloaded yet
2026-03-28 22:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 834b87d2-3e20-56eb-bc6c-24893d9eeecb with identifier: ST10%20NZU
2026-03-28 22:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 834b87d2-3e20-56eb-bc6c-24893d9eeecb with identifier: ST10%20NZU
2026-03-28 22:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 834b87d2-3e20-56eb-bc6c-24893d9eeecb with identifier: ST10%20NZU to the API
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ST10%20NZU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '834b87d2-3e20-56eb-bc6c-24893d9eeecb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ST10 NZU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ST10%20NZU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'KUGA',
'odometer': 169276,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 TDCI 2WD TITANIUM StationWagon',
'transmission': 'manual',
'trim': 'TDCI 2WD TITANIUM',
'vin': 'WF0RXXGCDRAT55060',
'year': 2010}
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST10%2520NZU%27 HTTP/1.1" 200 None
2026-03-28 22:01:35 [bca.uk] INFO: Saving data for ST10%20NZU: {'auction_closing_time': 1774864800.0, 'created_time': 1774621524.986112, 'last_price_update_time': 1774735295.938122}
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ST10%2520NZU') HTTP/1.1" 204 0
2026-03-28 22:01:35 [bca.uk] INFO: Found listing with ID: KU58%20EZM
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU58%2520EZM%27 HTTP/1.1" 200 None
2026-03-28 22:01:35 [bca.uk] INFO: Scrape type for KU58%20EZM: 0
2026-03-28 22:01:35 [bca.uk] INFO: Found listing with ID: NU15%20KYB
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU15%2520KYB%27 HTTP/1.1" 200 None
2026-03-28 22:01:35 [bca.uk] INFO: Scrape type for NU15%20KYB: 2
2026-03-28 22:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 369089c8-ce8b-5bd9-8bd3-48bf4792158c with identifier: NU15%20KYB
2026-03-28 22:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 369089c8-ce8b-5bd9-8bd3-48bf4792158c with scrape type 2
2026-03-28 22:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 369089c8-ce8b-5bd9-8bd3-48bf4792158c with scrape type 2
2026-03-28 22:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 369089c8-ce8b-5bd9-8bd3-48bf4792158c, identifier: NU15%20KYB
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093905%27 HTTP/1.1" 200 None
2026-03-28 22:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093905 not downloaded yet
2026-03-28 22:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP11OHH/42810859?sv=2020-08-04&st=2026-03-28T22%3A01%3A17Z&se=2026-03-28T22%3A26%3A17Z&sr=b&sp=r&sig=b7CgL1od%2BxWYmvFyCkZBnwP%2Fc8hvRbuQDmBfA%2FtGEC4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:36 [bca.uk] INFO: Found listing with ID: PL70%20OLP
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PL70%2520OLP%27 HTTP/1.1" 200 None
2026-03-28 22:01:36 [bca.uk] INFO: Scrape type for PL70%20OLP: 1
2026-03-28 22:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f7b21e0-59a7-5686-a122-ac8b5ae9229a with identifier: PL70%20OLP
2026-03-28 22:01:36 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3f7b21e0-59a7-5686-a122-ac8b5ae9229a
2026-03-28 22:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 369089c8-ce8b-5bd9-8bd3-48bf4792158c with identifier: NU15%20KYB
2026-03-28 22:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 369089c8-ce8b-5bd9-8bd3-48bf4792158c with identifier: NU15%20KYB
2026-03-28 22:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 369089c8-ce8b-5bd9-8bd3-48bf4792158c with identifier: NU15%20KYB to the API
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NU15%20KYB-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '369089c8-ce8b-5bd9-8bd3-48bf4792158c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NU15 KYB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NU15%20KYB&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 58116,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'NISSAN MICRA 1.2 ACENTA Hatchback',
'transmission': 'manual',
'trim': 'ACENTA',
'vin': 'MDHFBUK13U0800409',
'year': 2015}
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU15%2520KYB%27 HTTP/1.1" 200 None
2026-03-28 22:01:36 [bca.uk] INFO: Saving data for NU15%20KYB: {'auction_closing_time': 1774864800.0, 'created_time': 1774620769.323915, 'last_price_update_time': 1774735296.473671}
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NU15%2520KYB') HTTP/1.1" 204 0
2026-03-28 22:01:36 [bca.uk] INFO: Found listing with ID: AV09%20XGM
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV09%2520XGM%27 HTTP/1.1" 200 None
2026-03-28 22:01:36 [bca.uk] INFO: Scrape type for AV09%20XGM: 1
2026-03-28 22:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c42f4349-1b81-5dc4-a105-671ff23a08dd with identifier: AV09%20XGM
2026-03-28 22:01:36 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c42f4349-1b81-5dc4-a105-671ff23a08dd
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093945%27 HTTP/1.1" 200 None
2026-03-28 22:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093945 not downloaded yet
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110891%27 HTTP/1.1" 200 None
2026-03-28 22:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110891 not downloaded yet
2026-03-28 22:01:36 [bca.uk] INFO: Found listing with ID: SD62%20CKY
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD62%2520CKY%27 HTTP/1.1" 200 None
2026-03-28 22:01:36 [bca.uk] INFO: Scrape type for SD62%20CKY: 2
2026-03-28 22:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76787fe3-4391-5024-a08c-71c8eb6f7576 with identifier: SD62%20CKY
2026-03-28 22:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76787fe3-4391-5024-a08c-71c8eb6f7576 with scrape type 2
2026-03-28 22:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76787fe3-4391-5024-a08c-71c8eb6f7576 with scrape type 2
2026-03-28 22:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 76787fe3-4391-5024-a08c-71c8eb6f7576, identifier: SD62%20CKY
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093934%27 HTTP/1.1" 200 None
2026-03-28 22:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093934 not downloaded yet
2026-03-28 22:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547224ad0>
2026-03-28 22:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1/87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1_expert_report_file_1b58908a-a574-424f-9c4f-9d473d3d235b.pdf HTTP/1.1" 201 0
2026-03-28 22:01:36 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1
2026-03-28 22:01:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1, skipping ID generation
2026-03-28 22:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBG16XLF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BG16XLF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547e0510>
2026-03-28 22:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51da0f1d-592f-5dda-b1f6-cadeb5cfb790/51da0f1d-592f-5dda-b1f6-cadeb5cfb790_expert_report_file_6e24f79b-711e-40ea-be00-34bfc25c4574.pdf HTTP/1.1" 201 0
2026-03-28 22:01:36 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 51da0f1d-592f-5dda-b1f6-cadeb5cfb790
2026-03-28 22:01:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51da0f1d-592f-5dda-b1f6-cadeb5cfb790, skipping ID generation
2026-03-28 22:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 51da0f1d-592f-5dda-b1f6-cadeb5cfb790
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWU66XNV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WU66XNV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110816/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110816>
2026-03-28 22:01:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093820/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093820>
2026-03-28 22:01:36 [bca.uk] INFO: Found listing with ID: EP18%20LGJ
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EP18%2520LGJ%27 HTTP/1.1" 200 None
2026-03-28 22:01:36 [bca.uk] INFO: Scrape type for EP18%20LGJ: 0
2026-03-28 22:01:36 [bca.uk] INFO: Found listing with ID: GK68%20YWC
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK68%2520YWC%27 HTTP/1.1" 200 None
2026-03-28 22:01:36 [bca.uk] INFO: Scrape type for GK68%20YWC: 2
2026-03-28 22:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d139f5a-bacb-53a3-8c07-3e1ff555cc1c with identifier: GK68%20YWC
2026-03-28 22:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d139f5a-bacb-53a3-8c07-3e1ff555cc1c with scrape type 2
2026-03-28 22:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d139f5a-bacb-53a3-8c07-3e1ff555cc1c with scrape type 2
2026-03-28 22:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0d139f5a-bacb-53a3-8c07-3e1ff555cc1c, identifier: GK68%20YWC
2026-03-28 22:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 76787fe3-4391-5024-a08c-71c8eb6f7576 with identifier: SD62%20CKY
2026-03-28 22:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 76787fe3-4391-5024-a08c-71c8eb6f7576 with identifier: SD62%20CKY
2026-03-28 22:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 76787fe3-4391-5024-a08c-71c8eb6f7576 with identifier: SD62%20CKY to the API
2026-03-28 22:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SD62%20CKY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '76787fe3-4391-5024-a08c-71c8eb6f7576',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SD62 CKY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SD62%20CKY&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 106616,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.6 16V 115 ACTIVE Hatchback',
'transmission': 'manual',
'trim': '16V 115 ACTIVE',
'vin': 'W0LPC6ED7CG131716',
'year': 2012}
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD62%2520CKY%27 HTTP/1.1" 200 None
2026-03-28 22:01:37 [bca.uk] INFO: Saving data for SD62%20CKY: {'auction_closing_time': 1774864800.0, 'created_time': 1774621444.460149, 'last_price_update_time': 1774735297.224072}
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SD62%2520CKY') HTTP/1.1" 204 0
2026-03-28 22:01:37 [bca.uk] INFO: Found listing with ID: KN12%20MPO
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN12%2520MPO%27 HTTP/1.1" 200 None
2026-03-28 22:01:37 [bca.uk] INFO: Scrape type for KN12%20MPO: 1
2026-03-28 22:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0cc7482-767b-567d-a58d-775f8d1bb696 with identifier: KN12%20MPO
2026-03-28 22:01:37 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e0cc7482-767b-567d-a58d-775f8d1bb696
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093983%27 HTTP/1.1" 200 None
2026-03-28 22:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093983 not downloaded yet
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110911%27 HTTP/1.1" 200 None
2026-03-28 22:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110911 not downloaded yet
2026-03-28 22:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093835/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093835>
2026-03-28 22:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0d139f5a-bacb-53a3-8c07-3e1ff555cc1c with identifier: GK68%20YWC
2026-03-28 22:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0d139f5a-bacb-53a3-8c07-3e1ff555cc1c with identifier: GK68%20YWC
2026-03-28 22:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0d139f5a-bacb-53a3-8c07-3e1ff555cc1c with identifier: GK68%20YWC to the API
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 105,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GK68%20YWC-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0d139f5a-bacb-53a3-8c07-3e1ff555cc1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GK68 YWC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GK68%20YWC&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 81621,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'PEUGEOT 3008 1.5 BLUEHDI 130 GT LINE PREM.EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'BLUEHDI 130 GT LINE PREM.EAT8',
'vin': 'VF3MCYHZRJS473475',
'year': 2018}
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK68%2520YWC%27 HTTP/1.1" 200 None
2026-03-28 22:01:37 [bca.uk] INFO: Saving data for GK68%20YWC: {'auction_closing_time': 1774864800.0, 'created_time': 1774621469.279467, 'last_price_update_time': 1774735297.741631}
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GK68%2520YWC') HTTP/1.1" 204 0
2026-03-28 22:01:37 [bca.uk] INFO: Found listing with ID: SG14%20FMC
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG14%2520FMC%27 HTTP/1.1" 200 None
2026-03-28 22:01:37 [bca.uk] INFO: Scrape type for SG14%20FMC: 0
2026-03-28 22:01:37 [bca.uk] INFO: Found listing with ID: YC58%20WGE
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC58%2520WGE%27 HTTP/1.1" 200 None
2026-03-28 22:01:37 [bca.uk] INFO: Scrape type for YC58%20WGE: 2
2026-03-28 22:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36d656cb-ff36-5e8a-91e4-308d635ca004 with identifier: YC58%20WGE
2026-03-28 22:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36d656cb-ff36-5e8a-91e4-308d635ca004 with scrape type 2
2026-03-28 22:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36d656cb-ff36-5e8a-91e4-308d635ca004 with scrape type 2
2026-03-28 22:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 36d656cb-ff36-5e8a-91e4-308d635ca004, identifier: YC58%20WGE
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093969%27 HTTP/1.1" 200 None
2026-03-28 22:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093969 not downloaded yet
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699071260%27 HTTP/1.1" 200 None
2026-03-28 22:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071260 not downloaded yet
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142718%27 HTTP/1.1" 200 None
2026-03-28 22:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142718 not downloaded yet
2026-03-28 22:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557fdba10>
2026-03-28 22:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9153a9c4-5990-5981-85ad-c93a9119ac4b/9153a9c4-5990-5981-85ad-c93a9119ac4b_expert_report_file_1c80c08e-e4a1-4058-8529-00aa69bcc420.pdf HTTP/1.1" 201 0
2026-03-28 22:01:38 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9153a9c4-5990-5981-85ad-c93a9119ac4b
2026-03-28 22:01:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9153a9c4-5990-5981-85ad-c93a9119ac4b, skipping ID generation
2026-03-28 22:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9153a9c4-5990-5981-85ad-c93a9119ac4b
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFP11OHH-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FP11OHH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:38 [bca.uk] INFO: Found listing with ID: GN18%20FPD
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN18%2520FPD%27 HTTP/1.1" 200 None
2026-03-28 22:01:38 [bca.uk] INFO: Scrape type for GN18%20FPD: 0
2026-03-28 22:01:38 [bca.uk] INFO: Found listing with ID: RJ19%20XHK
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ19%2520XHK%27 HTTP/1.1" 200 None
2026-03-28 22:01:38 [bca.uk] INFO: Scrape type for RJ19%20XHK: 0
2026-03-28 22:01:38 [bca.uk] INFO: Found listing with ID: ML19%20YFV
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML19%2520YFV%27 HTTP/1.1" 200 None
2026-03-28 22:01:38 [bca.uk] INFO: Scrape type for ML19%20YFV: 1
2026-03-28 22:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82f1ca74-f3e3-557a-9800-72143e39903a with identifier: ML19%20YFV
2026-03-28 22:01:38 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 82f1ca74-f3e3-557a-9800-72143e39903a
2026-03-28 22:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 36d656cb-ff36-5e8a-91e4-308d635ca004 with identifier: YC58%20WGE
2026-03-28 22:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 36d656cb-ff36-5e8a-91e4-308d635ca004 with identifier: YC58%20WGE
2026-03-28 22:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 36d656cb-ff36-5e8a-91e4-308d635ca004 with identifier: YC58%20WGE to the API
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YC58%20WGE-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '36d656cb-ff36-5e8a-91e4-308d635ca004',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YC58 WGE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YC58%20WGE&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'HONDA',
'model': 'CIVIC',
'odometer': 124817,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'HONDA CIVIC 2.2 I-CTDI EX Hatchback',
'transmission': 'manual',
'trim': 'I-CTDI EX',
'vin': 'SHHFK37608U015471',
'year': 2008}
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC58%2520WGE%27 HTTP/1.1" 200 None
2026-03-28 22:01:38 [bca.uk] INFO: Saving data for YC58%20WGE: {'auction_closing_time': 1774864800.0, 'created_time': 1774621443.590912, 'last_price_update_time': 1774735298.412364}
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YC58%2520WGE') HTTP/1.1" 204 0
2026-03-28 22:01:38 [bca.uk] INFO: Found listing with ID: WJ10%20DVF
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ10%2520DVF%27 HTTP/1.1" 200 None
2026-03-28 22:01:38 [bca.uk] INFO: Scrape type for WJ10%20DVF: 1
2026-03-28 22:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b5e0f49-0b91-505b-88af-460f766781c7 with identifier: WJ10%20DVF
2026-03-28 22:01:38 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1b5e0f49-0b91-505b-88af-460f766781c7
2026-03-28 22:01:38 [bca.uk] INFO: Found listing with ID: YH11%20WZW
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH11%2520WZW%27 HTTP/1.1" 200 None
2026-03-28 22:01:38 [bca.uk] INFO: Scrape type for YH11%20WZW: 0
2026-03-28 22:01:38 [bca.uk] INFO: Found listing with ID: YP12%20HGG
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP12%2520HGG%27 HTTP/1.1" 200 None
2026-03-28 22:01:38 [bca.uk] INFO: Scrape type for YP12%20HGG: 0
2026-03-28 22:01:38 [bca.uk] INFO: Found listing with ID: YR60%20FLD
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR60%2520FLD%27 HTTP/1.1" 200 None
2026-03-28 22:01:38 [bca.uk] INFO: Scrape type for YR60%20FLD: 0
2026-03-28 22:01:38 [bca.uk] INFO: Found listing with ID: YX10%20UNJ
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX10%2520UNJ%27 HTTP/1.1" 200 None
2026-03-28 22:01:38 [bca.uk] INFO: Scrape type for YX10%20UNJ: 0
2026-03-28 22:01:38 [bca.uk] INFO: Found listing with ID: EN64%20OCP
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN64%2520OCP%27 HTTP/1.1" 200 None
2026-03-28 22:01:38 [bca.uk] INFO: Scrape type for EN64%20OCP: 2
2026-03-28 22:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f0b4346-8a5d-5d78-8080-a2a59518ad3b with identifier: EN64%20OCP
2026-03-28 22:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f0b4346-8a5d-5d78-8080-a2a59518ad3b with scrape type 2
2026-03-28 22:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f0b4346-8a5d-5d78-8080-a2a59518ad3b with scrape type 2
2026-03-28 22:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7f0b4346-8a5d-5d78-8080-a2a59518ad3b, identifier: EN64%20OCP
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093999%27 HTTP/1.1" 200 None
2026-03-28 22:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093999 not downloaded yet
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699071266%27 HTTP/1.1" 200 None
2026-03-28 22:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071266 not downloaded yet
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126431%27 HTTP/1.1" 200 None
2026-03-28 22:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126431 not downloaded yet
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994077%27 HTTP/1.1" 200 None
2026-03-28 22:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994077 not downloaded yet
2026-03-28 22:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966001/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VA62BTY/42810684?sv=2020-08-04&st=2026-03-28T22%3A01%3A03Z&se=2026-03-28T22%3A26%3A03Z&sr=b&sp=r&sig=N35MQzuEGC1T9OsmIXtmUT3IIUk5%2F7R2XsmdyzT4d0M%3D)
2026-03-28 22:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285748/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV69BJO/42810768?sv=2020-08-04&st=2026-03-28T22%3A01%3A08Z&se=2026-03-28T22%3A26%3A08Z&sr=b&sp=r&sig=RhBgWIDbmwF%2F8XqW9pjzomUmOVaJM8ThWq2ap8w7j1M%3D)
2026-03-28 22:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698965988/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VA62BTY/42810684?sv=2020-08-04&st=2026-03-28T22%3A01%3A03Z&se=2026-03-28T22%3A26%3A03Z&sr=b&sp=r&sig=N35MQzuEGC1T9OsmIXtmUT3IIUk5%2F7R2XsmdyzT4d0M%3D)
2026-03-28 22:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698965995/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VA62BTY/42810684?sv=2020-08-04&st=2026-03-28T22%3A01%3A03Z&se=2026-03-28T22%3A26%3A03Z&sr=b&sp=r&sig=N35MQzuEGC1T9OsmIXtmUT3IIUk5%2F7R2XsmdyzT4d0M%3D)
2026-03-28 22:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698980998/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND62EWM/42810799?sv=2020-08-04&st=2026-03-28T22%3A01%3A06Z&se=2026-03-28T22%3A26%3A06Z&sr=b&sp=r&sig=KD3C6SJzwrdEgIjlL7QRYHJfSgh8rbJ%2FPC%2F%2BEfVah7k%3D)
2026-03-28 22:01:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126505/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126505>
2026-03-28 22:01:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031464/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031464>
2026-03-28 22:01:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110824/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110824>
2026-03-28 22:01:38 [bca.uk] INFO: Found listing with ID: AE20%20NXF
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE20%2520NXF%27 HTTP/1.1" 200 None
2026-03-28 22:01:38 [bca.uk] INFO: Scrape type for AE20%20NXF: 1
2026-03-28 22:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40869bfc-8bb4-569d-b730-83efe1f5fcf1 with identifier: AE20%20NXF
2026-03-28 22:01:38 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 40869bfc-8bb4-569d-b730-83efe1f5fcf1
2026-03-28 22:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7f0b4346-8a5d-5d78-8080-a2a59518ad3b with identifier: EN64%20OCP
2026-03-28 22:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7f0b4346-8a5d-5d78-8080-a2a59518ad3b with identifier: EN64%20OCP
2026-03-28 22:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7f0b4346-8a5d-5d78-8080-a2a59518ad3b with identifier: EN64%20OCP to the API
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EN64%20OCP-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7f0b4346-8a5d-5d78-8080-a2a59518ad3b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EN64 OCP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EN64%20OCP&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'HYUNDAI',
'model': 'I30',
'odometer': 80133,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'HYUNDAI I30 1.4 ACTIVE Hatchback',
'transmission': 'manual',
'trim': 'ACTIVE',
'vin': 'TMAD251ALEJ233087',
'year': 2015}
2026-03-28 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN64%2520OCP%27 HTTP/1.1" 200 None
2026-03-28 22:01:39 [bca.uk] INFO: Saving data for EN64%20OCP: {'auction_closing_time': 1774864800.0, 'created_time': 1774621392.272524, 'last_price_update_time': 1774735299.104272}
2026-03-28 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EN64%2520OCP') HTTP/1.1" 204 0
2026-03-28 22:01:39 [bca.uk] INFO: Found listing with ID: YG19%20DRZ
2026-03-28 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG19%2520DRZ%27 HTTP/1.1" 200 None
2026-03-28 22:01:39 [bca.uk] INFO: Scrape type for YG19%20DRZ: 1
2026-03-28 22:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e897ee42-3f14-5f4f-8d1c-2a827ef07283 with identifier: YG19%20DRZ
2026-03-28 22:01:39 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e897ee42-3f14-5f4f-8d1c-2a827ef07283
2026-03-28 22:01:39 [bca.uk] INFO: Found listing with ID: LC11%20ZGK
2026-03-28 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC11%2520ZGK%27 HTTP/1.1" 200 None
2026-03-28 22:01:39 [bca.uk] INFO: Scrape type for LC11%20ZGK: 2
2026-03-28 22:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfcd0d49-94d4-593f-90f6-ffbf103060af with identifier: LC11%20ZGK
2026-03-28 22:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfcd0d49-94d4-593f-90f6-ffbf103060af with scrape type 2
2026-03-28 22:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfcd0d49-94d4-593f-90f6-ffbf103060af with scrape type 2
2026-03-28 22:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bfcd0d49-94d4-593f-90f6-ffbf103060af, identifier: LC11%20ZGK
2026-03-28 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699071274%27 HTTP/1.1" 200 None
2026-03-28 22:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071274 not downloaded yet
2026-03-28 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142731%27 HTTP/1.1" 200 None
2026-03-28 22:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142731 not downloaded yet
2026-03-28 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994101%27 HTTP/1.1" 200 None
2026-03-28 22:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994101 not downloaded yet
2026-03-28 22:01:39 [bca.uk] INFO: Found listing with ID: GJ21%20YWB
2026-03-28 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ21%2520YWB%27 HTTP/1.1" 200 None
2026-03-28 22:01:39 [bca.uk] INFO: Scrape type for GJ21%20YWB: 1
2026-03-28 22:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02c9a210-8239-5652-942c-af89b324b768 with identifier: GJ21%20YWB
2026-03-28 22:01:39 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 02c9a210-8239-5652-942c-af89b324b768
2026-03-28 22:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bfcd0d49-94d4-593f-90f6-ffbf103060af with identifier: LC11%20ZGK
2026-03-28 22:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bfcd0d49-94d4-593f-90f6-ffbf103060af with identifier: LC11%20ZGK
2026-03-28 22:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bfcd0d49-94d4-593f-90f6-ffbf103060af with identifier: LC11%20ZGK to the API
2026-03-28 22:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LC11%20ZGK-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bfcd0d49-94d4-593f-90f6-ffbf103060af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LC11 ZGK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LC11%20ZGK&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'KIA',
'model': 'RIO',
'odometer': 59715,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'KIA RIO 1.4 2 Hatchback',
'transmission': 'manual',
'trim': '2',
'vin': 'KNADH511LB6805252',
'year': 2011}
2026-03-28 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC11%2520ZGK%27 HTTP/1.1" 200 None
2026-03-28 22:01:39 [bca.uk] INFO: Saving data for LC11%20ZGK: {'auction_closing_time': 1774864800.0, 'created_time': 1773933032.204483, 'last_price_update_time': 1774735299.798632}
2026-03-28 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LC11%2520ZGK') HTTP/1.1" 204 0
2026-03-28 22:01:39 [bca.uk] INFO: Found listing with ID: X575%20MKR
2026-03-28 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X575%2520MKR%27 HTTP/1.1" 200 None
2026-03-28 22:01:39 [bca.uk] INFO: Scrape type for X575%20MKR: 1
2026-03-28 22:01:39 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-28 22:01:39 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-28 22:01:40 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-28 22:01:40 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-28 22:01:40 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-28 22:01:40 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-28 22:01:40 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-28 22:01:40 [scrapy.core.scraper] ERROR: Spider error processing <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search)
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
yield await it.__anext__()
^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
return await self.data.__anext__()
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
async for o in as_async_generator(it):
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
async for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
return await self.data.__anext__()
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
async for o in as_async_generator(it):
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
async for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
async for item_or_request in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-28 22:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093835/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP15GZB/42811287?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=7tUa0hwrEujFHU3KRxrEE1EA%2FQ%2B2aDgCCCKK2Q5cFLc%3D)
2026-03-28 22:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110816/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ73EOT/42811363?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=Z275yW1rsbj3FapfEeIfN9OJqcCvXddViu6M84JP7AA%3D)
2026-03-28 22:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093820/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VX52YYH/42811323?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=sBcdU%2Bi00fGyPAIkGghzLoIMWb9WJk%2B0Sty%2BOKRiKzA%3D)
2026-03-28 22:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126527/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126527>
2026-03-28 22:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994176/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994176>
2026-03-28 22:01:40 [bca.uk] INFO: Found listing with ID: LX58%20WKD
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX58%2520WKD%27 HTTP/1.1" 200 None
2026-03-28 22:01:40 [bca.uk] INFO: Scrape type for LX58%20WKD: 0
2026-03-28 22:01:40 [bca.uk] INFO: Found listing with ID: SJ58%20VYU
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ58%2520VYU%27 HTTP/1.1" 200 None
2026-03-28 22:01:40 [bca.uk] INFO: Scrape type for SJ58%20VYU: 0
2026-03-28 22:01:40 [bca.uk] INFO: Found listing with ID: YK12%20LUP
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK12%2520LUP%27 HTTP/1.1" 200 None
2026-03-28 22:01:40 [bca.uk] INFO: Scrape type for YK12%20LUP: 1
2026-03-28 22:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 927dcf7c-8068-5099-8312-bf23933749d3 with identifier: YK12%20LUP
2026-03-28 22:01:40 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 927dcf7c-8068-5099-8312-bf23933749d3
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699071282%27 HTTP/1.1" 200 None
2026-03-28 22:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071282 not downloaded yet
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126457%27 HTTP/1.1" 200 None
2026-03-28 22:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126457 not downloaded yet
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994117%27 HTTP/1.1" 200 None
2026-03-28 22:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994117 not downloaded yet
2026-03-28 22:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547285850>
2026-03-28 22:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44fab252-6185-51e4-87e9-3f4c2a42edd8/44fab252-6185-51e4-87e9-3f4c2a42edd8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVA62BTY%252F698966001%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966001/600 saved to cache
2026-03-28 22:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 44fab252-6185-51e4-87e9-3f4c2a42edd8
2026-03-28 22:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547ec450>
2026-03-28 22:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbce9e71-f6f9-5b70-87a1-2cf7e0368db6/fbce9e71-f6f9-5b70-87a1-2cf7e0368db6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV69BJO%252F699285748%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285748/600 saved to cache
2026-03-28 22:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fbce9e71-f6f9-5b70-87a1-2cf7e0368db6
2026-03-28 22:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472b0250>
2026-03-28 22:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44fab252-6185-51e4-87e9-3f4c2a42edd8/44fab252-6185-51e4-87e9-3f4c2a42edd8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVA62BTY%252F698965988%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698965988/600 saved to cache
2026-03-28 22:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44fab252-6185-51e4-87e9-3f4c2a42edd8
2026-03-28 22:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547238450>
2026-03-28 22:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44fab252-6185-51e4-87e9-3f4c2a42edd8/44fab252-6185-51e4-87e9-3f4c2a42edd8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVA62BTY%252F698965995%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698965995/600 saved to cache
2026-03-28 22:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 44fab252-6185-51e4-87e9-3f4c2a42edd8
2026-03-28 22:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54748e7d0>
2026-03-28 22:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc2a305-976b-5d20-86ca-43ed711c23db/1fc2a305-976b-5d20-86ca-43ed711c23db_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND62EWM%252F698980998%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698980998/600 saved to cache
2026-03-28 22:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1fc2a305-976b-5d20-86ca-43ed711c23db
2026-03-28 22:01:40 [bca.uk] INFO: Found listing with ID: RO22%20KPT
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO22%2520KPT%27 HTTP/1.1" 200 None
2026-03-28 22:01:40 [bca.uk] INFO: Scrape type for RO22%20KPT: 1
2026-03-28 22:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7f8a9fc-307f-5fd9-9f57-53be64230a5a with identifier: RO22%20KPT
2026-03-28 22:01:40 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a7f8a9fc-307f-5fd9-9f57-53be64230a5a
2026-03-28 22:01:40 [bca.uk] INFO: Found listing with ID: HJ15%20MKL
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ15%2520MKL%27 HTTP/1.1" 200 None
2026-03-28 22:01:40 [bca.uk] INFO: Scrape type for HJ15%20MKL: 0
2026-03-28 22:01:40 [bca.uk] INFO: Found listing with ID: BG13%20FKD
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG13%2520FKD%27 HTTP/1.1" 200 None
2026-03-28 22:01:40 [bca.uk] INFO: Scrape type for BG13%20FKD: 1
2026-03-28 22:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43f7303a-a2f6-5f86-b81e-26af26f2b888 with identifier: BG13%20FKD
2026-03-28 22:01:40 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 43f7303a-a2f6-5f86-b81e-26af26f2b888
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699071288%27 HTTP/1.1" 200 None
2026-03-28 22:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071288 not downloaded yet
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142741%27 HTTP/1.1" 200 None
2026-03-28 22:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142741 not downloaded yet
2026-03-28 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994133%27 HTTP/1.1" 200 None
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994133 not downloaded yet
2026-03-28 22:01:41 [bca.uk] INFO: Found listing with ID: EU05%20FSN
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU05%2520FSN%27 HTTP/1.1" 200 None
2026-03-28 22:01:41 [bca.uk] INFO: Scrape type for EU05%20FSN: 1
2026-03-28 22:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60dbac76-bcbf-5733-bcb6-c737b1fd8a76 with identifier: EU05%20FSN
2026-03-28 22:01:41 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 60dbac76-bcbf-5733-bcb6-c737b1fd8a76
2026-03-28 22:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547131210>
2026-03-28 22:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283b6c92-cce2-544a-9b3b-da049a06ca33/283b6c92-cce2-544a-9b3b-da049a06ca33_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP15GZB%252F699093835%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093835/600 saved to cache
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 283b6c92-cce2-544a-9b3b-da049a06ca33
2026-03-28 22:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477a7ed0>
2026-03-28 22:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2f45d0-e564-5ded-8cb4-0288835f055c/ab2f45d0-e564-5ded-8cb4-0288835f055c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ73EOT%252F699110816%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110816/600 saved to cache
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab2f45d0-e564-5ded-8cb4-0288835f055c
2026-03-28 22:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474a9dd0>
2026-03-28 22:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d9ff90-12a7-5f3d-86ac-c640dc2351b5/08d9ff90-12a7-5f3d-86ac-c640dc2351b5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVX52YYH%252F699093820%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093820/600 saved to cache
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08d9ff90-12a7-5f3d-86ac-c640dc2351b5
2026-03-28 22:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ10DVF/42811170?sv=2020-08-04&st=2026-03-28T22%3A01%3A40Z&se=2026-03-28T22%3A26%3A40Z&sr=b&sp=r&sig=BGXTJolY8Ge%2BXdix4Hh6nL18hqFDPxiPwsZ0%2B8UN9%2BA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ10%20DVF-GB>
2026-03-28 22:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML19YFV/42811247?sv=2020-08-04&st=2026-03-28T22%3A01%3A40Z&se=2026-03-28T22%3A26%3A40Z&sr=b&sp=r&sig=S%2FokmN6AyZAKnUf36DNP%2F9ORjut4q1lWqes9oRlwZxI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ML19%20YFV-GB>
2026-03-28 22:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110824/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ70EHU/42811341?sv=2020-08-04&st=2026-03-28T22%3A01%3A12Z&se=2026-03-28T22%3A26%3A12Z&sr=b&sp=r&sig=jIMEwQ1nhHjk3xUWtYxp4DaMU%2Fd7rUcdJRYrXhJEbps%3D)
2026-03-28 22:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126505/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT19CVS/42811387?sv=2020-08-04&st=2026-03-28T22%3A01%3A08Z&se=2026-03-28T22%3A26%3A08Z&sr=b&sp=r&sig=Xezo2YoS0t9x6abxzIwcxCNA1wXAbFztVA4zM%2F%2Bntk8%3D)
2026-03-28 22:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031464/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ68UWN/42811039?sv=2020-08-04&st=2026-03-28T22%3A01%3A10Z&se=2026-03-28T22%3A26%3A10Z&sr=b&sp=r&sig=1ZiFBHKVUwguyFOSNXk0RG8MN%2BDlXzRukHPnqyWqOFk%3D)
2026-03-28 22:01:41 [bca.uk] INFO: Found listing with ID: DY13%20XDF
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY13%2520XDF%27 HTTP/1.1" 200 None
2026-03-28 22:01:41 [bca.uk] INFO: Scrape type for DY13%20XDF: 1
2026-03-28 22:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c155e91-825b-5797-9727-36735366f7f9 with identifier: DY13%20XDF
2026-03-28 22:01:41 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6c155e91-825b-5797-9727-36735366f7f9
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699071302%27 HTTP/1.1" 200 None
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071302 not downloaded yet
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126482%27 HTTP/1.1" 200 None
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126482 not downloaded yet
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994149%27 HTTP/1.1" 200 None
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994149 not downloaded yet
2026-03-28 22:01:41 [bca.uk] INFO: Found listing with ID: AF13%20XPW
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF13%2520XPW%27 HTTP/1.1" 200 None
2026-03-28 22:01:41 [bca.uk] INFO: Scrape type for AF13%20XPW: 1
2026-03-28 22:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c23f5d21-755d-59bb-a7da-864dc76d3107 with identifier: AF13%20XPW
2026-03-28 22:01:41 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c23f5d21-755d-59bb-a7da-864dc76d3107
2026-03-28 22:01:41 [bca.uk] INFO: Found listing with ID: SP59%20FDN
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP59%2520FDN%27 HTTP/1.1" 200 None
2026-03-28 22:01:41 [bca.uk] INFO: Scrape type for SP59%20FDN: 1
2026-03-28 22:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3459172-6804-5615-b390-f6fc4febd79c with identifier: SP59%20FDN
2026-03-28 22:01:41 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f3459172-6804-5615-b390-f6fc4febd79c
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699071320%27 HTTP/1.1" 200 None
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071320 not downloaded yet
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142749%27 HTTP/1.1" 200 None
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142749 not downloaded yet
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994170%27 HTTP/1.1" 200 None
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994170 not downloaded yet
2026-03-28 22:01:41 [bca.uk] INFO: Found listing with ID: LD64%20FZX
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD64%2520FZX%27 HTTP/1.1" 200 None
2026-03-28 22:01:41 [bca.uk] INFO: Scrape type for LD64%20FZX: 1
2026-03-28 22:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 534d9bbb-c0a6-50f4-bc13-9009bdc08d59 with identifier: LD64%20FZX
2026-03-28 22:01:41 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 534d9bbb-c0a6-50f4-bc13-9009bdc08d59
2026-03-28 22:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071260/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071260>
2026-03-28 22:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142718/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142718>
2026-03-28 22:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994067/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FP11OHH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110857/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110857>
2026-03-28 22:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110875/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110875>
2026-03-28 22:01:41 [bca.uk] INFO: Found listing with ID: HS19%20GYN
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HS19%2520GYN%27 HTTP/1.1" 200 None
2026-03-28 22:01:41 [bca.uk] INFO: Scrape type for HS19%20GYN: 1
2026-03-28 22:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 546eaaae-2d78-532a-abb1-eac4aea0023f with identifier: HS19%20GYN
2026-03-28 22:01:41 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 546eaaae-2d78-532a-abb1-eac4aea0023f
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699071336%27 HTTP/1.1" 200 None
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071336 not downloaded yet
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126499%27 HTTP/1.1" 200 None
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126499 not downloaded yet
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994197%27 HTTP/1.1" 200 None
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994197 not downloaded yet
2026-03-28 22:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe564c1c290>
2026-03-28 22:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf35b337-845e-537f-a976-08188cca66f3/cf35b337-845e-537f-a976-08188cca66f3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ70EHU%252F699110824%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110824/600 saved to cache
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf35b337-845e-537f-a976-08188cca66f3
2026-03-28 22:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542eb410>
2026-03-28 22:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b3f5c4-70ca-530a-a56a-701b7ee98ebe/d2b3f5c4-70ca-530a-a56a-701b7ee98ebe_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT19CVS%252F699126505%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126505/600 saved to cache
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2b3f5c4-70ca-530a-a56a-701b7ee98ebe
2026-03-28 22:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093882/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093882>
2026-03-28 22:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126527/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT70TDO/42811400?sv=2020-08-04&st=2026-03-28T22%3A01%3A09Z&se=2026-03-28T22%3A26%3A09Z&sr=b&sp=r&sig=sz4G2m%2Bww1tbH3aSNvJ2DJLyecaaL3NNq%2FlejxEYTpI%3D)
2026-03-28 22:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994176/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN63OLH/42810834?sv=2020-08-04&st=2026-03-28T22%3A01%3A09Z&se=2026-03-28T22%3A26%3A09Z&sr=b&sp=r&sig=NMpNDT8TSdoKfgfMWv1wobNIeXn3SgscjQpSI5aPQXk%3D)
2026-03-28 22:01:41 [bca.uk] INFO: Found listing with ID: YM63%20ETA
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM63%2520ETA%27 HTTP/1.1" 200 None
2026-03-28 22:01:41 [bca.uk] INFO: Scrape type for YM63%20ETA: 1
2026-03-28 22:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 595887ba-7187-5162-8a50-188caa6efdd9 with identifier: YM63%20ETA
2026-03-28 22:01:41 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 595887ba-7187-5162-8a50-188caa6efdd9
2026-03-28 22:01:41 [bca.uk] INFO: Found listing with ID: CA21%20OVG
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA21%2520OVG%27 HTTP/1.1" 200 None
2026-03-28 22:01:41 [bca.uk] INFO: Scrape type for CA21%20OVG: 1
2026-03-28 22:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87d1c14a-d5f3-5567-89ad-8d86774c1313 with identifier: CA21%20OVG
2026-03-28 22:01:41 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 87d1c14a-d5f3-5567-89ad-8d86774c1313
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699071352%27 HTTP/1.1" 200 None
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071352 not downloaded yet
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142764%27 HTTP/1.1" 200 None
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142764 not downloaded yet
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994225%27 HTTP/1.1" 200 None
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994225 not downloaded yet
2026-03-28 22:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547733cd0>
2026-03-28 22:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f05d113-747f-52ed-a1ad-9799bad35377/7f05d113-747f-52ed-a1ad-9799bad35377_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ68UWN%252F699031464%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031464/600 saved to cache
2026-03-28 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f05d113-747f-52ed-a1ad-9799bad35377
2026-03-28 22:01:41 [bca.uk] INFO: Found listing with ID: CA57%20YVV
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA57%2520YVV%27 HTTP/1.1" 200 None
2026-03-28 22:01:41 [bca.uk] INFO: Scrape type for CA57%20YVV: 1
2026-03-28 22:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02 with identifier: CA57%20YVV
2026-03-28 22:01:41 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02
2026-03-28 22:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994101/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994101>
2026-03-28 22:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142731/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142731>
2026-03-28 22:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071274/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071274>
2026-03-28 22:01:41 [bca.uk] INFO: Found listing with ID: CN69%20YVF
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN69%2520YVF%27 HTTP/1.1" 200 None
2026-03-28 22:01:41 [bca.uk] INFO: Scrape type for CN69%20YVF: 1
2026-03-28 22:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0d2c8c1-587d-52a8-bac1-4dade51bc1df with identifier: CN69%20YVF
2026-03-28 22:01:41 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b0d2c8c1-587d-52a8-bac1-4dade51bc1df
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994243%27 HTTP/1.1" 200 None
2026-03-28 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994243 not downloaded yet
2026-03-28 22:01:42 [bca.uk] INFO: Found listing with ID: EO59%20HAX
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO59%2520HAX%27 HTTP/1.1" 200 None
2026-03-28 22:01:42 [bca.uk] INFO: Scrape type for EO59%20HAX: 1
2026-03-28 22:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e935e7df-c51b-5719-9d53-d1e5a270ea84 with identifier: EO59%20HAX
2026-03-28 22:01:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e935e7df-c51b-5719-9d53-d1e5a270ea84
2026-03-28 22:01:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477ac6d0>
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d540cd8f-d715-5405-a8d5-11721b31b439/d540cd8f-d715-5405-a8d5-11721b31b439_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT70TDO%252F699126527%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126527/600 saved to cache
2026-03-28 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d540cd8f-d715-5405-a8d5-11721b31b439
2026-03-28 22:01:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477d1c90>
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39f18d5c-38c9-5802-bc90-29e03976b40f/39f18d5c-38c9-5802-bc90-29e03976b40f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN63OLH%252F698994176%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994176/600 saved to cache
2026-03-28 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 39f18d5c-38c9-5802-bc90-29e03976b40f
2026-03-28 22:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML19YFV/42811247?sv=2020-08-04&st=2026-03-28T22%3A01%3A40Z&se=2026-03-28T22%3A26%3A40Z&sr=b&sp=r&sig=S%2FokmN6AyZAKnUf36DNP%2F9ORjut4q1lWqes9oRlwZxI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EU05FSN/42811285?sv=2020-08-04&st=2026-03-28T22%3A01%3A41Z&se=2026-03-28T22%3A26%3A41Z&sr=b&sp=r&sig=1ukcy%2BJnSTkmgE1yrhOXAgwOA%2FmnfMjqBgubNMC0cpA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EU05%20FSN-GB>
2026-03-28 22:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994133/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994133>
2026-03-28 22:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142741/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142741>
2026-03-28 22:01:42 [bca.uk] INFO: Found listing with ID: DH74%20NTG
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DH74%2520NTG%27 HTTP/1.1" 200 None
2026-03-28 22:01:42 [bca.uk] INFO: Scrape type for DH74%20NTG: 1
2026-03-28 22:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0257875d-c974-59e6-9d6f-29ede1e17434 with identifier: DH74%20NTG
2026-03-28 22:01:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0257875d-c974-59e6-9d6f-29ede1e17434
2026-03-28 22:01:42 [bca.uk] INFO: Found listing with ID: GF52%20OWM
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF52%2520OWM%27 HTTP/1.1" 200 None
2026-03-28 22:01:42 [bca.uk] INFO: Scrape type for GF52%20OWM: 1
2026-03-28 22:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fe63328-a7f9-5445-857a-b37d1386e94b with identifier: GF52%20OWM
2026-03-28 22:01:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2fe63328-a7f9-5445-857a-b37d1386e94b
2026-03-28 22:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ10DVF/42811170?sv=2020-08-04&st=2026-03-28T22%3A01%3A40Z&se=2026-03-28T22%3A26%3A40Z&sr=b&sp=r&sig=BGXTJolY8Ge%2BXdix4Hh6nL18hqFDPxiPwsZ0%2B8UN9%2BA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:42 [bca.uk] INFO: Found listing with ID: FR19%20MWZ
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FR19%2520MWZ%27 HTTP/1.1" 200 None
2026-03-28 22:01:42 [bca.uk] INFO: Scrape type for FR19%20MWZ: 1
2026-03-28 22:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb with identifier: FR19%20MWZ
2026-03-28 22:01:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb
2026-03-28 22:01:42 [bca.uk] INFO: Found listing with ID: GV07%20WHR
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV07%2520WHR%27 HTTP/1.1" 200 None
2026-03-28 22:01:42 [bca.uk] INFO: Scrape type for GV07%20WHR: 1
2026-03-28 22:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec5f1ff9-26e6-53be-a244-e62a265b9a04 with identifier: GV07%20WHR
2026-03-28 22:01:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ec5f1ff9-26e6-53be-a244-e62a265b9a04
2026-03-28 22:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994067/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP11OHH/42810859?sv=2020-08-04&st=2026-03-28T22%3A01%3A17Z&se=2026-03-28T22%3A26%3A17Z&sr=b&sp=r&sig=b7CgL1od%2BxWYmvFyCkZBnwP%2Fc8hvRbuQDmBfA%2FtGEC4%3D)
2026-03-28 22:01:42 [bca.uk] INFO: Found listing with ID: MT71%20NEN
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT71%2520NEN%27 HTTP/1.1" 200 None
2026-03-28 22:01:42 [bca.uk] INFO: Scrape type for MT71%20NEN: 1
2026-03-28 22:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5421d270-4706-56d4-861e-d213204bb57b with identifier: MT71%20NEN
2026-03-28 22:01:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5421d270-4706-56d4-861e-d213204bb57b
2026-03-28 22:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110857/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ73EOT/42811363?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=Z275yW1rsbj3FapfEeIfN9OJqcCvXddViu6M84JP7AA%3D)
2026-03-28 22:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110875/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ73EOT/42811363?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=Z275yW1rsbj3FapfEeIfN9OJqcCvXddViu6M84JP7AA%3D)
2026-03-28 22:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142718/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WU66XNV/42811422?sv=2020-08-04&st=2026-03-28T22%3A01%3A16Z&se=2026-03-28T22%3A26%3A16Z&sr=b&sp=r&sig=iEWCiRexucMVz979VRM55ID%2B0dAdHnqV0R4MKdIaGkA%3D)
2026-03-28 22:01:42 [bca.uk] INFO: Found listing with ID: SV57%20URE
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV57%2520URE%27 HTTP/1.1" 200 None
2026-03-28 22:01:42 [bca.uk] INFO: Scrape type for SV57%20URE: 1
2026-03-28 22:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc8ad810-ee96-5691-85b6-151e0c412b22 with identifier: SV57%20URE
2026-03-28 22:01:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item dc8ad810-ee96-5691-85b6-151e0c412b22
2026-03-28 22:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071260/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG16XLF/42811219?sv=2020-08-04&st=2026-03-28T22%3A01%3A19Z&se=2026-03-28T22%3A26%3A19Z&sr=b&sp=r&sig=piDa4JVgaWBzjvnw0OZ1irSwQFsxpWFyq8MJd75hPTs%3D)
2026-03-28 22:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994197/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994197>
2026-03-28 22:01:42 [bca.uk] INFO: Found listing with ID: WT69%20BHA
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WT69%2520BHA%27 HTTP/1.1" 200 None
2026-03-28 22:01:42 [bca.uk] INFO: Scrape type for WT69%20BHA: 1
2026-03-28 22:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc68cc3e-7955-57eb-86ee-c32f3b153341 with identifier: WT69%20BHA
2026-03-28 22:01:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item fc68cc3e-7955-57eb-86ee-c32f3b153341
2026-03-28 22:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699126499/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126499>
2026-03-28 22:01:42 [bca.uk] INFO: Found listing with ID: LX67%20JRZ
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX67%2520JRZ%27 HTTP/1.1" 200 None
2026-03-28 22:01:42 [bca.uk] INFO: Scrape type for LX67%20JRZ: 1
2026-03-28 22:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f32681d-db41-5392-826f-9b7e9d934be6 with identifier: LX67%20JRZ
2026-03-28 22:01:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0f32681d-db41-5392-826f-9b7e9d934be6
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54733e690>
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82f1ca74-f3e3-557a-9800-72143e39903a/82f1ca74-f3e3-557a-9800-72143e39903a_expert_report_file_8910a6b8-6157-408e-bc51-31f24951997a.pdf HTTP/1.1" 201 0
2026-03-28 22:01:42 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 82f1ca74-f3e3-557a-9800-72143e39903a
2026-03-28 22:01:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82f1ca74-f3e3-557a-9800-72143e39903a, skipping ID generation
2026-03-28 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82f1ca74-f3e3-557a-9800-72143e39903a
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DML19YFV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ML19YFV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:42 [bca.uk] INFO: Found listing with ID: BV70%20UZS
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV70%2520UZS%27 HTTP/1.1" 200 None
2026-03-28 22:01:42 [bca.uk] INFO: Scrape type for BV70%20UZS: 1
2026-03-28 22:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c249da5-1d51-5bc9-a40c-4417dbaa5b62 with identifier: BV70%20UZS
2026-03-28 22:01:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9c249da5-1d51-5bc9-a40c-4417dbaa5b62
2026-03-28 22:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142731/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WU66XNV/42811422?sv=2020-08-04&st=2026-03-28T22%3A01%3A16Z&se=2026-03-28T22%3A26%3A16Z&sr=b&sp=r&sig=iEWCiRexucMVz979VRM55ID%2B0dAdHnqV0R4MKdIaGkA%3D)
2026-03-28 22:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994101/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP11OHH/42810859?sv=2020-08-04&st=2026-03-28T22%3A01%3A17Z&se=2026-03-28T22%3A26%3A17Z&sr=b&sp=r&sig=b7CgL1od%2BxWYmvFyCkZBnwP%2Fc8hvRbuQDmBfA%2FtGEC4%3D)
2026-03-28 22:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142741/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WU66XNV/42811422?sv=2020-08-04&st=2026-03-28T22%3A01%3A16Z&se=2026-03-28T22%3A26%3A16Z&sr=b&sp=r&sig=iEWCiRexucMVz979VRM55ID%2B0dAdHnqV0R4MKdIaGkA%3D)
2026-03-28 22:01:42 [bca.uk] INFO: Found listing with ID: FY65%20OSN
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY65%2520OSN%27 HTTP/1.1" 200 None
2026-03-28 22:01:42 [bca.uk] INFO: Scrape type for FY65%20OSN: 1
2026-03-28 22:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4c536c8-20b9-5eb5-bd31-426ff92c052b with identifier: FY65%20OSN
2026-03-28 22:01:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d4c536c8-20b9-5eb5-bd31-426ff92c052b
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699083370%27 HTTP/1.1" 200 None
2026-03-28 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699083370 not downloaded yet
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547796450>
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5e0f49-0b91-505b-88af-460f766781c7/1b5e0f49-0b91-505b-88af-460f766781c7_expert_report_file_fe7eb208-e301-42d7-a9ce-809d4f16cdc5.pdf HTTP/1.1" 201 0
2026-03-28 22:01:42 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1b5e0f49-0b91-505b-88af-460f766781c7
2026-03-28 22:01:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b5e0f49-0b91-505b-88af-460f766781c7, skipping ID generation
2026-03-28 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b5e0f49-0b91-505b-88af-460f766781c7
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWJ10DVF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WJ10DVF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:42 [bca.uk] INFO: Found listing with ID: DG14%20YNA
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG14%2520YNA%27 HTTP/1.1" 200 None
2026-03-28 22:01:42 [bca.uk] INFO: Scrape type for DG14%20YNA: 1
2026-03-28 22:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 238a280e-8233-56ab-b3e9-1e6814e8a2fb with identifier: DG14%20YNA
2026-03-28 22:01:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 238a280e-8233-56ab-b3e9-1e6814e8a2fb
2026-03-28 22:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071274/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG16XLF/42811219?sv=2020-08-04&st=2026-03-28T22%3A01%3A19Z&se=2026-03-28T22%3A26%3A19Z&sr=b&sp=r&sig=piDa4JVgaWBzjvnw0OZ1irSwQFsxpWFyq8MJd75hPTs%3D)
2026-03-28 22:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994133/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP11OHH/42810859?sv=2020-08-04&st=2026-03-28T22%3A01%3A17Z&se=2026-03-28T22%3A26%3A17Z&sr=b&sp=r&sig=b7CgL1od%2BxWYmvFyCkZBnwP%2Fc8hvRbuQDmBfA%2FtGEC4%3D)
2026-03-28 22:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994243/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994243>
2026-03-28 22:01:42 [bca.uk] INFO: Found listing with ID: GC65%20ULU
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GC65%2520ULU%27 HTTP/1.1" 200 None
2026-03-28 22:01:42 [bca.uk] INFO: Scrape type for GC65%20ULU: 0
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699083378%27 HTTP/1.1" 200 None
2026-03-28 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699083378 not downloaded yet
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058678%27 HTTP/1.1" 200 None
2026-03-28 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058678 not downloaded yet
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555032a90>
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9153a9c4-5990-5981-85ad-c93a9119ac4b/9153a9c4-5990-5981-85ad-c93a9119ac4b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP11OHH%252F698994067%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994067/600 saved to cache
2026-03-28 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9153a9c4-5990-5981-85ad-c93a9119ac4b
2026-03-28 22:01:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555032c90>
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2f45d0-e564-5ded-8cb4-0288835f055c/ab2f45d0-e564-5ded-8cb4-0288835f055c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ73EOT%252F699110857%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110857/600 saved to cache
2026-03-28 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab2f45d0-e564-5ded-8cb4-0288835f055c
2026-03-28 22:01:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557131a10>
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2f45d0-e564-5ded-8cb4-0288835f055c/ab2f45d0-e564-5ded-8cb4-0288835f055c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ73EOT%252F699110875%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110875/600 saved to cache
2026-03-28 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab2f45d0-e564-5ded-8cb4-0288835f055c
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fc7810>
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51da0f1d-592f-5dda-b1f6-cadeb5cfb790/51da0f1d-592f-5dda-b1f6-cadeb5cfb790_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWU66XNV%252F699142718%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142718/600 saved to cache
2026-03-28 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 51da0f1d-592f-5dda-b1f6-cadeb5cfb790
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fbf750>
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1/87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG16XLF%252F699071260%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071260/600 saved to cache
2026-03-28 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1
2026-03-28 22:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EU05FSN/42811285?sv=2020-08-04&st=2026-03-28T22%3A01%3A41Z&se=2026-03-28T22%3A26%3A41Z&sr=b&sp=r&sig=1ukcy%2BJnSTkmgE1yrhOXAgwOA%2FmnfMjqBgubNMC0cpA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FR19MWZ/42810822?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=GYtWFICW2u6rv3sfILIF5tT%2FDyMNf2SiV4cdUThi5Hc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FR19%20MWZ-GB>
2026-03-28 22:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DH74NTG/42809544?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=LJJODzMkXqLjvOoVOHmQz4YZ1kuSc6HrYpr6QEIsFUo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DH74%20NTG-GB>
2026-03-28 22:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV07WHR/42811419?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=z1aEAAQDV9PIHJVl6UU9s5XvuilKP28U73wSSA6W4gI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GV07%20WHR-GB>
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699083388%27 HTTP/1.1" 200 None
2026-03-28 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699083388 not downloaded yet
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058702%27 HTTP/1.1" 200 None
2026-03-28 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058702 not downloaded yet
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54724aa50>
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51da0f1d-592f-5dda-b1f6-cadeb5cfb790/51da0f1d-592f-5dda-b1f6-cadeb5cfb790_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWU66XNV%252F699142731%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142731/600 saved to cache
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 51da0f1d-592f-5dda-b1f6-cadeb5cfb790
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54724b490>
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9153a9c4-5990-5981-85ad-c93a9119ac4b/9153a9c4-5990-5981-85ad-c93a9119ac4b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP11OHH%252F698994101%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994101/600 saved to cache
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9153a9c4-5990-5981-85ad-c93a9119ac4b
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547279350>
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51da0f1d-592f-5dda-b1f6-cadeb5cfb790/51da0f1d-592f-5dda-b1f6-cadeb5cfb790_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWU66XNV%252F699142741%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142741/600 saved to cache
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 51da0f1d-592f-5dda-b1f6-cadeb5cfb790
2026-03-28 22:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699126499/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WU66XNV/42811422?sv=2020-08-04&st=2026-03-28T22%3A01%3A16Z&se=2026-03-28T22%3A26%3A16Z&sr=b&sp=r&sig=iEWCiRexucMVz979VRM55ID%2B0dAdHnqV0R4MKdIaGkA%3D)
2026-03-28 22:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF52OWM/42811398?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=YeDMNZ6oQ6NFrpy2R%2Bj35ErYa8BTV%2BdGHdRn1PJbl%2Bs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF52%20OWM-GB>
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699083399%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699083399 not downloaded yet
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058713%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058713 not downloaded yet
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543b95d0>
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1/87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG16XLF%252F699071274%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071274/600 saved to cache
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544e1910>
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9153a9c4-5990-5981-85ad-c93a9119ac4b/9153a9c4-5990-5981-85ad-c93a9119ac4b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP11OHH%252F698994133%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994133/600 saved to cache
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9153a9c4-5990-5981-85ad-c93a9119ac4b
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557364150>
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60dbac76-bcbf-5733-bcb6-c737b1fd8a76/60dbac76-bcbf-5733-bcb6-c737b1fd8a76_expert_report_file_7358bf1b-9249-4f79-bfae-ba01ab3c6761.pdf HTTP/1.1" 201 0
2026-03-28 22:01:43 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 60dbac76-bcbf-5733-bcb6-c737b1fd8a76
2026-03-28 22:01:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60dbac76-bcbf-5733-bcb6-c737b1fd8a76, skipping ID generation
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 60dbac76-bcbf-5733-bcb6-c737b1fd8a76
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEU05FSN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EU05FSN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083359/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ML19YFV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV57URE/42811404?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=MvcPFzW4wOuqsi3ubsAt6SRypzyHXszdPCJYT5mCrw8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SV57%20URE-GB>
2026-03-28 22:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX67JRZ/42811335?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=8gtfp9xhRjJIo54cHj%2BsUwpEg7z8%2ButbAE5f7loqLgM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LX67%20JRZ-GB>
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699083413%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699083413 not downloaded yet
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058731%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058731 not downloaded yet
2026-03-28 22:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093882/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VX52YYH/42811323?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=sBcdU%2Bi00fGyPAIkGghzLoIMWb9WJk%2B0Sty%2BOKRiKzA%3D)
2026-03-28 22:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994197/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP11OHH/42810859?sv=2020-08-04&st=2026-03-28T22%3A01%3A17Z&se=2026-03-28T22%3A26%3A17Z&sr=b&sp=r&sig=b7CgL1od%2BxWYmvFyCkZBnwP%2Fc8hvRbuQDmBfA%2FtGEC4%3D)
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699080002%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699080002 not downloaded yet
2026-03-28 22:01:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554568250>
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51da0f1d-592f-5dda-b1f6-cadeb5cfb790/51da0f1d-592f-5dda-b1f6-cadeb5cfb790_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWU66XNV%252F699126499%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699126499/600 saved to cache
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 51da0f1d-592f-5dda-b1f6-cadeb5cfb790
2026-03-28 22:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WT69BHA/42810882?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=c83gNi4tlAbiB9gp%2BrChPq2zGPWp08bZPIfL6q5thYk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WT69%20BHA-GB>
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699083424%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699083424 not downloaded yet
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058744%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058744 not downloaded yet
2026-03-28 22:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994243/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP11OHH/42810859?sv=2020-08-04&st=2026-03-28T22%3A01%3A17Z&se=2026-03-28T22%3A26%3A17Z&sr=b&sp=r&sig=b7CgL1od%2BxWYmvFyCkZBnwP%2Fc8hvRbuQDmBfA%2FtGEC4%3D)
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699080015%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699080015 not downloaded yet
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699083442%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699083442 not downloaded yet
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058771%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058771 not downloaded yet
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699080023%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699080023 not downloaded yet
2026-03-28 22:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083370/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699083370>
2026-03-28 22:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058668/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WJ10DVF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699083461%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699083461 not downloaded yet
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058808%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058808 not downloaded yet
2026-03-28 22:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058678/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058678>
2026-03-28 22:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DH74NTG/42809544?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=LJJODzMkXqLjvOoVOHmQz4YZ1kuSc6HrYpr6QEIsFUo%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699080037%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699080037 not downloaded yet
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54724a5d0>
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d9ff90-12a7-5f3d-86ac-c640dc2351b5/08d9ff90-12a7-5f3d-86ac-c640dc2351b5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVX52YYH%252F699093882%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093882/600 saved to cache
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08d9ff90-12a7-5f3d-86ac-c640dc2351b5
2026-03-28 22:01:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55430f810>
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9153a9c4-5990-5981-85ad-c93a9119ac4b/9153a9c4-5990-5981-85ad-c93a9119ac4b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP11OHH%252F698994197%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994197/600 saved to cache
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9153a9c4-5990-5981-85ad-c93a9119ac4b
2026-03-28 22:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO59HAX/42811434?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=w87Az5BdQ8tw%2FoTy7zlShimMP%2BazepJ8YCD7W4Wu6As%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EO59%20HAX-GB>
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699083480%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699083480 not downloaded yet
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058848%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058848 not downloaded yet
2026-03-28 22:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FR19MWZ/42810822?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=GYtWFICW2u6rv3sfILIF5tT%2FDyMNf2SiV4cdUThi5Hc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699080053%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699080053 not downloaded yet
2026-03-28 22:01:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548091d0>
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9153a9c4-5990-5981-85ad-c93a9119ac4b/9153a9c4-5990-5981-85ad-c93a9119ac4b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP11OHH%252F698994243%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994243/600 saved to cache
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9153a9c4-5990-5981-85ad-c93a9119ac4b
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058871%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058871 not downloaded yet
2026-03-28 22:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083359/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML19YFV/42811247?sv=2020-08-04&st=2026-03-28T22%3A01%3A40Z&se=2026-03-28T22%3A26%3A40Z&sr=b&sp=r&sig=S%2FokmN6AyZAKnUf36DNP%2F9ORjut4q1lWqes9oRlwZxI%3D)
2026-03-28 22:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058702/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058702>
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699080061%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699080061 not downloaded yet
2026-03-28 22:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV07WHR/42811419?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=z1aEAAQDV9PIHJVl6UU9s5XvuilKP28U73wSSA6W4gI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55456d9d0>
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0257875d-c974-59e6-9d6f-29ede1e17434/0257875d-c974-59e6-9d6f-29ede1e17434_expert_report_file_ba7c36dc-c707-4409-92be-1c4e9caaf94e.pdf HTTP/1.1" 201 0
2026-03-28 22:01:43 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0257875d-c974-59e6-9d6f-29ede1e17434
2026-03-28 22:01:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0257875d-c974-59e6-9d6f-29ede1e17434, skipping ID generation
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0257875d-c974-59e6-9d6f-29ede1e17434
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDH74NTG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DH74NTG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699080071%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699080071 not downloaded yet
2026-03-28 22:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF52OWM/42811398?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=YeDMNZ6oQ6NFrpy2R%2Bj35ErYa8BTV%2BdGHdRn1PJbl%2Bs%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699079991/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EU05FSN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058713/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058713>
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188573%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188573 not downloaded yet
2026-03-28 22:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV57URE/42811404?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=MvcPFzW4wOuqsi3ubsAt6SRypzyHXszdPCJYT5mCrw8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX67JRZ/42811335?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=8gtfp9xhRjJIo54cHj%2BsUwpEg7z8%2ButbAE5f7loqLgM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699080079%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699080079 not downloaded yet
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54728da10>
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb/8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb_expert_report_file_6ce03467-a255-4fa9-aa70-8922bb5deed7.pdf HTTP/1.1" 201 0
2026-03-28 22:01:43 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb
2026-03-28 22:01:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb, skipping ID generation
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFR19MWZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FR19MWZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188581%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188581 not downloaded yet
2026-03-28 22:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058678/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ10DVF/42811170?sv=2020-08-04&st=2026-03-28T22%3A01%3A40Z&se=2026-03-28T22%3A26%3A40Z&sr=b&sp=r&sig=BGXTJolY8Ge%2BXdix4Hh6nL18hqFDPxiPwsZ0%2B8UN9%2BA%3D)
2026-03-28 22:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058744/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058744>
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015734%27 HTTP/1.1" 200 None
2026-03-28 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015734 not downloaded yet
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f95110>
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82f1ca74-f3e3-557a-9800-72143e39903a/82f1ca74-f3e3-557a-9800-72143e39903a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML19YFV%252F699083359%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083359/600 saved to cache
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82f1ca74-f3e3-557a-9800-72143e39903a
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473b79d0>
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec5f1ff9-26e6-53be-a244-e62a265b9a04/ec5f1ff9-26e6-53be-a244-e62a265b9a04_expert_report_file_8106f358-cb3e-479a-9645-e05fcd4a83c4.pdf HTTP/1.1" 201 0
2026-03-28 22:01:44 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ec5f1ff9-26e6-53be-a244-e62a265b9a04
2026-03-28 22:01:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec5f1ff9-26e6-53be-a244-e62a265b9a04, skipping ID generation
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ec5f1ff9-26e6-53be-a244-e62a265b9a04
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGV07WHR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GV07WHR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188589%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188589 not downloaded yet
2026-03-28 22:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WT69BHA/42810882?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=c83gNi4tlAbiB9gp%2BrChPq2zGPWp08bZPIfL6q5thYk%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058668/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ10DVF/42811170?sv=2020-08-04&st=2026-03-28T22%3A01%3A40Z&se=2026-03-28T22%3A26%3A40Z&sr=b&sp=r&sig=BGXTJolY8Ge%2BXdix4Hh6nL18hqFDPxiPwsZ0%2B8UN9%2BA%3D)
2026-03-28 22:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083370/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML19YFV/42811247?sv=2020-08-04&st=2026-03-28T22%3A01%3A40Z&se=2026-03-28T22%3A26%3A40Z&sr=b&sp=r&sig=S%2FokmN6AyZAKnUf36DNP%2F9ORjut4q1lWqes9oRlwZxI%3D)
2026-03-28 22:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080037/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699080037>
2026-03-28 22:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080023/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699080023>
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015746%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015746 not downloaded yet
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143524%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143524 not downloaded yet
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554826f10>
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fe63328-a7f9-5445-857a-b37d1386e94b/2fe63328-a7f9-5445-857a-b37d1386e94b_expert_report_file_f68b61c2-4629-4b72-9b53-246399fbccea.pdf HTTP/1.1" 201 0
2026-03-28 22:01:44 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2fe63328-a7f9-5445-857a-b37d1386e94b
2026-03-28 22:01:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2fe63328-a7f9-5445-857a-b37d1386e94b, skipping ID generation
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2fe63328-a7f9-5445-857a-b37d1386e94b
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGF52OWM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GF52OWM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188596%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188596 not downloaded yet
2026-03-28 22:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058702/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ10DVF/42811170?sv=2020-08-04&st=2026-03-28T22%3A01%3A40Z&se=2026-03-28T22%3A26%3A40Z&sr=b&sp=r&sig=BGXTJolY8Ge%2BXdix4Hh6nL18hqFDPxiPwsZ0%2B8UN9%2BA%3D)
2026-03-28 22:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058871/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058871>
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015760%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015760 not downloaded yet
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143539%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143539 not downloaded yet
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143518%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143518 not downloaded yet
2026-03-28 22:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO59HAX/42811434?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=w87Az5BdQ8tw%2FoTy7zlShimMP%2BazepJ8YCD7W4Wu6As%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188601%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188601 not downloaded yet
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474f55d0>
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc8ad810-ee96-5691-85b6-151e0c412b22/dc8ad810-ee96-5691-85b6-151e0c412b22_expert_report_file_fa88e783-457a-4e17-8c8b-61455947ce2d.pdf HTTP/1.1" 201 0
2026-03-28 22:01:44 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item dc8ad810-ee96-5691-85b6-151e0c412b22
2026-03-28 22:01:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc8ad810-ee96-5691-85b6-151e0c412b22, skipping ID generation
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc8ad810-ee96-5691-85b6-151e0c412b22
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSV57URE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SV57URE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b43ed0>
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f32681d-db41-5392-826f-9b7e9d934be6/0f32681d-db41-5392-826f-9b7e9d934be6_expert_report_file_3b009ec9-a095-486b-8a24-7972927e2993.pdf HTTP/1.1" 201 0
2026-03-28 22:01:44 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0f32681d-db41-5392-826f-9b7e9d934be6
2026-03-28 22:01:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f32681d-db41-5392-826f-9b7e9d934be6, skipping ID generation
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f32681d-db41-5392-826f-9b7e9d934be6
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLX67JRZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LX67JRZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b53b10>
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5e0f49-0b91-505b-88af-460f766781c7/1b5e0f49-0b91-505b-88af-460f766781c7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ10DVF%252F699058678%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058678/600 saved to cache
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b5e0f49-0b91-505b-88af-460f766781c7
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547da210>
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc68cc3e-7955-57eb-86ee-c32f3b153341/fc68cc3e-7955-57eb-86ee-c32f3b153341_expert_report_file_31088767-ea2d-4737-b921-5262bb5bdb6d.pdf HTTP/1.1" 201 0
2026-03-28 22:01:44 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item fc68cc3e-7955-57eb-86ee-c32f3b153341
2026-03-28 22:01:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc68cc3e-7955-57eb-86ee-c32f3b153341, skipping ID generation
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fc68cc3e-7955-57eb-86ee-c32f3b153341
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWT69BHA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WT69BHA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b42f50>
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5e0f49-0b91-505b-88af-460f766781c7/1b5e0f49-0b91-505b-88af-460f766781c7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ10DVF%252F699058668%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058668/600 saved to cache
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b5e0f49-0b91-505b-88af-460f766781c7
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b53210>
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82f1ca74-f3e3-557a-9800-72143e39903a/82f1ca74-f3e3-557a-9800-72143e39903a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML19YFV%252F699083370%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083370/600 saved to cache
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82f1ca74-f3e3-557a-9800-72143e39903a
2026-03-28 22:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058713/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ10DVF/42811170?sv=2020-08-04&st=2026-03-28T22%3A01%3A40Z&se=2026-03-28T22%3A26%3A40Z&sr=b&sp=r&sig=BGXTJolY8Ge%2BXdix4Hh6nL18hqFDPxiPwsZ0%2B8UN9%2BA%3D)
2026-03-28 22:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080053/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699080053>
2026-03-28 22:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188567/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DH74NTG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080071/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699080071>
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015782%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015782 not downloaded yet
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143549%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143549 not downloaded yet
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143517%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143517 not downloaded yet
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188615%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188615 not downloaded yet
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126468%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126468 not downloaded yet
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110920%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110920 not downloaded yet
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699032922%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032922 not downloaded yet
2026-03-28 22:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699079991/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EU05FSN/42811285?sv=2020-08-04&st=2026-03-28T22%3A01%3A41Z&se=2026-03-28T22%3A26%3A41Z&sr=b&sp=r&sig=1ukcy%2BJnSTkmgE1yrhOXAgwOA%2FmnfMjqBgubNMC0cpA%3D)
2026-03-28 22:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058744/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ10DVF/42811170?sv=2020-08-04&st=2026-03-28T22%3A01%3A40Z&se=2026-03-28T22%3A26%3A40Z&sr=b&sp=r&sig=BGXTJolY8Ge%2BXdix4Hh6nL18hqFDPxiPwsZ0%2B8UN9%2BA%3D)
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015797%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015797 not downloaded yet
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143565%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143565 not downloaded yet
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143533%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143533 not downloaded yet
2026-03-28 22:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015710/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FR19MWZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080061/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699080061>
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188626%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188626 not downloaded yet
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126487%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126487 not downloaded yet
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110933%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110933 not downloaded yet
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699032937%27 HTTP/1.1" 200 None
2026-03-28 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032937 not downloaded yet
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015837%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015837 not downloaded yet
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143575%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143575 not downloaded yet
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143529%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143529 not downloaded yet
2026-03-28 22:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542ff350>
2026-03-28 22:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5e0f49-0b91-505b-88af-460f766781c7/1b5e0f49-0b91-505b-88af-460f766781c7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ10DVF%252F699058702%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058702/600 saved to cache
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b5e0f49-0b91-505b-88af-460f766781c7
2026-03-28 22:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f8c1d0>
2026-03-28 22:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e935e7df-c51b-5719-9d53-d1e5a270ea84/e935e7df-c51b-5719-9d53-d1e5a270ea84_expert_report_file_8ab989eb-29d2-448b-aa54-e1ac43da70e3.pdf HTTP/1.1" 201 0
2026-03-28 22:01:45 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e935e7df-c51b-5719-9d53-d1e5a270ea84
2026-03-28 22:01:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e935e7df-c51b-5719-9d53-d1e5a270ea84, skipping ID generation
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e935e7df-c51b-5719-9d53-d1e5a270ea84
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEO59HAX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EO59HAX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547733450>
2026-03-28 22:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5e0f49-0b91-505b-88af-460f766781c7/1b5e0f49-0b91-505b-88af-460f766781c7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ10DVF%252F699058713%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058713/600 saved to cache
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b5e0f49-0b91-505b-88af-460f766781c7
2026-03-28 22:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015734/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015734>
2026-03-28 22:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143512/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GV07WHR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188581/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188581>
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188637%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188637 not downloaded yet
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126503%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126503 not downloaded yet
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110955%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110955 not downloaded yet
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699032949%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032949 not downloaded yet
2026-03-28 22:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080037/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EU05FSN/42811285?sv=2020-08-04&st=2026-03-28T22%3A01%3A41Z&se=2026-03-28T22%3A26%3A41Z&sr=b&sp=r&sig=1ukcy%2BJnSTkmgE1yrhOXAgwOA%2FmnfMjqBgubNMC0cpA%3D)
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015861%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015861 not downloaded yet
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143594%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143594 not downloaded yet
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143544%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143544 not downloaded yet
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143547%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143547 not downloaded yet
2026-03-28 22:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547135250>
2026-03-28 22:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60dbac76-bcbf-5733-bcb6-c737b1fd8a76/60dbac76-bcbf-5733-bcb6-c737b1fd8a76_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEU05FSN%252F699079991%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699079991/600 saved to cache
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60dbac76-bcbf-5733-bcb6-c737b1fd8a76
2026-03-28 22:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54728fc50>
2026-03-28 22:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5e0f49-0b91-505b-88af-460f766781c7/1b5e0f49-0b91-505b-88af-460f766781c7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ10DVF%252F699058744%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058744/600 saved to cache
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b5e0f49-0b91-505b-88af-460f766781c7
2026-03-28 22:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080023/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EU05FSN/42811285?sv=2020-08-04&st=2026-03-28T22%3A01%3A41Z&se=2026-03-28T22%3A26%3A41Z&sr=b&sp=r&sig=1ukcy%2BJnSTkmgE1yrhOXAgwOA%2FmnfMjqBgubNMC0cpA%3D)
2026-03-28 22:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188596/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188596>
2026-03-28 22:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143505/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GF52OWM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058871/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ10DVF/42811170?sv=2020-08-04&st=2026-03-28T22%3A01%3A40Z&se=2026-03-28T22%3A26%3A40Z&sr=b&sp=r&sig=BGXTJolY8Ge%2BXdix4Hh6nL18hqFDPxiPwsZ0%2B8UN9%2BA%3D)
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188648%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188648 not downloaded yet
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126515%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126515 not downloaded yet
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110966%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110966 not downloaded yet
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699032957%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032957 not downloaded yet
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015880%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015880 not downloaded yet
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143614%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143614 not downloaded yet
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143541%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143541 not downloaded yet
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143563%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143563 not downloaded yet
2026-03-28 22:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188567/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DH74NTG/42809544?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=LJJODzMkXqLjvOoVOHmQz4YZ1kuSc6HrYpr6QEIsFUo%3D)
2026-03-28 22:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032909/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WT69BHA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126535%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126535 not downloaded yet
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110974%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110974 not downloaded yet
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699032973%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032973 not downloaded yet
2026-03-28 22:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b2b690>
2026-03-28 22:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60dbac76-bcbf-5733-bcb6-c737b1fd8a76/60dbac76-bcbf-5733-bcb6-c737b1fd8a76_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEU05FSN%252F699080037%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080037/600 saved to cache
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60dbac76-bcbf-5733-bcb6-c737b1fd8a76
2026-03-28 22:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015710/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FR19MWZ/42810822?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=GYtWFICW2u6rv3sfILIF5tT%2FDyMNf2SiV4cdUThi5Hc%3D)
2026-03-28 22:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143549/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143549>
2026-03-28 22:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143517/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143517>
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015903%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015903 not downloaded yet
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143641%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143641 not downloaded yet
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143560%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143560 not downloaded yet
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143573%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143573 not downloaded yet
2026-03-28 22:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080071/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EU05FSN/42811285?sv=2020-08-04&st=2026-03-28T22%3A01%3A41Z&se=2026-03-28T22%3A26%3A41Z&sr=b&sp=r&sig=1ukcy%2BJnSTkmgE1yrhOXAgwOA%2FmnfMjqBgubNMC0cpA%3D)
2026-03-28 22:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080053/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EU05FSN/42811285?sv=2020-08-04&st=2026-03-28T22%3A01%3A41Z&se=2026-03-28T22%3A26%3A41Z&sr=b&sp=r&sig=1ukcy%2BJnSTkmgE1yrhOXAgwOA%2FmnfMjqBgubNMC0cpA%3D)
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126556%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126556 not downloaded yet
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110999%27 HTTP/1.1" 200 None
2026-03-28 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110999 not downloaded yet
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699032994%27 HTTP/1.1" 200 None
2026-03-28 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032994 not downloaded yet
2026-03-28 22:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080061/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EU05FSN/42811285?sv=2020-08-04&st=2026-03-28T22%3A01%3A41Z&se=2026-03-28T22%3A26%3A41Z&sr=b&sp=r&sig=1ukcy%2BJnSTkmgE1yrhOXAgwOA%2FmnfMjqBgubNMC0cpA%3D)
2026-03-28 22:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188581/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DH74NTG/42809544?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=LJJODzMkXqLjvOoVOHmQz4YZ1kuSc6HrYpr6QEIsFUo%3D)
2026-03-28 22:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143512/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV07WHR/42811419?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=z1aEAAQDV9PIHJVl6UU9s5XvuilKP28U73wSSA6W4gI%3D)
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143660%27 HTTP/1.1" 200 None
2026-03-28 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143660 not downloaded yet
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143554%27 HTTP/1.1" 200 None
2026-03-28 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143554 not downloaded yet
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143585%27 HTTP/1.1" 200 None
2026-03-28 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143585 not downloaded yet
2026-03-28 22:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f8dd90>
2026-03-28 22:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60dbac76-bcbf-5733-bcb6-c737b1fd8a76/60dbac76-bcbf-5733-bcb6-c737b1fd8a76_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEU05FSN%252F699080023%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080023/600 saved to cache
2026-03-28 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60dbac76-bcbf-5733-bcb6-c737b1fd8a76
2026-03-28 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a61910>
2026-03-28 22:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5e0f49-0b91-505b-88af-460f766781c7/1b5e0f49-0b91-505b-88af-460f766781c7_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ10DVF%252F699058871%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058871/600 saved to cache
2026-03-28 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1b5e0f49-0b91-505b-88af-460f766781c7
2026-03-28 22:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542d2b50>
2026-03-28 22:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0257875d-c974-59e6-9d6f-29ede1e17434/0257875d-c974-59e6-9d6f-29ede1e17434_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDH74NTG%252F699188567%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188567/600 saved to cache
2026-03-28 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0257875d-c974-59e6-9d6f-29ede1e17434
2026-03-28 22:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015734/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FR19MWZ/42810822?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=GYtWFICW2u6rv3sfILIF5tT%2FDyMNf2SiV4cdUThi5Hc%3D)
2026-03-28 22:01:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143535/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EO59HAX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126579%27 HTTP/1.1" 200 None
2026-03-28 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126579 not downloaded yet
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699111020%27 HTTP/1.1" 200 None
2026-03-28 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699111020 not downloaded yet
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699033017%27 HTTP/1.1" 200 None
2026-03-28 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699033017 not downloaded yet
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143571%27 HTTP/1.1" 200 None
2026-03-28 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143571 not downloaded yet
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143592%27 HTTP/1.1" 200 None
2026-03-28 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143592 not downloaded yet
2026-03-28 22:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188596/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DH74NTG/42809544?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=LJJODzMkXqLjvOoVOHmQz4YZ1kuSc6HrYpr6QEIsFUo%3D)
2026-03-28 22:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032909/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WT69BHA/42810882?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=c83gNi4tlAbiB9gp%2BrChPq2zGPWp08bZPIfL6q5thYk%3D)
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126601%27 HTTP/1.1" 200 None
2026-03-28 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126601 not downloaded yet
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699111031%27 HTTP/1.1" 200 None
2026-03-28 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699111031 not downloaded yet
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699033038%27 HTTP/1.1" 200 None
2026-03-28 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699033038 not downloaded yet
2026-03-28 22:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b04d90>
2026-03-28 22:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb/8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFR19MWZ%252F699015710%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015710/600 saved to cache
2026-03-28 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb
2026-03-28 22:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477d3190>
2026-03-28 22:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60dbac76-bcbf-5733-bcb6-c737b1fd8a76/60dbac76-bcbf-5733-bcb6-c737b1fd8a76_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEU05FSN%252F699080071%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080071/600 saved to cache
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60dbac76-bcbf-5733-bcb6-c737b1fd8a76
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b81d10>
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60dbac76-bcbf-5733-bcb6-c737b1fd8a76/60dbac76-bcbf-5733-bcb6-c737b1fd8a76_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEU05FSN%252F699080053%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080053/600 saved to cache
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60dbac76-bcbf-5733-bcb6-c737b1fd8a76
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477da290>
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60dbac76-bcbf-5733-bcb6-c737b1fd8a76/60dbac76-bcbf-5733-bcb6-c737b1fd8a76_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEU05FSN%252F699080061%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080061/600 saved to cache
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60dbac76-bcbf-5733-bcb6-c737b1fd8a76
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547743f10>
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0257875d-c974-59e6-9d6f-29ede1e17434/0257875d-c974-59e6-9d6f-29ede1e17434_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDH74NTG%252F699188581%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188581/600 saved to cache
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0257875d-c974-59e6-9d6f-29ede1e17434
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473dc590>
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec5f1ff9-26e6-53be-a244-e62a265b9a04/ec5f1ff9-26e6-53be-a244-e62a265b9a04_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV07WHR%252F699143512%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143512/600 saved to cache
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec5f1ff9-26e6-53be-a244-e62a265b9a04
2026-03-28 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032957/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032957>
2026-03-28 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032949/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032949>
2026-03-28 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110955/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110955>
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143613%27 HTTP/1.1" 200 None
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143613 not downloaded yet
2026-03-28 22:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143517/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF52OWM/42811398?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=YeDMNZ6oQ6NFrpy2R%2Bj35ErYa8BTV%2BdGHdRn1PJbl%2Bs%3D)
2026-03-28 22:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143549/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV07WHR/42811419?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=z1aEAAQDV9PIHJVl6UU9s5XvuilKP28U73wSSA6W4gI%3D)
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126618%27 HTTP/1.1" 200 None
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126618 not downloaded yet
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699111054%27 HTTP/1.1" 200 None
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699111054 not downloaded yet
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699033059%27 HTTP/1.1" 200 None
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699033059 not downloaded yet
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143632%27 HTTP/1.1" 200 None
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143632 not downloaded yet
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477ce690>
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb/8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFR19MWZ%252F699015734%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015734/600 saved to cache
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547313fd0>
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0257875d-c974-59e6-9d6f-29ede1e17434/0257875d-c974-59e6-9d6f-29ede1e17434_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDH74NTG%252F699188596%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188596/600 saved to cache
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0257875d-c974-59e6-9d6f-29ede1e17434
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547396650>
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc68cc3e-7955-57eb-86ee-c32f3b153341/fc68cc3e-7955-57eb-86ee-c32f3b153341_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWT69BHA%252F699032909%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032909/600 saved to cache
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc68cc3e-7955-57eb-86ee-c32f3b153341
2026-03-28 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143573/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143573>
2026-03-28 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143563/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143563>
2026-03-28 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143641/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143641>
2026-03-28 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143560/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143560>
2026-03-28 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015903/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015903>
2026-03-28 22:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143535/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO59HAX/42811434?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=w87Az5BdQ8tw%2FoTy7zlShimMP%2BazepJ8YCD7W4Wu6As%3D)
2026-03-28 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032973/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032973>
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143651%27 HTTP/1.1" 200 None
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143651 not downloaded yet
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554ab8e90>
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fe63328-a7f9-5445-857a-b37d1386e94b/2fe63328-a7f9-5445-857a-b37d1386e94b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF52OWM%252F699143517%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143517/600 saved to cache
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2fe63328-a7f9-5445-857a-b37d1386e94b
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473fa610>
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec5f1ff9-26e6-53be-a244-e62a265b9a04/ec5f1ff9-26e6-53be-a244-e62a265b9a04_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV07WHR%252F699143549%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143549/600 saved to cache
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec5f1ff9-26e6-53be-a244-e62a265b9a04
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143668%27 HTTP/1.1" 200 None
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143668 not downloaded yet
2026-03-28 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699033017/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699033017>
2026-03-28 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032994/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032994>
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549b17d0>
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e935e7df-c51b-5719-9d53-d1e5a270ea84/e935e7df-c51b-5719-9d53-d1e5a270ea84_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO59HAX%252F699143535%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143535/600 saved to cache
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e935e7df-c51b-5719-9d53-d1e5a270ea84
2026-03-28 22:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110955/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX67JRZ/42811335?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=8gtfp9xhRjJIo54cHj%2BsUwpEg7z8%2ButbAE5f7loqLgM%3D)
2026-03-28 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699033038/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699033038>
2026-03-28 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699111020/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699111020>
2026-03-28 22:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032957/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WT69BHA/42810882?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=c83gNi4tlAbiB9gp%2BrChPq2zGPWp08bZPIfL6q5thYk%3D)
2026-03-28 22:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032949/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WT69BHA/42810882?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=c83gNi4tlAbiB9gp%2BrChPq2zGPWp08bZPIfL6q5thYk%3D)
2026-03-28 22:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143505/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF52OWM/42811398?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=YeDMNZ6oQ6NFrpy2R%2Bj35ErYa8BTV%2BdGHdRn1PJbl%2Bs%3D)
2026-03-28 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699111031/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699111031>
2026-03-28 22:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143563/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO59HAX/42811434?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=w87Az5BdQ8tw%2FoTy7zlShimMP%2BazepJ8YCD7W4Wu6As%3D)
2026-03-28 22:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143560/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF52OWM/42811398?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=YeDMNZ6oQ6NFrpy2R%2Bj35ErYa8BTV%2BdGHdRn1PJbl%2Bs%3D)
2026-03-28 22:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143641/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV07WHR/42811419?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=z1aEAAQDV9PIHJVl6UU9s5XvuilKP28U73wSSA6W4gI%3D)
2026-03-28 22:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032973/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WT69BHA/42810882?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=c83gNi4tlAbiB9gp%2BrChPq2zGPWp08bZPIfL6q5thYk%3D)
2026-03-28 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143632/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143632>
2026-03-28 22:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015903/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FR19MWZ/42810822?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=GYtWFICW2u6rv3sfILIF5tT%2FDyMNf2SiV4cdUThi5Hc%3D)
2026-03-28 22:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143573/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO59HAX/42811434?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=w87Az5BdQ8tw%2FoTy7zlShimMP%2BazepJ8YCD7W4Wu6As%3D)
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55491c490>
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f32681d-db41-5392-826f-9b7e9d934be6/0f32681d-db41-5392-826f-9b7e9d934be6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX67JRZ%252F699110955%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110955/600 saved to cache
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f32681d-db41-5392-826f-9b7e9d934be6
2026-03-28 22:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699111020/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX67JRZ/42811335?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=8gtfp9xhRjJIo54cHj%2BsUwpEg7z8%2ButbAE5f7loqLgM%3D)
2026-03-28 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143668/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143668>
2026-03-28 22:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699033017/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WT69BHA/42810882?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=c83gNi4tlAbiB9gp%2BrChPq2zGPWp08bZPIfL6q5thYk%3D)
2026-03-28 22:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699033038/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WT69BHA/42810882?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=c83gNi4tlAbiB9gp%2BrChPq2zGPWp08bZPIfL6q5thYk%3D)
2026-03-28 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143651/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143651>
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477cf910>
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc68cc3e-7955-57eb-86ee-c32f3b153341/fc68cc3e-7955-57eb-86ee-c32f3b153341_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWT69BHA%252F699032957%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032957/600 saved to cache
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc68cc3e-7955-57eb-86ee-c32f3b153341
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554aa0390>
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc68cc3e-7955-57eb-86ee-c32f3b153341/fc68cc3e-7955-57eb-86ee-c32f3b153341_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWT69BHA%252F699032949%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032949/600 saved to cache
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc68cc3e-7955-57eb-86ee-c32f3b153341
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f97f90>
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fe63328-a7f9-5445-857a-b37d1386e94b/2fe63328-a7f9-5445-857a-b37d1386e94b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF52OWM%252F699143505%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143505/600 saved to cache
2026-03-28 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2fe63328-a7f9-5445-857a-b37d1386e94b
2026-03-28 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699033059/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699033059>
2026-03-28 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699111054/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699111054>
2026-03-28 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126618/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126618>
2026-03-28 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032994/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WT69BHA/42810882?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=c83gNi4tlAbiB9gp%2BrChPq2zGPWp08bZPIfL6q5thYk%3D)
2026-03-28 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699111031/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX67JRZ/42811335?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=8gtfp9xhRjJIo54cHj%2BsUwpEg7z8%2ButbAE5f7loqLgM%3D)
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54778df50>
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e935e7df-c51b-5719-9d53-d1e5a270ea84/e935e7df-c51b-5719-9d53-d1e5a270ea84_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO59HAX%252F699143563%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143563/600 saved to cache
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e935e7df-c51b-5719-9d53-d1e5a270ea84
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542bab90>
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fe63328-a7f9-5445-857a-b37d1386e94b/2fe63328-a7f9-5445-857a-b37d1386e94b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF52OWM%252F699143560%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143560/600 saved to cache
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2fe63328-a7f9-5445-857a-b37d1386e94b
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477c47d0>
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec5f1ff9-26e6-53be-a244-e62a265b9a04/ec5f1ff9-26e6-53be-a244-e62a265b9a04_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV07WHR%252F699143641%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143641/600 saved to cache
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ec5f1ff9-26e6-53be-a244-e62a265b9a04
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477314d0>
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc68cc3e-7955-57eb-86ee-c32f3b153341/fc68cc3e-7955-57eb-86ee-c32f3b153341_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWT69BHA%252F699032973%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032973/600 saved to cache
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc68cc3e-7955-57eb-86ee-c32f3b153341
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b8d90>
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb/8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFR19MWZ%252F699015903%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015903/600 saved to cache
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477c76d0>
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e935e7df-c51b-5719-9d53-d1e5a270ea84/e935e7df-c51b-5719-9d53-d1e5a270ea84_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO59HAX%252F699143573%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143573/600 saved to cache
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e935e7df-c51b-5719-9d53-d1e5a270ea84
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554905350>
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f32681d-db41-5392-826f-9b7e9d934be6/0f32681d-db41-5392-826f-9b7e9d934be6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX67JRZ%252F699111020%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699111020/600 saved to cache
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f32681d-db41-5392-826f-9b7e9d934be6
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477321d0>
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc68cc3e-7955-57eb-86ee-c32f3b153341/fc68cc3e-7955-57eb-86ee-c32f3b153341_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWT69BHA%252F699033017%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699033017/600 saved to cache
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc68cc3e-7955-57eb-86ee-c32f3b153341
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477c5a90>
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc68cc3e-7955-57eb-86ee-c32f3b153341/fc68cc3e-7955-57eb-86ee-c32f3b153341_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWT69BHA%252F699033038%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699033038/600 saved to cache
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc68cc3e-7955-57eb-86ee-c32f3b153341
2026-03-28 22:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126601/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126601>
2026-03-28 22:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143592/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143592>
2026-03-28 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143632/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO59HAX/42811434?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=w87Az5BdQ8tw%2FoTy7zlShimMP%2BazepJ8YCD7W4Wu6As%3D)
2026-03-28 22:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143613/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143613>
2026-03-28 22:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126579/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126579>
2026-03-28 22:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143571/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143571>
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b63e90>
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc68cc3e-7955-57eb-86ee-c32f3b153341/fc68cc3e-7955-57eb-86ee-c32f3b153341_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWT69BHA%252F699032994%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032994/600 saved to cache
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc68cc3e-7955-57eb-86ee-c32f3b153341
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543eab50>
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f32681d-db41-5392-826f-9b7e9d934be6/0f32681d-db41-5392-826f-9b7e9d934be6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX67JRZ%252F699111031%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699111031/600 saved to cache
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f32681d-db41-5392-826f-9b7e9d934be6
2026-03-28 22:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143585/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143585>
2026-03-28 22:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143554/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143554>
2026-03-28 22:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143660/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143660>
2026-03-28 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126618/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV57URE/42811404?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=MvcPFzW4wOuqsi3ubsAt6SRypzyHXszdPCJYT5mCrw8%3D)
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547db7d0>
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e935e7df-c51b-5719-9d53-d1e5a270ea84/e935e7df-c51b-5719-9d53-d1e5a270ea84_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO59HAX%252F699143632%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143632/600 saved to cache
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e935e7df-c51b-5719-9d53-d1e5a270ea84
2026-03-28 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143651/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO59HAX/42811434?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=w87Az5BdQ8tw%2FoTy7zlShimMP%2BazepJ8YCD7W4Wu6As%3D)
2026-03-28 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699111054/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX67JRZ/42811335?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=8gtfp9xhRjJIo54cHj%2BsUwpEg7z8%2ButbAE5f7loqLgM%3D)
2026-03-28 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699033059/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WT69BHA/42810882?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=c83gNi4tlAbiB9gp%2BrChPq2zGPWp08bZPIfL6q5thYk%3D)
2026-03-28 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143668/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO59HAX/42811434?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=w87Az5BdQ8tw%2FoTy7zlShimMP%2BazepJ8YCD7W4Wu6As%3D)
2026-03-28 22:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110999/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110999>
2026-03-28 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126579/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV57URE/42811404?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=MvcPFzW4wOuqsi3ubsAt6SRypzyHXszdPCJYT5mCrw8%3D)
2026-03-28 22:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126556/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126556>
2026-03-28 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143571/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF52OWM/42811398?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=YeDMNZ6oQ6NFrpy2R%2Bj35ErYa8BTV%2BdGHdRn1PJbl%2Bs%3D)
2026-03-28 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126601/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV57URE/42811404?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=MvcPFzW4wOuqsi3ubsAt6SRypzyHXszdPCJYT5mCrw8%3D)
2026-03-28 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143592/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO59HAX/42811434?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=w87Az5BdQ8tw%2FoTy7zlShimMP%2BazepJ8YCD7W4Wu6As%3D)
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547380190>
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc8ad810-ee96-5691-85b6-151e0c412b22/dc8ad810-ee96-5691-85b6-151e0c412b22_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV57URE%252F699126618%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126618/600 saved to cache
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dc8ad810-ee96-5691-85b6-151e0c412b22
2026-03-28 22:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110974/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110974>
2026-03-28 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143554/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF52OWM/42811398?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=YeDMNZ6oQ6NFrpy2R%2Bj35ErYa8BTV%2BdGHdRn1PJbl%2Bs%3D)
2026-03-28 22:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126535/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126535>
2026-03-28 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143613/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO59HAX/42811434?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=w87Az5BdQ8tw%2FoTy7zlShimMP%2BazepJ8YCD7W4Wu6As%3D)
2026-03-28 22:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143541/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143541>
2026-03-28 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143660/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV07WHR/42811419?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=z1aEAAQDV9PIHJVl6UU9s5XvuilKP28U73wSSA6W4gI%3D)
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477d0ed0>
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e935e7df-c51b-5719-9d53-d1e5a270ea84/e935e7df-c51b-5719-9d53-d1e5a270ea84_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO59HAX%252F699143651%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143651/600 saved to cache
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e935e7df-c51b-5719-9d53-d1e5a270ea84
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547340210>
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f32681d-db41-5392-826f-9b7e9d934be6/0f32681d-db41-5392-826f-9b7e9d934be6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX67JRZ%252F699111054%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699111054/600 saved to cache
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f32681d-db41-5392-826f-9b7e9d934be6
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477a7e90>
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc68cc3e-7955-57eb-86ee-c32f3b153341/fc68cc3e-7955-57eb-86ee-c32f3b153341_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWT69BHA%252F699033059%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699033059/600 saved to cache
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fc68cc3e-7955-57eb-86ee-c32f3b153341
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554954a50>
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e935e7df-c51b-5719-9d53-d1e5a270ea84/e935e7df-c51b-5719-9d53-d1e5a270ea84_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO59HAX%252F699143668%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143668/600 saved to cache
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e935e7df-c51b-5719-9d53-d1e5a270ea84
2026-03-28 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143585/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO59HAX/42811434?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=w87Az5BdQ8tw%2FoTy7zlShimMP%2BazepJ8YCD7W4Wu6As%3D)
2026-03-28 22:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143614/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143614>
2026-03-28 22:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015880/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015880>
2026-03-28 22:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110966/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110966>
2026-03-28 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110999/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX67JRZ/42811335?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=8gtfp9xhRjJIo54cHj%2BsUwpEg7z8%2ButbAE5f7loqLgM%3D)
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477aca90>
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc8ad810-ee96-5691-85b6-151e0c412b22/dc8ad810-ee96-5691-85b6-151e0c412b22_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV57URE%252F699126579%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126579/600 saved to cache
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dc8ad810-ee96-5691-85b6-151e0c412b22
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a60250>
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fe63328-a7f9-5445-857a-b37d1386e94b/2fe63328-a7f9-5445-857a-b37d1386e94b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF52OWM%252F699143571%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143571/600 saved to cache
2026-03-28 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2fe63328-a7f9-5445-857a-b37d1386e94b
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554907a10>
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc8ad810-ee96-5691-85b6-151e0c412b22/dc8ad810-ee96-5691-85b6-151e0c412b22_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV57URE%252F699126601%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126601/600 saved to cache
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dc8ad810-ee96-5691-85b6-151e0c412b22
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a627d0>
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e935e7df-c51b-5719-9d53-d1e5a270ea84/e935e7df-c51b-5719-9d53-d1e5a270ea84_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO59HAX%252F699143592%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143592/600 saved to cache
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e935e7df-c51b-5719-9d53-d1e5a270ea84
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477db090>
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fe63328-a7f9-5445-857a-b37d1386e94b/2fe63328-a7f9-5445-857a-b37d1386e94b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF52OWM%252F699143554%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143554/600 saved to cache
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2fe63328-a7f9-5445-857a-b37d1386e94b
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f9bed0>
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e935e7df-c51b-5719-9d53-d1e5a270ea84/e935e7df-c51b-5719-9d53-d1e5a270ea84_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO59HAX%252F699143613%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143613/600 saved to cache
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e935e7df-c51b-5719-9d53-d1e5a270ea84
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549072d0>
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec5f1ff9-26e6-53be-a244-e62a265b9a04/ec5f1ff9-26e6-53be-a244-e62a265b9a04_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV07WHR%252F699143660%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143660/600 saved to cache
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ec5f1ff9-26e6-53be-a244-e62a265b9a04
2026-03-28 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126515/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126515>
2026-03-28 22:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110974/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX67JRZ/42811335?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=8gtfp9xhRjJIo54cHj%2BsUwpEg7z8%2ButbAE5f7loqLgM%3D)
2026-03-28 22:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126535/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV57URE/42811404?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=MvcPFzW4wOuqsi3ubsAt6SRypzyHXszdPCJYT5mCrw8%3D)
2026-03-28 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188648/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188648>
2026-03-28 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143547/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143547>
2026-03-28 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143544/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143544>
2026-03-28 22:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126556/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV57URE/42811404?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=MvcPFzW4wOuqsi3ubsAt6SRypzyHXszdPCJYT5mCrw8%3D)
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477e68d0>
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e935e7df-c51b-5719-9d53-d1e5a270ea84/e935e7df-c51b-5719-9d53-d1e5a270ea84_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO59HAX%252F699143585%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143585/600 saved to cache
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e935e7df-c51b-5719-9d53-d1e5a270ea84
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547f4d90>
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f32681d-db41-5392-826f-9b7e9d934be6/0f32681d-db41-5392-826f-9b7e9d934be6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX67JRZ%252F699110999%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110999/600 saved to cache
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f32681d-db41-5392-826f-9b7e9d934be6
2026-03-28 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143594/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143594>
2026-03-28 22:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143541/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF52OWM/42811398?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=YeDMNZ6oQ6NFrpy2R%2Bj35ErYa8BTV%2BdGHdRn1PJbl%2Bs%3D)
2026-03-28 22:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110966/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX67JRZ/42811335?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=8gtfp9xhRjJIo54cHj%2BsUwpEg7z8%2ButbAE5f7loqLgM%3D)
2026-03-28 22:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143614/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV07WHR/42811419?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=z1aEAAQDV9PIHJVl6UU9s5XvuilKP28U73wSSA6W4gI%3D)
2026-03-28 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126503/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126503>
2026-03-28 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015861/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015861>
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542d4c10>
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f32681d-db41-5392-826f-9b7e9d934be6/0f32681d-db41-5392-826f-9b7e9d934be6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX67JRZ%252F699110974%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110974/600 saved to cache
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f32681d-db41-5392-826f-9b7e9d934be6
2026-03-28 22:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015880/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FR19MWZ/42810822?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=GYtWFICW2u6rv3sfILIF5tT%2FDyMNf2SiV4cdUThi5Hc%3D)
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473d8f10>
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc8ad810-ee96-5691-85b6-151e0c412b22/dc8ad810-ee96-5691-85b6-151e0c412b22_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV57URE%252F699126535%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126535/600 saved to cache
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc8ad810-ee96-5691-85b6-151e0c412b22
2026-03-28 22:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126515/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV57URE/42811404?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=MvcPFzW4wOuqsi3ubsAt6SRypzyHXszdPCJYT5mCrw8%3D)
2026-03-28 22:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143544/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF52OWM/42811398?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=YeDMNZ6oQ6NFrpy2R%2Bj35ErYa8BTV%2BdGHdRn1PJbl%2Bs%3D)
2026-03-28 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188637/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188637>
2026-03-28 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143529/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143529>
2026-03-28 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143575/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143575>
2026-03-28 22:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188648/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DH74NTG/42809544?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=LJJODzMkXqLjvOoVOHmQz4YZ1kuSc6HrYpr6QEIsFUo%3D)
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549cb690>
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc8ad810-ee96-5691-85b6-151e0c412b22/dc8ad810-ee96-5691-85b6-151e0c412b22_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV57URE%252F699126556%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126556/600 saved to cache
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dc8ad810-ee96-5691-85b6-151e0c412b22
2026-03-28 22:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143547/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO59HAX/42811434?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=w87Az5BdQ8tw%2FoTy7zlShimMP%2BazepJ8YCD7W4Wu6As%3D)
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473062d0>
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fe63328-a7f9-5445-857a-b37d1386e94b/2fe63328-a7f9-5445-857a-b37d1386e94b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF52OWM%252F699143541%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143541/600 saved to cache
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2fe63328-a7f9-5445-857a-b37d1386e94b
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477a5550>
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f32681d-db41-5392-826f-9b7e9d934be6/0f32681d-db41-5392-826f-9b7e9d934be6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX67JRZ%252F699110966%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110966/600 saved to cache
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f32681d-db41-5392-826f-9b7e9d934be6
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474bb890>
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec5f1ff9-26e6-53be-a244-e62a265b9a04/ec5f1ff9-26e6-53be-a244-e62a265b9a04_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV07WHR%252F699143614%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143614/600 saved to cache
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ec5f1ff9-26e6-53be-a244-e62a265b9a04
2026-03-28 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015837/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015837>
2026-03-28 22:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126503/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV57URE/42811404?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=MvcPFzW4wOuqsi3ubsAt6SRypzyHXszdPCJYT5mCrw8%3D)
2026-03-28 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126487/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126487>
2026-03-28 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110933/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110933>
2026-03-28 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188626/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188626>
2026-03-28 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032937/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032937>
2026-03-28 22:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143594/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV07WHR/42811419?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=z1aEAAQDV9PIHJVl6UU9s5XvuilKP28U73wSSA6W4gI%3D)
2026-03-28 22:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015861/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FR19MWZ/42810822?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=GYtWFICW2u6rv3sfILIF5tT%2FDyMNf2SiV4cdUThi5Hc%3D)
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547775b90>
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb/8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFR19MWZ%252F699015880%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015880/600 saved to cache
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b07390>
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc8ad810-ee96-5691-85b6-151e0c412b22/dc8ad810-ee96-5691-85b6-151e0c412b22_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV57URE%252F699126515%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126515/600 saved to cache
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc8ad810-ee96-5691-85b6-151e0c412b22
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54772bc50>
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fe63328-a7f9-5445-857a-b37d1386e94b/2fe63328-a7f9-5445-857a-b37d1386e94b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF52OWM%252F699143544%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143544/600 saved to cache
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2fe63328-a7f9-5445-857a-b37d1386e94b
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544c0b10>
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0257875d-c974-59e6-9d6f-29ede1e17434/0257875d-c974-59e6-9d6f-29ede1e17434_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDH74NTG%252F699188648%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188648/600 saved to cache
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0257875d-c974-59e6-9d6f-29ede1e17434
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54748ec10>
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e935e7df-c51b-5719-9d53-d1e5a270ea84/e935e7df-c51b-5719-9d53-d1e5a270ea84_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO59HAX%252F699143547%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143547/600 saved to cache
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e935e7df-c51b-5719-9d53-d1e5a270ea84
2026-03-28 22:01:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e935e7df-c51b-5719-9d53-d1e5a270ea84, skipping ID generation
2026-03-28 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e935e7df-c51b-5719-9d53-d1e5a270ea84 sending to next pipeline
2026-03-28 22:01:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e935e7df-c51b-5719-9d53-d1e5a270ea84, identifier: EO59%20HAX
2026-03-28 22:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e935e7df-c51b-5719-9d53-d1e5a270ea84 with identifier: EO59%20HAX
2026-03-28 22:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e935e7df-c51b-5719-9d53-d1e5a270ea84 with identifier: EO59%20HAX
2026-03-28 22:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e935e7df-c51b-5719-9d53-d1e5a270ea84 with identifier: EO59%20HAX to the API
2026-03-28 22:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143547/600>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e935e7df-c51b-5719-9d53-d1e5a270ea84/e935e7df-c51b-5719-9d53-d1e5a270ea84_expert_report_file_8ab989eb-29d2-448b-aa54-e1ac43da70e3.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EO59%20HAX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e935e7df-c51b-5719-9d53-d1e5a270ea84',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EO59 HAX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EO59%20HAX&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MINI',
'model': 'FIRST',
'odometer': 106810,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e935e7df-c51b-5719-9d53-d1e5a270ea84/e935e7df-c51b-5719-9d53-d1e5a270ea84_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43911,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143535/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e935e7df-c51b-5719-9d53-d1e5a270ea84/e935e7df-c51b-5719-9d53-d1e5a270ea84_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41754,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143547/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e935e7df-c51b-5719-9d53-d1e5a270ea84/e935e7df-c51b-5719-9d53-d1e5a270ea84_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40936,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143563/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e935e7df-c51b-5719-9d53-d1e5a270ea84/e935e7df-c51b-5719-9d53-d1e5a270ea84_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37973,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143573/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e935e7df-c51b-5719-9d53-d1e5a270ea84/e935e7df-c51b-5719-9d53-d1e5a270ea84_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37705,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143585/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e935e7df-c51b-5719-9d53-d1e5a270ea84/e935e7df-c51b-5719-9d53-d1e5a270ea84_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37640,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143592/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e935e7df-c51b-5719-9d53-d1e5a270ea84/e935e7df-c51b-5719-9d53-d1e5a270ea84_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82421,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143613/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e935e7df-c51b-5719-9d53-d1e5a270ea84/e935e7df-c51b-5719-9d53-d1e5a270ea84_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59810,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143632/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e935e7df-c51b-5719-9d53-d1e5a270ea84/e935e7df-c51b-5719-9d53-d1e5a270ea84_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76129,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143651/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e935e7df-c51b-5719-9d53-d1e5a270ea84/e935e7df-c51b-5719-9d53-d1e5a270ea84_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84141,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO59HAX/699143668/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'MINI FIRST 1.4 Hatchback',
'transmission': 'manual',
'trim': '',
'vin': 'WMWME32040TM63191',
'year': 2009}
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO59%2520HAX%27 HTTP/1.1" 200 None
2026-03-28 22:01:51 [bca.uk] INFO: Saving data for EO59%20HAX: {'created_time': 1774735311.068083, 'last_price_update_time': 1774735311.068098, 'auction_closing_time': 1774864800.0}
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EO59%2520HAX') HTTP/1.1" 204 0
2026-03-28 22:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143575/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV07WHR/42811419?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=z1aEAAQDV9PIHJVl6UU9s5XvuilKP28U73wSSA6W4gI%3D)
2026-03-28 22:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143529/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF52OWM/42811398?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=YeDMNZ6oQ6NFrpy2R%2Bj35ErYa8BTV%2BdGHdRn1PJbl%2Bs%3D)
2026-03-28 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143565/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143565>
2026-03-28 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015797/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015797>
2026-03-28 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143533/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143533>
2026-03-28 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032922/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032922>
2026-03-28 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110920/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110920>
2026-03-28 22:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188637/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DH74NTG/42809544?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=LJJODzMkXqLjvOoVOHmQz4YZ1kuSc6HrYpr6QEIsFUo%3D)
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547796510>
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc8ad810-ee96-5691-85b6-151e0c412b22/dc8ad810-ee96-5691-85b6-151e0c412b22_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV57URE%252F699126503%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126503/600 saved to cache
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc8ad810-ee96-5691-85b6-151e0c412b22
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474dff90>
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec5f1ff9-26e6-53be-a244-e62a265b9a04/ec5f1ff9-26e6-53be-a244-e62a265b9a04_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV07WHR%252F699143594%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143594/600 saved to cache
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ec5f1ff9-26e6-53be-a244-e62a265b9a04
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554905150>
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb/8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFR19MWZ%252F699015861%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015861/600 saved to cache
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb
2026-03-28 22:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110933/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX67JRZ/42811335?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=8gtfp9xhRjJIo54cHj%2BsUwpEg7z8%2ButbAE5f7loqLgM%3D)
2026-03-28 22:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032937/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WT69BHA/42810882?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=c83gNi4tlAbiB9gp%2BrChPq2zGPWp08bZPIfL6q5thYk%3D)
2026-03-28 22:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188626/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DH74NTG/42809544?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=LJJODzMkXqLjvOoVOHmQz4YZ1kuSc6HrYpr6QEIsFUo%3D)
2026-03-28 22:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126487/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV57URE/42811404?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=MvcPFzW4wOuqsi3ubsAt6SRypzyHXszdPCJYT5mCrw8%3D)
2026-03-28 22:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015837/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FR19MWZ/42810822?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=GYtWFICW2u6rv3sfILIF5tT%2FDyMNf2SiV4cdUThi5Hc%3D)
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547203f10>
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec5f1ff9-26e6-53be-a244-e62a265b9a04/ec5f1ff9-26e6-53be-a244-e62a265b9a04_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV07WHR%252F699143575%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143575/600 saved to cache
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec5f1ff9-26e6-53be-a244-e62a265b9a04
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473b5250>
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fe63328-a7f9-5445-857a-b37d1386e94b/2fe63328-a7f9-5445-857a-b37d1386e94b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF52OWM%252F699143529%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143529/600 saved to cache
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2fe63328-a7f9-5445-857a-b37d1386e94b
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473b67d0>
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0257875d-c974-59e6-9d6f-29ede1e17434/0257875d-c974-59e6-9d6f-29ede1e17434_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDH74NTG%252F699188637%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188637/600 saved to cache
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0257875d-c974-59e6-9d6f-29ede1e17434
2026-03-28 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126468/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126468>
2026-03-28 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015782/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015782>
2026-03-28 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188615/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188615>
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474e43d0>
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f32681d-db41-5392-826f-9b7e9d934be6/0f32681d-db41-5392-826f-9b7e9d934be6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX67JRZ%252F699110933%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110933/600 saved to cache
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f32681d-db41-5392-826f-9b7e9d934be6
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547137190>
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc68cc3e-7955-57eb-86ee-c32f3b153341/fc68cc3e-7955-57eb-86ee-c32f3b153341_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWT69BHA%252F699032937%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032937/600 saved to cache
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc68cc3e-7955-57eb-86ee-c32f3b153341
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549ad7d0>
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0257875d-c974-59e6-9d6f-29ede1e17434/0257875d-c974-59e6-9d6f-29ede1e17434_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDH74NTG%252F699188626%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188626/600 saved to cache
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0257875d-c974-59e6-9d6f-29ede1e17434
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556fbfc50>
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc8ad810-ee96-5691-85b6-151e0c412b22/dc8ad810-ee96-5691-85b6-151e0c412b22_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV57URE%252F699126487%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126487/600 saved to cache
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc8ad810-ee96-5691-85b6-151e0c412b22
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472548d0>
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb/8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFR19MWZ%252F699015837%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015837/600 saved to cache
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb
2026-03-28 22:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015797/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FR19MWZ/42810822?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=GYtWFICW2u6rv3sfILIF5tT%2FDyMNf2SiV4cdUThi5Hc%3D)
2026-03-28 22:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143533/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF52OWM/42811398?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=YeDMNZ6oQ6NFrpy2R%2Bj35ErYa8BTV%2BdGHdRn1PJbl%2Bs%3D)
2026-03-28 22:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143565/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV07WHR/42811419?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=z1aEAAQDV9PIHJVl6UU9s5XvuilKP28U73wSSA6W4gI%3D)
2026-03-28 22:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110920/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX67JRZ/42811335?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=8gtfp9xhRjJIo54cHj%2BsUwpEg7z8%2ButbAE5f7loqLgM%3D)
2026-03-28 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126442/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SV57URE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110908/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LX67JRZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032922/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WT69BHA/42810882?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=c83gNi4tlAbiB9gp%2BrChPq2zGPWp08bZPIfL6q5thYk%3D)
2026-03-28 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188601/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188601>
2026-03-28 22:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126468/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV57URE/42811404?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=MvcPFzW4wOuqsi3ubsAt6SRypzyHXszdPCJYT5mCrw8%3D)
2026-03-28 22:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015782/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FR19MWZ/42810822?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=GYtWFICW2u6rv3sfILIF5tT%2FDyMNf2SiV4cdUThi5Hc%3D)
2026-03-28 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143539/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143539>
2026-03-28 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143524/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143524>
2026-03-28 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143518/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143518>
2026-03-28 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015746/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015746>
2026-03-28 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015760/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015760>
2026-03-28 22:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188615/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DH74NTG/42809544?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=LJJODzMkXqLjvOoVOHmQz4YZ1kuSc6HrYpr6QEIsFUo%3D)
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547116ed0>
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb/8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFR19MWZ%252F699015797%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015797/600 saved to cache
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb
2026-03-28 22:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110908/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX67JRZ/42811335?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=8gtfp9xhRjJIo54cHj%2BsUwpEg7z8%2ButbAE5f7loqLgM%3D)
2026-03-28 22:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126442/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV57URE/42811404?sv=2020-08-04&st=2026-03-28T22%3A01%3A43Z&se=2026-03-28T22%3A26%3A43Z&sr=b&sp=r&sig=MvcPFzW4wOuqsi3ubsAt6SRypzyHXszdPCJYT5mCrw8%3D)
2026-03-28 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058848/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058848>
2026-03-28 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080079/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699080079>
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477620d0>
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fe63328-a7f9-5445-857a-b37d1386e94b/2fe63328-a7f9-5445-857a-b37d1386e94b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF52OWM%252F699143533%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143533/600 saved to cache
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2fe63328-a7f9-5445-857a-b37d1386e94b
2026-03-28 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188589/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188589>
2026-03-28 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188573/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188573>
2026-03-28 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083480/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699083480>
2026-03-28 22:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188601/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DH74NTG/42809544?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=LJJODzMkXqLjvOoVOHmQz4YZ1kuSc6HrYpr6QEIsFUo%3D)
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474a92d0>
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec5f1ff9-26e6-53be-a244-e62a265b9a04/ec5f1ff9-26e6-53be-a244-e62a265b9a04_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV07WHR%252F699143565%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143565/600 saved to cache
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec5f1ff9-26e6-53be-a244-e62a265b9a04
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477acc90>
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f32681d-db41-5392-826f-9b7e9d934be6/0f32681d-db41-5392-826f-9b7e9d934be6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX67JRZ%252F699110920%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110920/600 saved to cache
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f32681d-db41-5392-826f-9b7e9d934be6
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473b4210>
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc68cc3e-7955-57eb-86ee-c32f3b153341/fc68cc3e-7955-57eb-86ee-c32f3b153341_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWT69BHA%252F699032922%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032922/600 saved to cache
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc68cc3e-7955-57eb-86ee-c32f3b153341
2026-03-28 22:01:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc68cc3e-7955-57eb-86ee-c32f3b153341, skipping ID generation
2026-03-28 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc68cc3e-7955-57eb-86ee-c32f3b153341 sending to next pipeline
2026-03-28 22:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fc68cc3e-7955-57eb-86ee-c32f3b153341, identifier: WT69%20BHA
2026-03-28 22:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fc68cc3e-7955-57eb-86ee-c32f3b153341 with identifier: WT69%20BHA
2026-03-28 22:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fc68cc3e-7955-57eb-86ee-c32f3b153341 with identifier: WT69%20BHA
2026-03-28 22:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fc68cc3e-7955-57eb-86ee-c32f3b153341 with identifier: WT69%20BHA to the API
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032922/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc68cc3e-7955-57eb-86ee-c32f3b153341/fc68cc3e-7955-57eb-86ee-c32f3b153341_expert_report_file_31088767-ea2d-4737-b921-5262bb5bdb6d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WT69%20BHA-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fc68cc3e-7955-57eb-86ee-c32f3b153341',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WT69 BHA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WT69%20BHA&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VOLKSWAGEN',
'model': 'TIGUAN ALLSPACE',
'odometer': 38418,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc68cc3e-7955-57eb-86ee-c32f3b153341/fc68cc3e-7955-57eb-86ee-c32f3b153341_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41813,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032909/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc68cc3e-7955-57eb-86ee-c32f3b153341/fc68cc3e-7955-57eb-86ee-c32f3b153341_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41587,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032922/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc68cc3e-7955-57eb-86ee-c32f3b153341/fc68cc3e-7955-57eb-86ee-c32f3b153341_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37876,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032937/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc68cc3e-7955-57eb-86ee-c32f3b153341/fc68cc3e-7955-57eb-86ee-c32f3b153341_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38826,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032949/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc68cc3e-7955-57eb-86ee-c32f3b153341/fc68cc3e-7955-57eb-86ee-c32f3b153341_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36609,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032957/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc68cc3e-7955-57eb-86ee-c32f3b153341/fc68cc3e-7955-57eb-86ee-c32f3b153341_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35769,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032973/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc68cc3e-7955-57eb-86ee-c32f3b153341/fc68cc3e-7955-57eb-86ee-c32f3b153341_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102719,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699032994/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc68cc3e-7955-57eb-86ee-c32f3b153341/fc68cc3e-7955-57eb-86ee-c32f3b153341_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83964,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699033017/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc68cc3e-7955-57eb-86ee-c32f3b153341/fc68cc3e-7955-57eb-86ee-c32f3b153341_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90818,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699033038/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc68cc3e-7955-57eb-86ee-c32f3b153341/fc68cc3e-7955-57eb-86ee-c32f3b153341_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90679,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WT69BHA/699033059/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN ALLSPACE 1.5 TSI EVO 150 2WD MATCH DSG '
'StationWagon',
'transmission': 'automatic',
'trim': 'TSI EVO 150 2WD MATCH DSG',
'vin': 'WVGZZZ5NZLM078782',
'year': 2020}
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WT69%2520BHA%27 HTTP/1.1" 200 None
2026-03-28 22:01:52 [bca.uk] INFO: Saving data for WT69%20BHA: {'created_time': 1774735312.506408, 'last_price_update_time': 1774735312.506418, 'auction_closing_time': 1774951200.0}
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WT69%2520BHA') HTTP/1.1" 204 0
2026-03-28 22:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143518/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF52OWM/42811398?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=YeDMNZ6oQ6NFrpy2R%2Bj35ErYa8BTV%2BdGHdRn1PJbl%2Bs%3D)
2026-03-28 22:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143539/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV07WHR/42811419?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=z1aEAAQDV9PIHJVl6UU9s5XvuilKP28U73wSSA6W4gI%3D)
2026-03-28 22:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083461/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699083461>
2026-03-28 22:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058808/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058808>
2026-03-28 22:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015746/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FR19MWZ/42810822?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=GYtWFICW2u6rv3sfILIF5tT%2FDyMNf2SiV4cdUThi5Hc%3D)
2026-03-28 22:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015760/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FR19MWZ/42810822?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=GYtWFICW2u6rv3sfILIF5tT%2FDyMNf2SiV4cdUThi5Hc%3D)
2026-03-28 22:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143524/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV07WHR/42811419?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=z1aEAAQDV9PIHJVl6UU9s5XvuilKP28U73wSSA6W4gI%3D)
2026-03-28 22:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058771/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058771>
2026-03-28 22:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473eb550>
2026-03-28 22:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc8ad810-ee96-5691-85b6-151e0c412b22/dc8ad810-ee96-5691-85b6-151e0c412b22_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV57URE%252F699126468%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126468/600 saved to cache
2026-03-28 22:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc8ad810-ee96-5691-85b6-151e0c412b22
2026-03-28 22:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477e6050>
2026-03-28 22:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb/8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFR19MWZ%252F699015782%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015782/600 saved to cache
2026-03-28 22:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb
2026-03-28 22:01:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547158210>
2026-03-28 22:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0257875d-c974-59e6-9d6f-29ede1e17434/0257875d-c974-59e6-9d6f-29ede1e17434_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDH74NTG%252F699188615%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188615/600 saved to cache
2026-03-28 22:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0257875d-c974-59e6-9d6f-29ede1e17434
2026-03-28 22:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474edc90>
2026-03-28 22:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f32681d-db41-5392-826f-9b7e9d934be6/0f32681d-db41-5392-826f-9b7e9d934be6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX67JRZ%252F699110908%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110908/600 saved to cache
2026-03-28 22:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f32681d-db41-5392-826f-9b7e9d934be6
2026-03-28 22:01:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f32681d-db41-5392-826f-9b7e9d934be6, skipping ID generation
2026-03-28 22:01:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f32681d-db41-5392-826f-9b7e9d934be6 sending to next pipeline
2026-03-28 22:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0f32681d-db41-5392-826f-9b7e9d934be6, identifier: LX67%20JRZ
2026-03-28 22:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55495e6d0>
2026-03-28 22:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc8ad810-ee96-5691-85b6-151e0c412b22/dc8ad810-ee96-5691-85b6-151e0c412b22_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV57URE%252F699126442%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126442/600 saved to cache
2026-03-28 22:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc8ad810-ee96-5691-85b6-151e0c412b22
2026-03-28 22:01:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc8ad810-ee96-5691-85b6-151e0c412b22, skipping ID generation
2026-03-28 22:01:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc8ad810-ee96-5691-85b6-151e0c412b22 sending to next pipeline
2026-03-28 22:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dc8ad810-ee96-5691-85b6-151e0c412b22, identifier: SV57%20URE
2026-03-28 22:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477a70d0>
2026-03-28 22:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0257875d-c974-59e6-9d6f-29ede1e17434/0257875d-c974-59e6-9d6f-29ede1e17434_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDH74NTG%252F699188601%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188601/600 saved to cache
2026-03-28 22:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0257875d-c974-59e6-9d6f-29ede1e17434
2026-03-28 22:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0f32681d-db41-5392-826f-9b7e9d934be6 with identifier: LX67%20JRZ
2026-03-28 22:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0f32681d-db41-5392-826f-9b7e9d934be6 with identifier: LX67%20JRZ
2026-03-28 22:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0f32681d-db41-5392-826f-9b7e9d934be6 with identifier: LX67%20JRZ to the API
2026-03-28 22:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110908/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f32681d-db41-5392-826f-9b7e9d934be6/0f32681d-db41-5392-826f-9b7e9d934be6_expert_report_file_3b009ec9-a095-486b-8a24-7972927e2993.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LX67%20JRZ-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0f32681d-db41-5392-826f-9b7e9d934be6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LX67 JRZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LX67%20JRZ&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'HONDA',
'model': 'CR-V',
'odometer': 99118,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f32681d-db41-5392-826f-9b7e9d934be6/0f32681d-db41-5392-826f-9b7e9d934be6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47274,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110908/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f32681d-db41-5392-826f-9b7e9d934be6/0f32681d-db41-5392-826f-9b7e9d934be6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47146,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110920/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f32681d-db41-5392-826f-9b7e9d934be6/0f32681d-db41-5392-826f-9b7e9d934be6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45922,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110933/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f32681d-db41-5392-826f-9b7e9d934be6/0f32681d-db41-5392-826f-9b7e9d934be6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42083,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110955/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f32681d-db41-5392-826f-9b7e9d934be6/0f32681d-db41-5392-826f-9b7e9d934be6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39666,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110966/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f32681d-db41-5392-826f-9b7e9d934be6/0f32681d-db41-5392-826f-9b7e9d934be6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39650,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110974/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f32681d-db41-5392-826f-9b7e9d934be6/0f32681d-db41-5392-826f-9b7e9d934be6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88877,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699110999/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f32681d-db41-5392-826f-9b7e9d934be6/0f32681d-db41-5392-826f-9b7e9d934be6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64367,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699111020/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f32681d-db41-5392-826f-9b7e9d934be6/0f32681d-db41-5392-826f-9b7e9d934be6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86113,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699111031/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f32681d-db41-5392-826f-9b7e9d934be6/0f32681d-db41-5392-826f-9b7e9d934be6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82361,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX67JRZ/699111054/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'HONDA CR-V 1.6 I-DTEC 160 EX 4WD StationWagon',
'transmission': 'automatic',
'trim': 'I-DTEC 160 EX 4WD',
'vin': 'SHSRE6890HU001969',
'year': 2017}
2026-03-28 22:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX67%2520JRZ%27 HTTP/1.1" 200 None
2026-03-28 22:01:53 [bca.uk] INFO: Saving data for LX67%20JRZ: {'created_time': 1774735313.450086, 'last_price_update_time': 1774735313.450095, 'auction_closing_time': 1774864800.0}
2026-03-28 22:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LX67%2520JRZ') HTTP/1.1" 204 0
2026-03-28 22:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dc8ad810-ee96-5691-85b6-151e0c412b22 with identifier: SV57%20URE
2026-03-28 22:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dc8ad810-ee96-5691-85b6-151e0c412b22 with identifier: SV57%20URE
2026-03-28 22:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dc8ad810-ee96-5691-85b6-151e0c412b22 with identifier: SV57%20URE to the API
2026-03-28 22:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126442/600>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc8ad810-ee96-5691-85b6-151e0c412b22/dc8ad810-ee96-5691-85b6-151e0c412b22_expert_report_file_fa88e783-457a-4e17-8c8b-61455947ce2d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SV57%20URE-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'dc8ad810-ee96-5691-85b6-151e0c412b22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SV57 URE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SV57%20URE&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'PEUGEOT',
'model': '206',
'odometer': 95350,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc8ad810-ee96-5691-85b6-151e0c412b22/dc8ad810-ee96-5691-85b6-151e0c412b22_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43232,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126442/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc8ad810-ee96-5691-85b6-151e0c412b22/dc8ad810-ee96-5691-85b6-151e0c412b22_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42115,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126468/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc8ad810-ee96-5691-85b6-151e0c412b22/dc8ad810-ee96-5691-85b6-151e0c412b22_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41489,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126487/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc8ad810-ee96-5691-85b6-151e0c412b22/dc8ad810-ee96-5691-85b6-151e0c412b22_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39342,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126503/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc8ad810-ee96-5691-85b6-151e0c412b22/dc8ad810-ee96-5691-85b6-151e0c412b22_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38167,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126515/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc8ad810-ee96-5691-85b6-151e0c412b22/dc8ad810-ee96-5691-85b6-151e0c412b22_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38403,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126535/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc8ad810-ee96-5691-85b6-151e0c412b22/dc8ad810-ee96-5691-85b6-151e0c412b22_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91117,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126556/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc8ad810-ee96-5691-85b6-151e0c412b22/dc8ad810-ee96-5691-85b6-151e0c412b22_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85631,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126579/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc8ad810-ee96-5691-85b6-151e0c412b22/dc8ad810-ee96-5691-85b6-151e0c412b22_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71253,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126601/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc8ad810-ee96-5691-85b6-151e0c412b22/dc8ad810-ee96-5691-85b6-151e0c412b22_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70584,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV57URE/699126618/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'PEUGEOT 206 1.4 HDI LOOK Hatchback',
'transmission': 'manual',
'trim': 'HDI LOOK',
'vin': 'VF32C8HZA47745260',
'year': 2007}
2026-03-28 22:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV57%2520URE%27 HTTP/1.1" 200 None
2026-03-28 22:01:53 [bca.uk] INFO: Saving data for SV57%20URE: {'created_time': 1774735313.842023, 'last_price_update_time': 1774735313.842032, 'auction_closing_time': 1774864800.0}
2026-03-28 22:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SV57%2520URE') HTTP/1.1" 204 0
2026-03-28 22:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188589/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DH74NTG/42809544?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=LJJODzMkXqLjvOoVOHmQz4YZ1kuSc6HrYpr6QEIsFUo%3D)
2026-03-28 22:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188573/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DH74NTG/42809544?sv=2020-08-04&st=2026-03-28T22%3A01%3A42Z&se=2026-03-28T22%3A26%3A42Z&sr=b&sp=r&sig=LJJODzMkXqLjvOoVOHmQz4YZ1kuSc6HrYpr6QEIsFUo%3D)
2026-03-28 22:01:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080015/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699080015>
2026-03-28 22:01:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083424/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699083424>
2026-03-28 22:01:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083442/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699083442>
2026-03-28 22:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544c1cd0>
2026-03-28 22:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fe63328-a7f9-5445-857a-b37d1386e94b/2fe63328-a7f9-5445-857a-b37d1386e94b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF52OWM%252F699143518%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143518/600 saved to cache
2026-03-28 22:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2fe63328-a7f9-5445-857a-b37d1386e94b
2026-03-28 22:01:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2fe63328-a7f9-5445-857a-b37d1386e94b, skipping ID generation
2026-03-28 22:01:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2fe63328-a7f9-5445-857a-b37d1386e94b sending to next pipeline
2026-03-28 22:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2fe63328-a7f9-5445-857a-b37d1386e94b, identifier: GF52%20OWM
2026-03-28 22:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54710f610>
2026-03-28 22:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec5f1ff9-26e6-53be-a244-e62a265b9a04/ec5f1ff9-26e6-53be-a244-e62a265b9a04_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV07WHR%252F699143539%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143539/600 saved to cache
2026-03-28 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec5f1ff9-26e6-53be-a244-e62a265b9a04
2026-03-28 22:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b61d50>
2026-03-28 22:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb/8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFR19MWZ%252F699015746%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015746/600 saved to cache
2026-03-28 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb
2026-03-28 22:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473e9550>
2026-03-28 22:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb/8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFR19MWZ%252F699015760%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015760/600 saved to cache
2026-03-28 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb
2026-03-28 22:01:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb, skipping ID generation
2026-03-28 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb sending to next pipeline
2026-03-28 22:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb, identifier: FR19%20MWZ
2026-03-28 22:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54738d390>
2026-03-28 22:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec5f1ff9-26e6-53be-a244-e62a265b9a04/ec5f1ff9-26e6-53be-a244-e62a265b9a04_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV07WHR%252F699143524%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143524/600 saved to cache
2026-03-28 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec5f1ff9-26e6-53be-a244-e62a265b9a04
2026-03-28 22:01:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec5f1ff9-26e6-53be-a244-e62a265b9a04, skipping ID generation
2026-03-28 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec5f1ff9-26e6-53be-a244-e62a265b9a04 sending to next pipeline
2026-03-28 22:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ec5f1ff9-26e6-53be-a244-e62a265b9a04, identifier: GV07%20WHR
2026-03-28 22:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058848/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ10DVF/42811170?sv=2020-08-04&st=2026-03-28T22%3A01%3A40Z&se=2026-03-28T22%3A26%3A40Z&sr=b&sp=r&sig=BGXTJolY8Ge%2BXdix4Hh6nL18hqFDPxiPwsZ0%2B8UN9%2BA%3D)
2026-03-28 22:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083480/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML19YFV/42811247?sv=2020-08-04&st=2026-03-28T22%3A01%3A40Z&se=2026-03-28T22%3A26%3A40Z&sr=b&sp=r&sig=S%2FokmN6AyZAKnUf36DNP%2F9ORjut4q1lWqes9oRlwZxI%3D)
2026-03-28 22:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2fe63328-a7f9-5445-857a-b37d1386e94b with identifier: GF52%20OWM
2026-03-28 22:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2fe63328-a7f9-5445-857a-b37d1386e94b with identifier: GF52%20OWM
2026-03-28 22:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2fe63328-a7f9-5445-857a-b37d1386e94b with identifier: GF52%20OWM to the API
2026-03-28 22:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143518/600>
{'auction_title': '',
'c_o_2_emission_value': 142,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fe63328-a7f9-5445-857a-b37d1386e94b/2fe63328-a7f9-5445-857a-b37d1386e94b_expert_report_file_f68b61c2-4629-4b72-9b53-246399fbccea.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF52%20OWM-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2fe63328-a7f9-5445-857a-b37d1386e94b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GF52 OWM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GF52%20OWM&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 107222,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fe63328-a7f9-5445-857a-b37d1386e94b/2fe63328-a7f9-5445-857a-b37d1386e94b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46878,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143505/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fe63328-a7f9-5445-857a-b37d1386e94b/2fe63328-a7f9-5445-857a-b37d1386e94b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44858,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143518/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fe63328-a7f9-5445-857a-b37d1386e94b/2fe63328-a7f9-5445-857a-b37d1386e94b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44700,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143517/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fe63328-a7f9-5445-857a-b37d1386e94b/2fe63328-a7f9-5445-857a-b37d1386e94b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42493,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143533/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fe63328-a7f9-5445-857a-b37d1386e94b/2fe63328-a7f9-5445-857a-b37d1386e94b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44058,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143529/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fe63328-a7f9-5445-857a-b37d1386e94b/2fe63328-a7f9-5445-857a-b37d1386e94b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40665,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143544/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fe63328-a7f9-5445-857a-b37d1386e94b/2fe63328-a7f9-5445-857a-b37d1386e94b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41708,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143541/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fe63328-a7f9-5445-857a-b37d1386e94b/2fe63328-a7f9-5445-857a-b37d1386e94b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39133,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143560/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fe63328-a7f9-5445-857a-b37d1386e94b/2fe63328-a7f9-5445-857a-b37d1386e94b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40271,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143554/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fe63328-a7f9-5445-857a-b37d1386e94b/2fe63328-a7f9-5445-857a-b37d1386e94b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37842,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF52OWM/699143571/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.2 E 55 Hatchback',
'transmission': 'manual',
'trim': 'E 55',
'vin': 'WVWZZZ9NZ3Y112597',
'year': 2002}
2026-03-28 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF52%2520OWM%27 HTTP/1.1" 200 None
2026-03-28 22:01:54 [bca.uk] INFO: Saving data for GF52%20OWM: {'created_time': 1774735314.757791, 'last_price_update_time': 1774735314.7578, 'auction_closing_time': 1774864800.0}
2026-03-28 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GF52%2520OWM') HTTP/1.1" 204 0
2026-03-28 22:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb with identifier: FR19%20MWZ
2026-03-28 22:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb with identifier: FR19%20MWZ
2026-03-28 22:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb with identifier: FR19%20MWZ to the API
2026-03-28 22:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015760/600>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb/8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb_expert_report_file_6ce03467-a255-4fa9-aa70-8922bb5deed7.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FR19%20MWZ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FR19 MWZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FR19%20MWZ&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VOLKSWAGEN',
'model': 'UP!',
'odometer': 27979,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb/8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41597,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015710/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb/8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42360,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015734/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb/8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38310,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015746/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb/8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38471,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015760/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb/8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39165,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015782/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb/8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38964,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015797/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb/8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111891,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015837/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb/8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81700,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015861/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb/8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103400,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015880/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb/8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81606,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR19MWZ/699015903/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN UP! 1.0 GTI 115 Hatchback',
'transmission': 'manual',
'trim': 'GTI 115',
'vin': 'WVWZZZAAZKD173690',
'year': 2019}
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FR19%2520MWZ%27 HTTP/1.1" 200 None
2026-03-28 22:01:55 [bca.uk] INFO: Saving data for FR19%20MWZ: {'created_time': 1774735315.143412, 'last_price_update_time': 1774735315.143422, 'auction_closing_time': 1774951200.0}
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FR19%2520MWZ') HTTP/1.1" 204 0
2026-03-28 22:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ec5f1ff9-26e6-53be-a244-e62a265b9a04 with identifier: GV07%20WHR
2026-03-28 22:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ec5f1ff9-26e6-53be-a244-e62a265b9a04 with identifier: GV07%20WHR
2026-03-28 22:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ec5f1ff9-26e6-53be-a244-e62a265b9a04 with identifier: GV07%20WHR to the API
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143524/600>
{'auction_title': '',
'c_o_2_emission_value': 167,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec5f1ff9-26e6-53be-a244-e62a265b9a04/ec5f1ff9-26e6-53be-a244-e62a265b9a04_expert_report_file_8106f358-cb3e-479a-9645-e05fcd4a83c4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GV07%20WHR-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'ec5f1ff9-26e6-53be-a244-e62a265b9a04',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GV07 WHR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GV07%20WHR&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'TOYOTA',
'model': 'COROLLA VERSO',
'odometer': 238617,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec5f1ff9-26e6-53be-a244-e62a265b9a04/ec5f1ff9-26e6-53be-a244-e62a265b9a04_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42563,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143512/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec5f1ff9-26e6-53be-a244-e62a265b9a04/ec5f1ff9-26e6-53be-a244-e62a265b9a04_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41474,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143524/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec5f1ff9-26e6-53be-a244-e62a265b9a04/ec5f1ff9-26e6-53be-a244-e62a265b9a04_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41639,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143539/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec5f1ff9-26e6-53be-a244-e62a265b9a04/ec5f1ff9-26e6-53be-a244-e62a265b9a04_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39054,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143549/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec5f1ff9-26e6-53be-a244-e62a265b9a04/ec5f1ff9-26e6-53be-a244-e62a265b9a04_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36810,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143565/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec5f1ff9-26e6-53be-a244-e62a265b9a04/ec5f1ff9-26e6-53be-a244-e62a265b9a04_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37789,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143575/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec5f1ff9-26e6-53be-a244-e62a265b9a04/ec5f1ff9-26e6-53be-a244-e62a265b9a04_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82314,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143594/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec5f1ff9-26e6-53be-a244-e62a265b9a04/ec5f1ff9-26e6-53be-a244-e62a265b9a04_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64709,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143614/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec5f1ff9-26e6-53be-a244-e62a265b9a04/ec5f1ff9-26e6-53be-a244-e62a265b9a04_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80581,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143641/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec5f1ff9-26e6-53be-a244-e62a265b9a04/ec5f1ff9-26e6-53be-a244-e62a265b9a04_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81834,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV07WHR/699143660/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'TOYOTA COROLLA VERSO 2.2 D-4D T3 MPV',
'transmission': 'manual',
'trim': 'D-4D T3',
'vin': 'NMTEA16R90R086435',
'year': 2007}
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV07%2520WHR%27 HTTP/1.1" 200 None
2026-03-28 22:01:55 [bca.uk] INFO: Saving data for GV07%20WHR: {'created_time': 1774735315.539081, 'last_price_update_time': 1774735315.539093, 'auction_closing_time': 1774864800.0}
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GV07%2520WHR') HTTP/1.1" 204 0
2026-03-28 22:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080079/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EU05FSN/42811285?sv=2020-08-04&st=2026-03-28T22%3A01%3A41Z&se=2026-03-28T22%3A26%3A41Z&sr=b&sp=r&sig=1ukcy%2BJnSTkmgE1yrhOXAgwOA%2FmnfMjqBgubNMC0cpA%3D)
2026-03-28 22:01:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080002/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699080002>
2026-03-28 22:01:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058731/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058731>
2026-03-28 22:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058808/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ10DVF/42811170?sv=2020-08-04&st=2026-03-28T22%3A01%3A40Z&se=2026-03-28T22%3A26%3A40Z&sr=b&sp=r&sig=BGXTJolY8Ge%2BXdix4Hh6nL18hqFDPxiPwsZ0%2B8UN9%2BA%3D)
2026-03-28 22:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058771/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ10DVF/42811170?sv=2020-08-04&st=2026-03-28T22%3A01%3A40Z&se=2026-03-28T22%3A26%3A40Z&sr=b&sp=r&sig=BGXTJolY8Ge%2BXdix4Hh6nL18hqFDPxiPwsZ0%2B8UN9%2BA%3D)
2026-03-28 22:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083461/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML19YFV/42811247?sv=2020-08-04&st=2026-03-28T22%3A01%3A40Z&se=2026-03-28T22%3A26%3A40Z&sr=b&sp=r&sig=S%2FokmN6AyZAKnUf36DNP%2F9ORjut4q1lWqes9oRlwZxI%3D)
2026-03-28 22:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472645d0>
2026-03-28 22:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0257875d-c974-59e6-9d6f-29ede1e17434/0257875d-c974-59e6-9d6f-29ede1e17434_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDH74NTG%252F699188589%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188589/600 saved to cache
2026-03-28 22:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0257875d-c974-59e6-9d6f-29ede1e17434
2026-03-28 22:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b048d0>
2026-03-28 22:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0257875d-c974-59e6-9d6f-29ede1e17434/0257875d-c974-59e6-9d6f-29ede1e17434_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDH74NTG%252F699188573%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188573/600 saved to cache
2026-03-28 22:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0257875d-c974-59e6-9d6f-29ede1e17434
2026-03-28 22:01:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0257875d-c974-59e6-9d6f-29ede1e17434, skipping ID generation
2026-03-28 22:01:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0257875d-c974-59e6-9d6f-29ede1e17434 sending to next pipeline
2026-03-28 22:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0257875d-c974-59e6-9d6f-29ede1e17434, identifier: DH74%20NTG
2026-03-28 22:01:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547312ad0>
2026-03-28 22:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5e0f49-0b91-505b-88af-460f766781c7/1b5e0f49-0b91-505b-88af-460f766781c7_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ10DVF%252F699058848%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058848/600 saved to cache
2026-03-28 22:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1b5e0f49-0b91-505b-88af-460f766781c7
2026-03-28 22:01:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54776d6d0>
2026-03-28 22:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82f1ca74-f3e3-557a-9800-72143e39903a/82f1ca74-f3e3-557a-9800-72143e39903a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML19YFV%252F699083480%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083480/600 saved to cache
2026-03-28 22:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82f1ca74-f3e3-557a-9800-72143e39903a
2026-03-28 22:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0257875d-c974-59e6-9d6f-29ede1e17434 with identifier: DH74%20NTG
2026-03-28 22:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0257875d-c974-59e6-9d6f-29ede1e17434 with identifier: DH74%20NTG
2026-03-28 22:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0257875d-c974-59e6-9d6f-29ede1e17434 with identifier: DH74%20NTG to the API
2026-03-28 22:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188573/600>
{'auction_title': '',
'c_o_2_emission_value': 126,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0257875d-c974-59e6-9d6f-29ede1e17434/0257875d-c974-59e6-9d6f-29ede1e17434_expert_report_file_ba7c36dc-c707-4409-92be-1c4e9caaf94e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DH74%20NTG-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0257875d-c974-59e6-9d6f-29ede1e17434',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DH74 NTG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DH74%20NTG&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'SKODA',
'model': 'KAMIQ',
'odometer': 2947,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0257875d-c974-59e6-9d6f-29ede1e17434/0257875d-c974-59e6-9d6f-29ede1e17434_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41532,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188567/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0257875d-c974-59e6-9d6f-29ede1e17434/0257875d-c974-59e6-9d6f-29ede1e17434_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42790,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188573/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0257875d-c974-59e6-9d6f-29ede1e17434/0257875d-c974-59e6-9d6f-29ede1e17434_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40729,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188581/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0257875d-c974-59e6-9d6f-29ede1e17434/0257875d-c974-59e6-9d6f-29ede1e17434_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41789,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188589/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0257875d-c974-59e6-9d6f-29ede1e17434/0257875d-c974-59e6-9d6f-29ede1e17434_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39928,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188596/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0257875d-c974-59e6-9d6f-29ede1e17434/0257875d-c974-59e6-9d6f-29ede1e17434_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39173,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188601/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0257875d-c974-59e6-9d6f-29ede1e17434/0257875d-c974-59e6-9d6f-29ede1e17434_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80287,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188615/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0257875d-c974-59e6-9d6f-29ede1e17434/0257875d-c974-59e6-9d6f-29ede1e17434_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64761,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188626/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0257875d-c974-59e6-9d6f-29ede1e17434/0257875d-c974-59e6-9d6f-29ede1e17434_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78647,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188637/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0257875d-c974-59e6-9d6f-29ede1e17434/0257875d-c974-59e6-9d6f-29ede1e17434_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83643,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH74NTG/699188648/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-01-01',
'seller_name': None,
'title': 'SKODA KAMIQ 1.0 TSI 115 SE L ED. Hatchback',
'transmission': 'manual',
'trim': 'TSI 115 SE L ED.',
'vin': 'TMBHR6NW6S3018089',
'year': 2025}
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DH74%2520NTG%27 HTTP/1.1" 200 None
2026-03-28 22:01:56 [bca.uk] INFO: Saving data for DH74%20NTG: {'created_time': 1774735316.255614, 'last_price_update_time': 1774735316.255623, 'auction_closing_time': 1774951200.0}
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DH74%2520NTG') HTTP/1.1" 204 0
2026-03-28 22:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083388/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699083388>
2026-03-28 22:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083399/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699083399>
2026-03-28 22:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083413/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699083413>
2026-03-28 22:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083378/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699083378>
2026-03-28 22:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG14YNA/42808187?sv=2020-08-04&st=2026-03-28T22%3A01%3A55Z&se=2026-03-28T22%3A26%3A55Z&sr=b&sp=r&sig=DGiN%2BSfP9fEeRz4iomC5Qiv6ES1KZsQ9RCNgoJLwpnk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DG14%20YNA-GB>
2026-03-28 22:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083424/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML19YFV/42811247?sv=2020-08-04&st=2026-03-28T22%3A01%3A40Z&se=2026-03-28T22%3A26%3A40Z&sr=b&sp=r&sig=S%2FokmN6AyZAKnUf36DNP%2F9ORjut4q1lWqes9oRlwZxI%3D)
2026-03-28 22:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083442/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML19YFV/42811247?sv=2020-08-04&st=2026-03-28T22%3A01%3A40Z&se=2026-03-28T22%3A26%3A40Z&sr=b&sp=r&sig=S%2FokmN6AyZAKnUf36DNP%2F9ORjut4q1lWqes9oRlwZxI%3D)
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477d0410>
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60dbac76-bcbf-5733-bcb6-c737b1fd8a76/60dbac76-bcbf-5733-bcb6-c737b1fd8a76_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEU05FSN%252F699080079%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080079/600 saved to cache
2026-03-28 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 60dbac76-bcbf-5733-bcb6-c737b1fd8a76
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a62a50>
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5e0f49-0b91-505b-88af-460f766781c7/1b5e0f49-0b91-505b-88af-460f766781c7_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ10DVF%252F699058808%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058808/600 saved to cache
2026-03-28 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1b5e0f49-0b91-505b-88af-460f766781c7
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b80390>
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5e0f49-0b91-505b-88af-460f766781c7/1b5e0f49-0b91-505b-88af-460f766781c7_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ10DVF%252F699058771%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058771/600 saved to cache
2026-03-28 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1b5e0f49-0b91-505b-88af-460f766781c7
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b05f50>
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82f1ca74-f3e3-557a-9800-72143e39903a/82f1ca74-f3e3-557a-9800-72143e39903a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML19YFV%252F699083461%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083461/600 saved to cache
2026-03-28 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82f1ca74-f3e3-557a-9800-72143e39903a
2026-03-28 22:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080015/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EU05FSN/42811285?sv=2020-08-04&st=2026-03-28T22%3A01%3A41Z&se=2026-03-28T22%3A26%3A41Z&sr=b&sp=r&sig=1ukcy%2BJnSTkmgE1yrhOXAgwOA%2FmnfMjqBgubNMC0cpA%3D)
2026-03-28 22:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV70UZS/42810918?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=OuGBCg%2BAeGR0D2f%2BeITBsmUKuqiSK1uvUwiSvUi6IQs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BV70%20UZS-GB>
2026-03-28 22:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT71NEN/42810987?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=rH6uqkSHrsaaYdvpCA%2FsZzV6mE0zUHVzVmdfRT1wrj0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT71%20NEN-GB>
2026-03-28 22:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY65OSN/42811345?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=nIVSbgrO1i9Xr%2BfbSLpc%2BtaM0zcISF5O%2FO1r76QJkIA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FY65%20OSN-GB>
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b82350>
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82f1ca74-f3e3-557a-9800-72143e39903a/82f1ca74-f3e3-557a-9800-72143e39903a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML19YFV%252F699083424%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083424/600 saved to cache
2026-03-28 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82f1ca74-f3e3-557a-9800-72143e39903a
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547297fd0>
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82f1ca74-f3e3-557a-9800-72143e39903a/82f1ca74-f3e3-557a-9800-72143e39903a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML19YFV%252F699083442%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083442/600 saved to cache
2026-03-28 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82f1ca74-f3e3-557a-9800-72143e39903a
2026-03-28 22:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058731/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ10DVF/42811170?sv=2020-08-04&st=2026-03-28T22%3A01%3A40Z&se=2026-03-28T22%3A26%3A40Z&sr=b&sp=r&sig=BGXTJolY8Ge%2BXdix4Hh6nL18hqFDPxiPwsZ0%2B8UN9%2BA%3D)
2026-03-28 22:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN69YVF/42797384?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=2YQhuVPOEs8nllGGk7BCLIWyloC%2FrwsAAUaDV7wMkMk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CN69%20YVF-GB>
2026-03-28 22:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994225/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994225>
2026-03-28 22:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080002/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EU05FSN/42811285?sv=2020-08-04&st=2026-03-28T22%3A01%3A41Z&se=2026-03-28T22%3A26%3A41Z&sr=b&sp=r&sig=1ukcy%2BJnSTkmgE1yrhOXAgwOA%2FmnfMjqBgubNMC0cpA%3D)
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474b9790>
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60dbac76-bcbf-5733-bcb6-c737b1fd8a76/60dbac76-bcbf-5733-bcb6-c737b1fd8a76_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEU05FSN%252F699080015%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080015/600 saved to cache
2026-03-28 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60dbac76-bcbf-5733-bcb6-c737b1fd8a76
2026-03-28 22:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA57YVV/42811409?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=nyWRKONE8HKvE1Bd8e5fHoTy4qWWUPVu8%2FwiG6QJKuE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CA57%20YVV-GB>
2026-03-28 22:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083413/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML19YFV/42811247?sv=2020-08-04&st=2026-03-28T22%3A01%3A40Z&se=2026-03-28T22%3A26%3A40Z&sr=b&sp=r&sig=S%2FokmN6AyZAKnUf36DNP%2F9ORjut4q1lWqes9oRlwZxI%3D)
2026-03-28 22:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083388/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML19YFV/42811247?sv=2020-08-04&st=2026-03-28T22%3A01%3A40Z&se=2026-03-28T22%3A26%3A40Z&sr=b&sp=r&sig=S%2FokmN6AyZAKnUf36DNP%2F9ORjut4q1lWqes9oRlwZxI%3D)
2026-03-28 22:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142764/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142764>
2026-03-28 22:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083399/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML19YFV/42811247?sv=2020-08-04&st=2026-03-28T22%3A01%3A40Z&se=2026-03-28T22%3A26%3A40Z&sr=b&sp=r&sig=S%2FokmN6AyZAKnUf36DNP%2F9ORjut4q1lWqes9oRlwZxI%3D)
2026-03-28 22:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071352/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071352>
2026-03-28 22:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083378/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML19YFV/42811247?sv=2020-08-04&st=2026-03-28T22%3A01%3A40Z&se=2026-03-28T22%3A26%3A40Z&sr=b&sp=r&sig=S%2FokmN6AyZAKnUf36DNP%2F9ORjut4q1lWqes9oRlwZxI%3D)
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474f7f90>
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5e0f49-0b91-505b-88af-460f766781c7/1b5e0f49-0b91-505b-88af-460f766781c7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ10DVF%252F699058731%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058731/600 saved to cache
2026-03-28 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b5e0f49-0b91-505b-88af-460f766781c7
2026-03-28 22:01:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b5e0f49-0b91-505b-88af-460f766781c7, skipping ID generation
2026-03-28 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b5e0f49-0b91-505b-88af-460f766781c7 sending to next pipeline
2026-03-28 22:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1b5e0f49-0b91-505b-88af-460f766781c7, identifier: WJ10%20DVF
2026-03-28 22:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1b5e0f49-0b91-505b-88af-460f766781c7 with identifier: WJ10%20DVF
2026-03-28 22:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1b5e0f49-0b91-505b-88af-460f766781c7 with identifier: WJ10%20DVF
2026-03-28 22:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1b5e0f49-0b91-505b-88af-460f766781c7 with identifier: WJ10%20DVF to the API
2026-03-28 22:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058731/600>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b5e0f49-0b91-505b-88af-460f766781c7/1b5e0f49-0b91-505b-88af-460f766781c7_expert_report_file_fe7eb208-e301-42d7-a9ce-809d4f16cdc5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ10%20DVF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1b5e0f49-0b91-505b-88af-460f766781c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ10 DVF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ10%20DVF&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'HYUNDAI',
'model': 'I20',
'odometer': 123098,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b5e0f49-0b91-505b-88af-460f766781c7/1b5e0f49-0b91-505b-88af-460f766781c7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49107,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058668/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b5e0f49-0b91-505b-88af-460f766781c7/1b5e0f49-0b91-505b-88af-460f766781c7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48508,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058678/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b5e0f49-0b91-505b-88af-460f766781c7/1b5e0f49-0b91-505b-88af-460f766781c7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46140,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058702/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b5e0f49-0b91-505b-88af-460f766781c7/1b5e0f49-0b91-505b-88af-460f766781c7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46677,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058713/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b5e0f49-0b91-505b-88af-460f766781c7/1b5e0f49-0b91-505b-88af-460f766781c7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40133,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058731/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b5e0f49-0b91-505b-88af-460f766781c7/1b5e0f49-0b91-505b-88af-460f766781c7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41272,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058744/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b5e0f49-0b91-505b-88af-460f766781c7/1b5e0f49-0b91-505b-88af-460f766781c7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95391,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058771/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b5e0f49-0b91-505b-88af-460f766781c7/1b5e0f49-0b91-505b-88af-460f766781c7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92668,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058808/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b5e0f49-0b91-505b-88af-460f766781c7/1b5e0f49-0b91-505b-88af-460f766781c7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100792,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058848/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b5e0f49-0b91-505b-88af-460f766781c7/1b5e0f49-0b91-505b-88af-460f766781c7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70405,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ10DVF/699058871/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'HYUNDAI I20 1.2 CLASSIC Hatchback',
'transmission': 'manual',
'trim': 'CLASSIC',
'vin': 'MALBA51BLAM123723',
'year': 2010}
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ10%2520DVF%27 HTTP/1.1" 200 None
2026-03-28 22:01:57 [bca.uk] INFO: Saving data for WJ10%20DVF: {'created_time': 1774735317.162368, 'last_price_update_time': 1774735317.162378, 'auction_closing_time': 1774864800.0}
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ10%2520DVF') HTTP/1.1" 204 0
2026-03-28 22:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA21OVG/42811124?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=V82shKhtqB4rTcaiwqPXnkTP%2BoliWo3nMVb6T0BN5SU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CA21%20OVG-GB>
2026-03-28 22:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM63ETA/42811195?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=2NbmZDcOnFW6Po4d67twxE1bAr32VvI6Mv3oQSg7FqY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YM63%20ETA-GB>
2026-03-28 22:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994225/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP11OHH/42810859?sv=2020-08-04&st=2026-03-28T22%3A01%3A17Z&se=2026-03-28T22%3A26%3A17Z&sr=b&sp=r&sig=b7CgL1od%2BxWYmvFyCkZBnwP%2Fc8hvRbuQDmBfA%2FtGEC4%3D)
2026-03-28 22:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV70UZS/42810918?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=OuGBCg%2BAeGR0D2f%2BeITBsmUKuqiSK1uvUwiSvUi6IQs%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT71NEN/42810987?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=rH6uqkSHrsaaYdvpCA%2FsZzV6mE0zUHVzVmdfRT1wrj0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG14YNA/42808187?sv=2020-08-04&st=2026-03-28T22%3A01%3A55Z&se=2026-03-28T22%3A26%3A55Z&sr=b&sp=r&sig=DGiN%2BSfP9fEeRz4iomC5Qiv6ES1KZsQ9RCNgoJLwpnk%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY65OSN/42811345?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=nIVSbgrO1i9Xr%2BfbSLpc%2BtaM0zcISF5O%2FO1r76QJkIA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN69YVF/42797384?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=2YQhuVPOEs8nllGGk7BCLIWyloC%2FrwsAAUaDV7wMkMk%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554942790>
2026-03-28 22:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60dbac76-bcbf-5733-bcb6-c737b1fd8a76/60dbac76-bcbf-5733-bcb6-c737b1fd8a76_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEU05FSN%252F699080002%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080002/600 saved to cache
2026-03-28 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60dbac76-bcbf-5733-bcb6-c737b1fd8a76
2026-03-28 22:01:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60dbac76-bcbf-5733-bcb6-c737b1fd8a76, skipping ID generation
2026-03-28 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60dbac76-bcbf-5733-bcb6-c737b1fd8a76 sending to next pipeline
2026-03-28 22:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 60dbac76-bcbf-5733-bcb6-c737b1fd8a76, identifier: EU05%20FSN
2026-03-28 22:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544b7c10>
2026-03-28 22:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82f1ca74-f3e3-557a-9800-72143e39903a/82f1ca74-f3e3-557a-9800-72143e39903a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML19YFV%252F699083413%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083413/600 saved to cache
2026-03-28 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82f1ca74-f3e3-557a-9800-72143e39903a
2026-03-28 22:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474ed390>
2026-03-28 22:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82f1ca74-f3e3-557a-9800-72143e39903a/82f1ca74-f3e3-557a-9800-72143e39903a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML19YFV%252F699083388%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083388/600 saved to cache
2026-03-28 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82f1ca74-f3e3-557a-9800-72143e39903a
2026-03-28 22:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477da390>
2026-03-28 22:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82f1ca74-f3e3-557a-9800-72143e39903a/82f1ca74-f3e3-557a-9800-72143e39903a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML19YFV%252F699083399%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083399/600 saved to cache
2026-03-28 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82f1ca74-f3e3-557a-9800-72143e39903a
2026-03-28 22:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471376d0>
2026-03-28 22:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82f1ca74-f3e3-557a-9800-72143e39903a/82f1ca74-f3e3-557a-9800-72143e39903a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML19YFV%252F699083378%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083378/600 saved to cache
2026-03-28 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82f1ca74-f3e3-557a-9800-72143e39903a
2026-03-28 22:01:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82f1ca74-f3e3-557a-9800-72143e39903a, skipping ID generation
2026-03-28 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82f1ca74-f3e3-557a-9800-72143e39903a sending to next pipeline
2026-03-28 22:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 82f1ca74-f3e3-557a-9800-72143e39903a, identifier: ML19%20YFV
2026-03-28 22:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 60dbac76-bcbf-5733-bcb6-c737b1fd8a76 with identifier: EU05%20FSN
2026-03-28 22:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 60dbac76-bcbf-5733-bcb6-c737b1fd8a76 with identifier: EU05%20FSN
2026-03-28 22:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 60dbac76-bcbf-5733-bcb6-c737b1fd8a76 with identifier: EU05%20FSN to the API
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080002/600>
{'auction_title': '',
'c_o_2_emission_value': 435,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dbac76-bcbf-5733-bcb6-c737b1fd8a76/60dbac76-bcbf-5733-bcb6-c737b1fd8a76_expert_report_file_7358bf1b-9249-4f79-bfae-ba01ab3c6761.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EU05%20FSN-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '4.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '60dbac76-bcbf-5733-bcb6-c737b1fd8a76',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EU05 FSN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EU05%20FSN&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MASERATI',
'model': 'GRANSPORT',
'odometer': 50182,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dbac76-bcbf-5733-bcb6-c737b1fd8a76/60dbac76-bcbf-5733-bcb6-c737b1fd8a76_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176270,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699079991/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dbac76-bcbf-5733-bcb6-c737b1fd8a76/60dbac76-bcbf-5733-bcb6-c737b1fd8a76_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 167536,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080002/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dbac76-bcbf-5733-bcb6-c737b1fd8a76/60dbac76-bcbf-5733-bcb6-c737b1fd8a76_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 166301,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080015/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dbac76-bcbf-5733-bcb6-c737b1fd8a76/60dbac76-bcbf-5733-bcb6-c737b1fd8a76_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 169720,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080023/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dbac76-bcbf-5733-bcb6-c737b1fd8a76/60dbac76-bcbf-5733-bcb6-c737b1fd8a76_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 160937,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080037/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dbac76-bcbf-5733-bcb6-c737b1fd8a76/60dbac76-bcbf-5733-bcb6-c737b1fd8a76_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139293,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080053/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dbac76-bcbf-5733-bcb6-c737b1fd8a76/60dbac76-bcbf-5733-bcb6-c737b1fd8a76_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171309,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080061/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dbac76-bcbf-5733-bcb6-c737b1fd8a76/60dbac76-bcbf-5733-bcb6-c737b1fd8a76_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 163612,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080071/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dbac76-bcbf-5733-bcb6-c737b1fd8a76/60dbac76-bcbf-5733-bcb6-c737b1fd8a76_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 161726,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU05FSN/699080079/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'MASERATI GRANSPORT 4.2 V8 Coupe',
'transmission': 'automatic',
'trim': 'V8',
'vin': 'ZAMEC38C000017728',
'year': 2005}
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU05%2520FSN%27 HTTP/1.1" 200 None
2026-03-28 22:01:57 [bca.uk] INFO: Saving data for EU05%20FSN: {'created_time': 1774735317.989663, 'last_price_update_time': 1774735317.989674, 'auction_closing_time': 1774951200.0}
2026-03-28 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EU05%2520FSN') HTTP/1.1" 204 0
2026-03-28 22:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 82f1ca74-f3e3-557a-9800-72143e39903a with identifier: ML19%20YFV
2026-03-28 22:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 82f1ca74-f3e3-557a-9800-72143e39903a with identifier: ML19%20YFV
2026-03-28 22:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 82f1ca74-f3e3-557a-9800-72143e39903a with identifier: ML19%20YFV to the API
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083378/600>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82f1ca74-f3e3-557a-9800-72143e39903a/82f1ca74-f3e3-557a-9800-72143e39903a_expert_report_file_8910a6b8-6157-408e-bc51-31f24951997a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ML19%20YFV-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '82f1ca74-f3e3-557a-9800-72143e39903a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ML19 YFV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ML19%20YFV&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 16032,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82f1ca74-f3e3-557a-9800-72143e39903a/82f1ca74-f3e3-557a-9800-72143e39903a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46944,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083359/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82f1ca74-f3e3-557a-9800-72143e39903a/82f1ca74-f3e3-557a-9800-72143e39903a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45587,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083370/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82f1ca74-f3e3-557a-9800-72143e39903a/82f1ca74-f3e3-557a-9800-72143e39903a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42927,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083378/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82f1ca74-f3e3-557a-9800-72143e39903a/82f1ca74-f3e3-557a-9800-72143e39903a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40616,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083388/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82f1ca74-f3e3-557a-9800-72143e39903a/82f1ca74-f3e3-557a-9800-72143e39903a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38935,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083399/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82f1ca74-f3e3-557a-9800-72143e39903a/82f1ca74-f3e3-557a-9800-72143e39903a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38687,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083413/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82f1ca74-f3e3-557a-9800-72143e39903a/82f1ca74-f3e3-557a-9800-72143e39903a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86394,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083424/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82f1ca74-f3e3-557a-9800-72143e39903a/82f1ca74-f3e3-557a-9800-72143e39903a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73080,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083442/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82f1ca74-f3e3-557a-9800-72143e39903a/82f1ca74-f3e3-557a-9800-72143e39903a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81195,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083461/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82f1ca74-f3e3-557a-9800-72143e39903a/82f1ca74-f3e3-557a-9800-72143e39903a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76185,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML19YFV/699083480/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.0 EVO 80 SE Hatchback',
'transmission': 'manual',
'trim': 'EVO 80 SE',
'vin': 'WVWZZZAWZKU049432',
'year': 2019}
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML19%2520YFV%27 HTTP/1.1" 200 None
2026-03-28 22:01:58 [bca.uk] INFO: Saving data for ML19%20YFV: {'created_time': 1774735318.410419, 'last_price_update_time': 1774735318.410431, 'auction_closing_time': 1774951200.0}
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ML19%2520YFV') HTTP/1.1" 204 0
2026-03-28 22:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071336/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071336>
2026-03-28 22:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142764/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WU66XNV/42811422?sv=2020-08-04&st=2026-03-28T22%3A01%3A16Z&se=2026-03-28T22%3A26%3A16Z&sr=b&sp=r&sig=iEWCiRexucMVz979VRM55ID%2B0dAdHnqV0R4MKdIaGkA%3D)
2026-03-28 22:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994170/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994170>
2026-03-28 22:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142749/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142749>
2026-03-28 22:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD64FZX/42811100?sv=2020-08-04&st=2026-03-28T22%3A01%3A57Z&se=2026-03-28T22%3A26%3A57Z&sr=b&sp=r&sig=Dwyi0onZG26vosKetvMpU1c04CHcIlFHDTCIHVQ3O7A%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD64%20FZX-GB>
2026-03-28 22:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HS19GYN/42810950?sv=2020-08-04&st=2026-03-28T22%3A01%3A57Z&se=2026-03-28T22%3A26%3A57Z&sr=b&sp=r&sig=96MKHybbSRUkGdibvkSkCtuF%2FChn%2BRdVR1EkP2SXC%2FI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HS19%20GYN-GB>
2026-03-28 22:01:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477a57d0>
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9153a9c4-5990-5981-85ad-c93a9119ac4b/9153a9c4-5990-5981-85ad-c93a9119ac4b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP11OHH%252F698994225%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994225/600 saved to cache
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9153a9c4-5990-5981-85ad-c93a9119ac4b
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547107550>
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c249da5-1d51-5bc9-a40c-4417dbaa5b62/9c249da5-1d51-5bc9-a40c-4417dbaa5b62_expert_report_file_c8b94598-516c-4261-873f-13d1d2094a58.pdf HTTP/1.1" 201 0
2026-03-28 22:01:58 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9c249da5-1d51-5bc9-a40c-4417dbaa5b62
2026-03-28 22:01:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c249da5-1d51-5bc9-a40c-4417dbaa5b62, skipping ID generation
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9c249da5-1d51-5bc9-a40c-4417dbaa5b62
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBV70UZS-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BV70UZS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547783cd0>
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5421d270-4706-56d4-861e-d213204bb57b/5421d270-4706-56d4-861e-d213204bb57b_expert_report_file_aab5f253-0af3-4abf-bf5d-c25f1ddf6163.pdf HTTP/1.1" 201 0
2026-03-28 22:01:58 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5421d270-4706-56d4-861e-d213204bb57b
2026-03-28 22:01:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5421d270-4706-56d4-861e-d213204bb57b, skipping ID generation
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5421d270-4706-56d4-861e-d213204bb57b
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMT71NEN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MT71NEN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474df0d0>
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_238a280e-8233-56ab-b3e9-1e6814e8a2fb/238a280e-8233-56ab-b3e9-1e6814e8a2fb_expert_report_file_785555aa-4c8b-4dff-ad1d-f2c8f3a1e9ab.pdf HTTP/1.1" 201 0
2026-03-28 22:01:58 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 238a280e-8233-56ab-b3e9-1e6814e8a2fb
2026-03-28 22:01:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 238a280e-8233-56ab-b3e9-1e6814e8a2fb, skipping ID generation
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 238a280e-8233-56ab-b3e9-1e6814e8a2fb
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDG14YNA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DG14YNA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473c8050>
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c536c8-20b9-5eb5-bd31-426ff92c052b/d4c536c8-20b9-5eb5-bd31-426ff92c052b_expert_report_file_0f872af8-a49e-4739-8299-461dd235b5fe.pdf HTTP/1.1" 201 0
2026-03-28 22:01:58 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d4c536c8-20b9-5eb5-bd31-426ff92c052b
2026-03-28 22:01:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4c536c8-20b9-5eb5-bd31-426ff92c052b, skipping ID generation
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d4c536c8-20b9-5eb5-bd31-426ff92c052b
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFY65OSN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FY65OSN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557364150>
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0d2c8c1-587d-52a8-bac1-4dade51bc1df/b0d2c8c1-587d-52a8-bac1-4dade51bc1df_expert_report_file_0e7a6942-a5d6-4520-914b-327291407560.pdf HTTP/1.1" 201 0
2026-03-28 22:01:58 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b0d2c8c1-587d-52a8-bac1-4dade51bc1df
2026-03-28 22:01:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0d2c8c1-587d-52a8-bac1-4dade51bc1df, skipping ID generation
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b0d2c8c1-587d-52a8-bac1-4dade51bc1df
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCN69YVF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CN69YVF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071352/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG16XLF/42811219?sv=2020-08-04&st=2026-03-28T22%3A01%3A19Z&se=2026-03-28T22%3A26%3A19Z&sr=b&sp=r&sig=piDa4JVgaWBzjvnw0OZ1irSwQFsxpWFyq8MJd75hPTs%3D)
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023437%27 HTTP/1.1" 200 None
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023437 not downloaded yet
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699032890%27 HTTP/1.1" 200 None
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032890 not downloaded yet
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188570%27 HTTP/1.1" 200 None
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188570 not downloaded yet
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110942%27 HTTP/1.1" 200 None
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110942 not downloaded yet
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188490%27 HTTP/1.1" 200 None
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188490 not downloaded yet
2026-03-28 22:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA57YVV/42811409?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=nyWRKONE8HKvE1Bd8e5fHoTy4qWWUPVu8%2FwiG6QJKuE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994149/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994149>
2026-03-28 22:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071320/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071320>
2026-03-28 22:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP59FDN/42810928?sv=2020-08-04&st=2026-03-28T22%3A01%3A58Z&se=2026-03-28T22%3A26%3A58Z&sr=b&sp=r&sig=ZbUiVX8NyRKy%2F6YCWkg131AVlNtT%2BzZ%2B1LicpDOBetc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SP59%20FDN-GB>
2026-03-28 22:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF13XPW/42811334?sv=2020-08-04&st=2026-03-28T22%3A01%3A58Z&se=2026-03-28T22%3A26%3A58Z&sr=b&sp=r&sig=IaKRLAZfI72tCuDzXhHdVv5UuGmFx5%2Bys8PCMcTmf1c%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AF13%20XPW-GB>
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023447%27 HTTP/1.1" 200 None
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023447 not downloaded yet
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699032900%27 HTTP/1.1" 200 None
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032900 not downloaded yet
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188577%27 HTTP/1.1" 200 None
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188577 not downloaded yet
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093922%27 HTTP/1.1" 200 None
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093922 not downloaded yet
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188494%27 HTTP/1.1" 200 None
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188494 not downloaded yet
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547137990>
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51da0f1d-592f-5dda-b1f6-cadeb5cfb790/51da0f1d-592f-5dda-b1f6-cadeb5cfb790_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWU66XNV%252F699142764%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142764/600 saved to cache
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 51da0f1d-592f-5dda-b1f6-cadeb5cfb790
2026-03-28 22:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699126482/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126482>
2026-03-28 22:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071302/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071302>
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023461%27 HTTP/1.1" 200 None
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023461 not downloaded yet
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699032912%27 HTTP/1.1" 200 None
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032912 not downloaded yet
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188583%27 HTTP/1.1" 200 None
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188583 not downloaded yet
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110957%27 HTTP/1.1" 200 None
2026-03-28 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110957 not downloaded yet
2026-03-28 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188503%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188503 not downloaded yet
2026-03-28 22:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA21OVG/42811124?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=V82shKhtqB4rTcaiwqPXnkTP%2BoliWo3nMVb6T0BN5SU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55749a950>
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1/87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG16XLF%252F699071352%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071352/600 saved to cache
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1
2026-03-28 22:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM63ETA/42811195?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=2NbmZDcOnFW6Po4d67twxE1bAr32VvI6Mv3oQSg7FqY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142749/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WU66XNV/42811422?sv=2020-08-04&st=2026-03-28T22%3A01%3A16Z&se=2026-03-28T22%3A26%3A16Z&sr=b&sp=r&sig=iEWCiRexucMVz979VRM55ID%2B0dAdHnqV0R4MKdIaGkA%3D)
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023473%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023473 not downloaded yet
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699032926%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032926 not downloaded yet
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188588%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188588 not downloaded yet
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093933%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093933 not downloaded yet
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188509%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188509 not downloaded yet
2026-03-28 22:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994170/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP11OHH/42810859?sv=2020-08-04&st=2026-03-28T22%3A01%3A17Z&se=2026-03-28T22%3A26%3A17Z&sr=b&sp=r&sig=b7CgL1od%2BxWYmvFyCkZBnwP%2Fc8hvRbuQDmBfA%2FtGEC4%3D)
2026-03-28 22:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HS19GYN/42810950?sv=2020-08-04&st=2026-03-28T22%3A01%3A57Z&se=2026-03-28T22%3A26%3A57Z&sr=b&sp=r&sig=96MKHybbSRUkGdibvkSkCtuF%2FChn%2BRdVR1EkP2SXC%2FI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD64FZX/42811100?sv=2020-08-04&st=2026-03-28T22%3A01%3A57Z&se=2026-03-28T22%3A26%3A57Z&sr=b&sp=r&sig=Dwyi0onZG26vosKetvMpU1c04CHcIlFHDTCIHVQ3O7A%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188480/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CN69YVF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:01:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DY13XDF/42810869?sv=2020-08-04&st=2026-03-28T22%3A01%3A59Z&se=2026-03-28T22%3A26%3A59Z&sr=b&sp=r&sig=FCMXSpevxSyZRl0Z0VANwCsNVYcTGX2VuTfaZYnad0M%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DY13%20XDF-GB>
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023482%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023482 not downloaded yet
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699032941%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032941 not downloaded yet
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188594%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188594 not downloaded yet
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110963%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110963 not downloaded yet
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188516%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188516 not downloaded yet
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472b0ed0>
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_088c09e3-d7eb-592d-ab1c-79cc7e5bdf02/088c09e3-d7eb-592d-ab1c-79cc7e5bdf02_expert_report_file_1d97c261-2351-4d24-9f12-a8d51cdc93b4.pdf HTTP/1.1" 201 0
2026-03-28 22:01:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02
2026-03-28 22:01:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02, skipping ID generation
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCA57YVV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CA57YVV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071336/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG16XLF/42811219?sv=2020-08-04&st=2026-03-28T22%3A01%3A19Z&se=2026-03-28T22%3A26%3A19Z&sr=b&sp=r&sig=piDa4JVgaWBzjvnw0OZ1irSwQFsxpWFyq8MJd75hPTs%3D)
2026-03-28 22:01:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110925/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FY65OSN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023504%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023504 not downloaded yet
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699032976%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032976 not downloaded yet
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188607%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188607 not downloaded yet
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093941%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093941 not downloaded yet
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188536%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188536 not downloaded yet
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143521%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143521 not downloaded yet
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54710d250>
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d1c14a-d5f3-5567-89ad-8d86774c1313/87d1c14a-d5f3-5567-89ad-8d86774c1313_expert_report_file_33c39f18-f868-44bc-b64a-9ed199cf37ce.pdf HTTP/1.1" 201 0
2026-03-28 22:01:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 87d1c14a-d5f3-5567-89ad-8d86774c1313
2026-03-28 22:01:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87d1c14a-d5f3-5567-89ad-8d86774c1313, skipping ID generation
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 87d1c14a-d5f3-5567-89ad-8d86774c1313
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCA21OVG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CA21OVG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994149/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP11OHH/42810859?sv=2020-08-04&st=2026-03-28T22%3A01%3A17Z&se=2026-03-28T22%3A26%3A17Z&sr=b&sp=r&sig=b7CgL1od%2BxWYmvFyCkZBnwP%2Fc8hvRbuQDmBfA%2FtGEC4%3D)
2026-03-28 22:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699126482/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WU66XNV/42811422?sv=2020-08-04&st=2026-03-28T22%3A01%3A16Z&se=2026-03-28T22%3A26%3A16Z&sr=b&sp=r&sig=iEWCiRexucMVz979VRM55ID%2B0dAdHnqV0R4MKdIaGkA%3D)
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023529%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023529 not downloaded yet
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699033000%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699033000 not downloaded yet
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188617%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188617 not downloaded yet
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110973%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110973 not downloaded yet
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188550%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188550 not downloaded yet
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143530%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143530 not downloaded yet
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699060067%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060067 not downloaded yet
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b52f10>
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595887ba-7187-5162-8a50-188caa6efdd9/595887ba-7187-5162-8a50-188caa6efdd9_expert_report_file_509397fe-228c-4255-8570-c41f3683e1e5.pdf HTTP/1.1" 201 0
2026-03-28 22:01:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 595887ba-7187-5162-8a50-188caa6efdd9
2026-03-28 22:01:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 595887ba-7187-5162-8a50-188caa6efdd9, skipping ID generation
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 595887ba-7187-5162-8a50-188caa6efdd9
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYM63ETA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YM63ETA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554299810>
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51da0f1d-592f-5dda-b1f6-cadeb5cfb790/51da0f1d-592f-5dda-b1f6-cadeb5cfb790_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWU66XNV%252F699142749%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142749/600 saved to cache
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 51da0f1d-592f-5dda-b1f6-cadeb5cfb790
2026-03-28 22:01:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:01:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:01:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:01:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55497bc10>
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9153a9c4-5990-5981-85ad-c93a9119ac4b/9153a9c4-5990-5981-85ad-c93a9119ac4b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP11OHH%252F698994170%252F600') HTTP/1.1" 204 0
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994170/600 saved to cache
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9153a9c4-5990-5981-85ad-c93a9119ac4b
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55491d450>
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_546eaaae-2d78-532a-abb1-eac4aea0023f/546eaaae-2d78-532a-abb1-eac4aea0023f_expert_report_file_cb4882e9-26b8-4155-a7cb-1498a2ef0809.pdf HTTP/1.1" 201 0
2026-03-28 22:01:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 546eaaae-2d78-532a-abb1-eac4aea0023f
2026-03-28 22:01:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 546eaaae-2d78-532a-abb1-eac4aea0023f, skipping ID generation
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 546eaaae-2d78-532a-abb1-eac4aea0023f
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHS19GYN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HS19GYN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473c94d0>
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_534d9bbb-c0a6-50f4-bc13-9009bdc08d59/534d9bbb-c0a6-50f4-bc13-9009bdc08d59_expert_report_file_88686304-2464-4fb8-ac15-bbeabde242cb.pdf HTTP/1.1" 201 0
2026-03-28 22:01:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 534d9bbb-c0a6-50f4-bc13-9009bdc08d59
2026-03-28 22:01:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 534d9bbb-c0a6-50f4-bc13-9009bdc08d59, skipping ID generation
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 534d9bbb-c0a6-50f4-bc13-9009bdc08d59
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLD64FZX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD64FZX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF13XPW/42811334?sv=2020-08-04&st=2026-03-28T22%3A01%3A58Z&se=2026-03-28T22%3A26%3A58Z&sr=b&sp=r&sig=IaKRLAZfI72tCuDzXhHdVv5UuGmFx5%2Bys8PCMcTmf1c%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071320/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG16XLF/42811219?sv=2020-08-04&st=2026-03-28T22%3A01%3A19Z&se=2026-03-28T22%3A26%3A19Z&sr=b&sp=r&sig=piDa4JVgaWBzjvnw0OZ1irSwQFsxpWFyq8MJd75hPTs%3D)
2026-03-28 22:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071302/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG16XLF/42811219?sv=2020-08-04&st=2026-03-28T22%3A01%3A19Z&se=2026-03-28T22%3A26%3A19Z&sr=b&sp=r&sig=piDa4JVgaWBzjvnw0OZ1irSwQFsxpWFyq8MJd75hPTs%3D)
2026-03-28 22:01:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188494/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188494>
2026-03-28 22:01:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188503/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188503>
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023554%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023554 not downloaded yet
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699033023%27 HTTP/1.1" 200 None
2026-03-28 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699033023 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188631%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188631 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093951%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093951 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188563%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188563 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143540%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143540 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699060079%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060079 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074168%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074168 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038707%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038707 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699049702%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049702 not downloaded yet
2026-03-28 22:02:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554aa3690>
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1/87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG16XLF%252F699071336%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071336/600 saved to cache
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1
2026-03-28 22:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP59FDN/42810928?sv=2020-08-04&st=2026-03-28T22%3A01%3A58Z&se=2026-03-28T22%3A26%3A58Z&sr=b&sp=r&sig=ZbUiVX8NyRKy%2F6YCWkg131AVlNtT%2BzZ%2B1LicpDOBetc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110957/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110957>
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023578%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023578 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699033043%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699033043 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188642%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188642 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110982%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110982 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188575%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188575 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143555%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143555 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699060095%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060095 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074173%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074173 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038720%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038720 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699049712%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049712 not downloaded yet
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55429a950>
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9153a9c4-5990-5981-85ad-c93a9119ac4b/9153a9c4-5990-5981-85ad-c93a9119ac4b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP11OHH%252F698994149%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994149/600 saved to cache
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9153a9c4-5990-5981-85ad-c93a9119ac4b
2026-03-28 22:02:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54713ff90>
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51da0f1d-592f-5dda-b1f6-cadeb5cfb790/51da0f1d-592f-5dda-b1f6-cadeb5cfb790_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWU66XNV%252F699126482%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699126482/600 saved to cache
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 51da0f1d-592f-5dda-b1f6-cadeb5cfb790
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554280bd0>
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c23f5d21-755d-59bb-a7da-864dc76d3107/c23f5d21-755d-59bb-a7da-864dc76d3107_expert_report_file_81cb98c6-b82a-47dd-a656-87ae9f6c0b90.pdf HTTP/1.1" 201 0
2026-03-28 22:02:00 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c23f5d21-755d-59bb-a7da-864dc76d3107
2026-03-28 22:02:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c23f5d21-755d-59bb-a7da-864dc76d3107, skipping ID generation
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c23f5d21-755d-59bb-a7da-864dc76d3107
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAF13XPW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AF13XPW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55428a650>
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1/87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG16XLF%252F699071320%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071320/600 saved to cache
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1
2026-03-28 22:02:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547372f10>
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1/87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG16XLF%252F699071302%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071302/600 saved to cache
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1
2026-03-28 22:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188480/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN69YVF/42797384?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=2YQhuVPOEs8nllGGk7BCLIWyloC%2FrwsAAUaDV7wMkMk%3D)
2026-03-28 22:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110925/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY65OSN/42811345?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=nIVSbgrO1i9Xr%2BfbSLpc%2BtaM0zcISF5O%2FO1r76QJkIA%3D)
2026-03-28 22:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188588/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188588>
2026-03-28 22:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699093933/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093933>
2026-03-28 22:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188509/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188509>
2026-03-28 22:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143511/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CA57YVV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143570%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143570 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699060107%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060107 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074178%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074178 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038730%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038730 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699049720%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049720 not downloaded yet
2026-03-28 22:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DY13XDF/42810869?sv=2020-08-04&st=2026-03-28T22%3A01%3A59Z&se=2026-03-28T22%3A26%3A59Z&sr=b&sp=r&sig=FCMXSpevxSyZRl0Z0VANwCsNVYcTGX2VuTfaZYnad0M%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060057/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CA21OVG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110902%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110902 not downloaded yet
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547700990>
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3459172-6804-5615-b390-f6fc4febd79c/f3459172-6804-5615-b390-f6fc4febd79c_expert_report_file_6158ed19-1997-4058-b190-e2610ad86d64.pdf HTTP/1.1" 201 0
2026-03-28 22:02:00 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f3459172-6804-5615-b390-f6fc4febd79c
2026-03-28 22:02:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3459172-6804-5615-b390-f6fc4febd79c, skipping ID generation
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f3459172-6804-5615-b390-f6fc4febd79c
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSP59FDN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SP59FDN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143597%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143597 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699060113%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060113 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074184%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074184 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038738%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038738 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699049729%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049729 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110914%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110914 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011566%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011566 not downloaded yet
2026-03-28 22:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188503/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN69YVF/42797384?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=2YQhuVPOEs8nllGGk7BCLIWyloC%2FrwsAAUaDV7wMkMk%3D)
2026-03-28 22:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110957/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY65OSN/42811345?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=nIVSbgrO1i9Xr%2BfbSLpc%2BtaM0zcISF5O%2FO1r76QJkIA%3D)
2026-03-28 22:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188494/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN69YVF/42797384?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=2YQhuVPOEs8nllGGk7BCLIWyloC%2FrwsAAUaDV7wMkMk%3D)
2026-03-28 22:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143521/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143521>
2026-03-28 22:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060067/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060067>
2026-03-28 22:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038692/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HS19GYN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074164/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YM63ETA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049693/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD64FZX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143622%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143622 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699060128%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060128 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074188%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074188 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038751%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038751 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699049739%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049739 not downloaded yet
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110924%27 HTTP/1.1" 200 None
2026-03-28 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110924 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011575%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011575 not downloaded yet
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547326550>
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0d2c8c1-587d-52a8-bac1-4dade51bc1df/b0d2c8c1-587d-52a8-bac1-4dade51bc1df_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN69YVF%252F699188480%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188480/600 saved to cache
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0d2c8c1-587d-52a8-bac1-4dade51bc1df
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f95550>
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c536c8-20b9-5eb5-bd31-426ff92c052b/d4c536c8-20b9-5eb5-bd31-426ff92c052b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY65OSN%252F699110925%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110925/600 saved to cache
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4c536c8-20b9-5eb5-bd31-426ff92c052b
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473b3fd0>
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c155e91-825b-5797-9727-36735366f7f9/6c155e91-825b-5797-9727-36735366f7f9_expert_report_file_73fa36eb-ef32-4104-9345-aaab0be16e8e.pdf HTTP/1.1" 201 0
2026-03-28 22:02:01 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6c155e91-825b-5797-9727-36735366f7f9
2026-03-28 22:02:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c155e91-825b-5797-9727-36735366f7f9, skipping ID generation
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6c155e91-825b-5797-9727-36735366f7f9
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDY13XDF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DY13XDF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143640%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143640 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699060148%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060148 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074199%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074199 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038773%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038773 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699049755%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049755 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110937%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110937 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011578%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011578 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994752%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994752 not downloaded yet
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54748f190>
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0d2c8c1-587d-52a8-bac1-4dade51bc1df/b0d2c8c1-587d-52a8-bac1-4dade51bc1df_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN69YVF%252F699188503%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188503/600 saved to cache
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b0d2c8c1-587d-52a8-bac1-4dade51bc1df
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55427abd0>
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c536c8-20b9-5eb5-bd31-426ff92c052b/d4c536c8-20b9-5eb5-bd31-426ff92c052b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY65OSN%252F699110957%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110957/600 saved to cache
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d4c536c8-20b9-5eb5-bd31-426ff92c052b
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472926d0>
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0d2c8c1-587d-52a8-bac1-4dade51bc1df/b0d2c8c1-587d-52a8-bac1-4dade51bc1df_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN69YVF%252F699188494%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188494/600 saved to cache
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b0d2c8c1-587d-52a8-bac1-4dade51bc1df
2026-03-28 22:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699093933/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY65OSN/42811345?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=nIVSbgrO1i9Xr%2BfbSLpc%2BtaM0zcISF5O%2FO1r76QJkIA%3D)
2026-03-28 22:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143511/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA57YVV/42811409?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=nyWRKONE8HKvE1Bd8e5fHoTy4qWWUPVu8%2FwiG6QJKuE%3D)
2026-03-28 22:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188509/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN69YVF/42797384?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=2YQhuVPOEs8nllGGk7BCLIWyloC%2FrwsAAUaDV7wMkMk%3D)
2026-03-28 22:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060057/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA21OVG/42811124?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=V82shKhtqB4rTcaiwqPXnkTP%2BoliWo3nMVb6T0BN5SU%3D)
2026-03-28 22:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188588/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG14YNA/42808187?sv=2020-08-04&st=2026-03-28T22%3A01%3A55Z&se=2026-03-28T22%3A26%3A55Z&sr=b&sp=r&sig=DGiN%2BSfP9fEeRz4iomC5Qiv6ES1KZsQ9RCNgoJLwpnk%3D)
2026-03-28 22:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049712/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049712>
2026-03-28 22:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038720/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038720>
2026-03-28 22:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110892/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AF13XPW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143664%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143664 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699060169%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060169 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074203%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074203 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038787%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038787 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699049778%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049778 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110953%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110953 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011589%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011589 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994775%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994775 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699060189%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060189 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074210%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074210 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038817%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038817 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699049801%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049801 not downloaded yet
2026-03-28 22:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049693/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD64FZX/42811100?sv=2020-08-04&st=2026-03-28T22%3A01%3A57Z&se=2026-03-28T22%3A26%3A57Z&sr=b&sp=r&sig=Dwyi0onZG26vosKetvMpU1c04CHcIlFHDTCIHVQ3O7A%3D)
2026-03-28 22:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074164/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM63ETA/42811195?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=2NbmZDcOnFW6Po4d67twxE1bAr32VvI6Mv3oQSg7FqY%3D)
2026-03-28 22:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038692/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HS19GYN/42810950?sv=2020-08-04&st=2026-03-28T22%3A01%3A57Z&se=2026-03-28T22%3A26%3A57Z&sr=b&sp=r&sig=96MKHybbSRUkGdibvkSkCtuF%2FChn%2BRdVR1EkP2SXC%2FI%3D)
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110971%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110971 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011593%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011593 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994791%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994791 not downloaded yet
2026-03-28 22:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110914/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110914>
2026-03-28 22:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049729/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049729>
2026-03-28 22:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011566/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011566>
2026-03-28 22:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060067/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA21OVG/42811124?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=V82shKhtqB4rTcaiwqPXnkTP%2BoliWo3nMVb6T0BN5SU%3D)
2026-03-28 22:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143521/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA57YVV/42811409?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=nyWRKONE8HKvE1Bd8e5fHoTy4qWWUPVu8%2FwiG6QJKuE%3D)
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074217%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074217 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038842%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038842 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699049819%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049819 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110990%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110990 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011600%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011600 not downloaded yet
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994813%27 HTTP/1.1" 200 None
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994813 not downloaded yet
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549b2b10>
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c536c8-20b9-5eb5-bd31-426ff92c052b/d4c536c8-20b9-5eb5-bd31-426ff92c052b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY65OSN%252F699093933%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699093933/600 saved to cache
2026-03-28 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d4c536c8-20b9-5eb5-bd31-426ff92c052b
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554915d90>
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_088c09e3-d7eb-592d-ab1c-79cc7e5bdf02/088c09e3-d7eb-592d-ab1c-79cc7e5bdf02_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA57YVV%252F699143511%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143511/600 saved to cache
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542dbf50>
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0d2c8c1-587d-52a8-bac1-4dade51bc1df/b0d2c8c1-587d-52a8-bac1-4dade51bc1df_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN69YVF%252F699188509%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188509/600 saved to cache
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b0d2c8c1-587d-52a8-bac1-4dade51bc1df
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b417d0>
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d1c14a-d5f3-5567-89ad-8d86774c1313/87d1c14a-d5f3-5567-89ad-8d86774c1313_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA21OVG%252F699060057%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060057/600 saved to cache
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87d1c14a-d5f3-5567-89ad-8d86774c1313
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473eb0d0>
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_238a280e-8233-56ab-b3e9-1e6814e8a2fb/238a280e-8233-56ab-b3e9-1e6814e8a2fb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG14YNA%252F699188588%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188588/600 saved to cache
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 238a280e-8233-56ab-b3e9-1e6814e8a2fb
2026-03-28 22:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049712/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD64FZX/42811100?sv=2020-08-04&st=2026-03-28T22%3A01%3A57Z&se=2026-03-28T22%3A26%3A57Z&sr=b&sp=r&sig=Dwyi0onZG26vosKetvMpU1c04CHcIlFHDTCIHVQ3O7A%3D)
2026-03-28 22:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038720/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HS19GYN/42810950?sv=2020-08-04&st=2026-03-28T22%3A01%3A57Z&se=2026-03-28T22%3A26%3A57Z&sr=b&sp=r&sig=96MKHybbSRUkGdibvkSkCtuF%2FChn%2BRdVR1EkP2SXC%2FI%3D)
2026-03-28 22:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110892/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF13XPW/42811334?sv=2020-08-04&st=2026-03-28T22%3A01%3A58Z&se=2026-03-28T22%3A26%3A58Z&sr=b&sp=r&sig=IaKRLAZfI72tCuDzXhHdVv5UuGmFx5%2Bys8PCMcTmf1c%3D)
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699111015%27 HTTP/1.1" 200 None
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699111015 not downloaded yet
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011611%27 HTTP/1.1" 200 None
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011611 not downloaded yet
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994828%27 HTTP/1.1" 200 None
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994828 not downloaded yet
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547201e50>
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_534d9bbb-c0a6-50f4-bc13-9009bdc08d59/534d9bbb-c0a6-50f4-bc13-9009bdc08d59_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD64FZX%252F699049693%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049693/600 saved to cache
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 534d9bbb-c0a6-50f4-bc13-9009bdc08d59
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547324a50>
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595887ba-7187-5162-8a50-188caa6efdd9/595887ba-7187-5162-8a50-188caa6efdd9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM63ETA%252F699074164%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074164/600 saved to cache
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 595887ba-7187-5162-8a50-188caa6efdd9
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f94cd0>
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_546eaaae-2d78-532a-abb1-eac4aea0023f/546eaaae-2d78-532a-abb1-eac4aea0023f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHS19GYN%252F699038692%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038692/600 saved to cache
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 546eaaae-2d78-532a-abb1-eac4aea0023f
2026-03-28 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049755/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049755>
2026-03-28 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060148/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060148>
2026-03-28 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038773/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038773>
2026-03-28 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143640/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143640>
2026-03-28 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074199/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074199>
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699111030%27 HTTP/1.1" 200 None
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699111030 not downloaded yet
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011617%27 HTTP/1.1" 200 None
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011617 not downloaded yet
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994857%27 HTTP/1.1" 200 None
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994857 not downloaded yet
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554956a10>
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d1c14a-d5f3-5567-89ad-8d86774c1313/87d1c14a-d5f3-5567-89ad-8d86774c1313_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA21OVG%252F699060067%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060067/600 saved to cache
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 87d1c14a-d5f3-5567-89ad-8d86774c1313
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54748ed50>
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_088c09e3-d7eb-592d-ab1c-79cc7e5bdf02/088c09e3-d7eb-592d-ab1c-79cc7e5bdf02_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA57YVV%252F699143521%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143521/600 saved to cache
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473836d0>
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_534d9bbb-c0a6-50f4-bc13-9009bdc08d59/534d9bbb-c0a6-50f4-bc13-9009bdc08d59_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD64FZX%252F699049712%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049712/600 saved to cache
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 534d9bbb-c0a6-50f4-bc13-9009bdc08d59
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fbce10>
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_546eaaae-2d78-532a-abb1-eac4aea0023f/546eaaae-2d78-532a-abb1-eac4aea0023f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHS19GYN%252F699038720%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038720/600 saved to cache
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 546eaaae-2d78-532a-abb1-eac4aea0023f
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557299350>
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c23f5d21-755d-59bb-a7da-864dc76d3107/c23f5d21-755d-59bb-a7da-864dc76d3107_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF13XPW%252F699110892%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110892/600 saved to cache
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c23f5d21-755d-59bb-a7da-864dc76d3107
2026-03-28 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110953/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110953>
2026-03-28 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011589/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011589>
2026-03-28 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994775/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994775>
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011621%27 HTTP/1.1" 200 None
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011621 not downloaded yet
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994876%27 HTTP/1.1" 200 None
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994876 not downloaded yet
2026-03-28 22:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110914/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF13XPW/42811334?sv=2020-08-04&st=2026-03-28T22%3A01%3A58Z&se=2026-03-28T22%3A26%3A58Z&sr=b&sp=r&sig=IaKRLAZfI72tCuDzXhHdVv5UuGmFx5%2Bys8PCMcTmf1c%3D)
2026-03-28 22:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049729/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD64FZX/42811100?sv=2020-08-04&st=2026-03-28T22%3A01%3A57Z&se=2026-03-28T22%3A26%3A57Z&sr=b&sp=r&sig=Dwyi0onZG26vosKetvMpU1c04CHcIlFHDTCIHVQ3O7A%3D)
2026-03-28 22:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011566/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP59FDN/42810928?sv=2020-08-04&st=2026-03-28T22%3A01%3A58Z&se=2026-03-28T22%3A26%3A58Z&sr=b&sp=r&sig=ZbUiVX8NyRKy%2F6YCWkg131AVlNtT%2BzZ%2B1LicpDOBetc%3D)
2026-03-28 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994791/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994791>
2026-03-28 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011593/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011593>
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994903%27 HTTP/1.1" 200 None
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994903 not downloaded yet
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994932%27 HTTP/1.1" 200 None
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994932 not downloaded yet
2026-03-28 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994813/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994813>
2026-03-28 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011600/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011600>
2026-03-28 22:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049755/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD64FZX/42811100?sv=2020-08-04&st=2026-03-28T22%3A01%3A57Z&se=2026-03-28T22%3A26%3A57Z&sr=b&sp=r&sig=Dwyi0onZG26vosKetvMpU1c04CHcIlFHDTCIHVQ3O7A%3D)
2026-03-28 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110990/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110990>
2026-03-28 22:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143640/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA57YVV/42811409?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=nyWRKONE8HKvE1Bd8e5fHoTy4qWWUPVu8%2FwiG6QJKuE%3D)
2026-03-28 22:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074199/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM63ETA/42811195?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=2NbmZDcOnFW6Po4d67twxE1bAr32VvI6Mv3oQSg7FqY%3D)
2026-03-28 22:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038773/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HS19GYN/42810950?sv=2020-08-04&st=2026-03-28T22%3A01%3A57Z&se=2026-03-28T22%3A26%3A57Z&sr=b&sp=r&sig=96MKHybbSRUkGdibvkSkCtuF%2FChn%2BRdVR1EkP2SXC%2FI%3D)
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55729bcd0>
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c23f5d21-755d-59bb-a7da-864dc76d3107/c23f5d21-755d-59bb-a7da-864dc76d3107_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF13XPW%252F699110914%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110914/600 saved to cache
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c23f5d21-755d-59bb-a7da-864dc76d3107
2026-03-28 22:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011593/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP59FDN/42810928?sv=2020-08-04&st=2026-03-28T22%3A01%3A58Z&se=2026-03-28T22%3A26%3A58Z&sr=b&sp=r&sig=ZbUiVX8NyRKy%2F6YCWkg131AVlNtT%2BzZ%2B1LicpDOBetc%3D)
2026-03-28 22:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994775/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DY13XDF/42810869?sv=2020-08-04&st=2026-03-28T22%3A01%3A59Z&se=2026-03-28T22%3A26%3A59Z&sr=b&sp=r&sig=FCMXSpevxSyZRl0Z0VANwCsNVYcTGX2VuTfaZYnad0M%3D)
2026-03-28 22:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110953/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF13XPW/42811334?sv=2020-08-04&st=2026-03-28T22%3A01%3A58Z&se=2026-03-28T22%3A26%3A58Z&sr=b&sp=r&sig=IaKRLAZfI72tCuDzXhHdVv5UuGmFx5%2Bys8PCMcTmf1c%3D)
2026-03-28 22:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060148/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA21OVG/42811124?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=V82shKhtqB4rTcaiwqPXnkTP%2BoliWo3nMVb6T0BN5SU%3D)
2026-03-28 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994857/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994857>
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554967d90>
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_534d9bbb-c0a6-50f4-bc13-9009bdc08d59/534d9bbb-c0a6-50f4-bc13-9009bdc08d59_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD64FZX%252F699049729%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049729/600 saved to cache
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 534d9bbb-c0a6-50f4-bc13-9009bdc08d59
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55456ba90>
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3459172-6804-5615-b390-f6fc4febd79c/f3459172-6804-5615-b390-f6fc4febd79c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP59FDN%252F699011566%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011566/600 saved to cache
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f3459172-6804-5615-b390-f6fc4febd79c
2026-03-28 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011617/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011617>
2026-03-28 22:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994791/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DY13XDF/42810869?sv=2020-08-04&st=2026-03-28T22%3A01%3A59Z&se=2026-03-28T22%3A26%3A59Z&sr=b&sp=r&sig=FCMXSpevxSyZRl0Z0VANwCsNVYcTGX2VuTfaZYnad0M%3D)
2026-03-28 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543da1d0>
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_534d9bbb-c0a6-50f4-bc13-9009bdc08d59/534d9bbb-c0a6-50f4-bc13-9009bdc08d59_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD64FZX%252F699049755%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049755/600 saved to cache
2026-03-28 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 534d9bbb-c0a6-50f4-bc13-9009bdc08d59
2026-03-28 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54778ddd0>
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_088c09e3-d7eb-592d-ab1c-79cc7e5bdf02/088c09e3-d7eb-592d-ab1c-79cc7e5bdf02_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA57YVV%252F699143640%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143640/600 saved to cache
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549b0750>
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595887ba-7187-5162-8a50-188caa6efdd9/595887ba-7187-5162-8a50-188caa6efdd9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM63ETA%252F699074199%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074199/600 saved to cache
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 595887ba-7187-5162-8a50-188caa6efdd9
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe563755850>
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_546eaaae-2d78-532a-abb1-eac4aea0023f/546eaaae-2d78-532a-abb1-eac4aea0023f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHS19GYN%252F699038773%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038773/600 saved to cache
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 546eaaae-2d78-532a-abb1-eac4aea0023f
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555032c10>
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3459172-6804-5615-b390-f6fc4febd79c/f3459172-6804-5615-b390-f6fc4febd79c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP59FDN%252F699011593%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011593/600 saved to cache
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f3459172-6804-5615-b390-f6fc4febd79c
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b1490>
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c155e91-825b-5797-9727-36735366f7f9/6c155e91-825b-5797-9727-36735366f7f9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDY13XDF%252F698994775%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994775/600 saved to cache
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6c155e91-825b-5797-9727-36735366f7f9
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542eba50>
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c23f5d21-755d-59bb-a7da-864dc76d3107/c23f5d21-755d-59bb-a7da-864dc76d3107_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF13XPW%252F699110953%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110953/600 saved to cache
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c23f5d21-755d-59bb-a7da-864dc76d3107
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554556ad0>
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d1c14a-d5f3-5567-89ad-8d86774c1313/87d1c14a-d5f3-5567-89ad-8d86774c1313_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA21OVG%252F699060148%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060148/600 saved to cache
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 87d1c14a-d5f3-5567-89ad-8d86774c1313
2026-03-28 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994932/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994932>
2026-03-28 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699111030/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699111030>
2026-03-28 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994903/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994903>
2026-03-28 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994876/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994876>
2026-03-28 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994813/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DY13XDF/42810869?sv=2020-08-04&st=2026-03-28T22%3A01%3A59Z&se=2026-03-28T22%3A26%3A59Z&sr=b&sp=r&sig=FCMXSpevxSyZRl0Z0VANwCsNVYcTGX2VuTfaZYnad0M%3D)
2026-03-28 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011600/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP59FDN/42810928?sv=2020-08-04&st=2026-03-28T22%3A01%3A58Z&se=2026-03-28T22%3A26%3A58Z&sr=b&sp=r&sig=ZbUiVX8NyRKy%2F6YCWkg131AVlNtT%2BzZ%2B1LicpDOBetc%3D)
2026-03-28 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110990/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF13XPW/42811334?sv=2020-08-04&st=2026-03-28T22%3A01%3A58Z&se=2026-03-28T22%3A26%3A58Z&sr=b&sp=r&sig=IaKRLAZfI72tCuDzXhHdVv5UuGmFx5%2Bys8PCMcTmf1c%3D)
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55712f490>
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c155e91-825b-5797-9727-36735366f7f9/6c155e91-825b-5797-9727-36735366f7f9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDY13XDF%252F698994791%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994791/600 saved to cache
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6c155e91-825b-5797-9727-36735366f7f9
2026-03-28 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011621/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011621>
2026-03-28 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994828/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994828>
2026-03-28 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699111015/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699111015>
2026-03-28 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011611/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011611>
2026-03-28 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994857/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DY13XDF/42810869?sv=2020-08-04&st=2026-03-28T22%3A01%3A59Z&se=2026-03-28T22%3A26%3A59Z&sr=b&sp=r&sig=FCMXSpevxSyZRl0Z0VANwCsNVYcTGX2VuTfaZYnad0M%3D)
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f95390>
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c155e91-825b-5797-9727-36735366f7f9/6c155e91-825b-5797-9727-36735366f7f9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDY13XDF%252F698994813%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994813/600 saved to cache
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6c155e91-825b-5797-9727-36735366f7f9
2026-03-28 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049819/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049819>
2026-03-28 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011589/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP59FDN/42810928?sv=2020-08-04&st=2026-03-28T22%3A01%3A58Z&se=2026-03-28T22%3A26%3A58Z&sr=b&sp=r&sig=ZbUiVX8NyRKy%2F6YCWkg131AVlNtT%2BzZ%2B1LicpDOBetc%3D)
2026-03-28 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038842/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038842>
2026-03-28 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994903/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DY13XDF/42810869?sv=2020-08-04&st=2026-03-28T22%3A01%3A59Z&se=2026-03-28T22%3A26%3A59Z&sr=b&sp=r&sig=FCMXSpevxSyZRl0Z0VANwCsNVYcTGX2VuTfaZYnad0M%3D)
2026-03-28 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699111030/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF13XPW/42811334?sv=2020-08-04&st=2026-03-28T22%3A01%3A58Z&se=2026-03-28T22%3A26%3A58Z&sr=b&sp=r&sig=IaKRLAZfI72tCuDzXhHdVv5UuGmFx5%2Bys8PCMcTmf1c%3D)
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554809290>
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3459172-6804-5615-b390-f6fc4febd79c/f3459172-6804-5615-b390-f6fc4febd79c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP59FDN%252F699011600%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011600/600 saved to cache
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f3459172-6804-5615-b390-f6fc4febd79c
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547279490>
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c23f5d21-755d-59bb-a7da-864dc76d3107/c23f5d21-755d-59bb-a7da-864dc76d3107_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF13XPW%252F699110990%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110990/600 saved to cache
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c23f5d21-755d-59bb-a7da-864dc76d3107
2026-03-28 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011617/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP59FDN/42810928?sv=2020-08-04&st=2026-03-28T22%3A01%3A58Z&se=2026-03-28T22%3A26%3A58Z&sr=b&sp=r&sig=ZbUiVX8NyRKy%2F6YCWkg131AVlNtT%2BzZ%2B1LicpDOBetc%3D)
2026-03-28 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074217/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074217>
2026-03-28 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110971/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110971>
2026-03-28 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049801/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049801>
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473baf10>
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c155e91-825b-5797-9727-36735366f7f9/6c155e91-825b-5797-9727-36735366f7f9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDY13XDF%252F698994857%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994857/600 saved to cache
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6c155e91-825b-5797-9727-36735366f7f9
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54727a110>
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3459172-6804-5615-b390-f6fc4febd79c/f3459172-6804-5615-b390-f6fc4febd79c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP59FDN%252F699011589%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011589/600 saved to cache
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f3459172-6804-5615-b390-f6fc4febd79c
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547205a50>
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c155e91-825b-5797-9727-36735366f7f9/6c155e91-825b-5797-9727-36735366f7f9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDY13XDF%252F698994903%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994903/600 saved to cache
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6c155e91-825b-5797-9727-36735366f7f9
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54778e390>
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c23f5d21-755d-59bb-a7da-864dc76d3107/c23f5d21-755d-59bb-a7da-864dc76d3107_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF13XPW%252F699111030%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699111030/600 saved to cache
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c23f5d21-755d-59bb-a7da-864dc76d3107
2026-03-28 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011611/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP59FDN/42810928?sv=2020-08-04&st=2026-03-28T22%3A01%3A58Z&se=2026-03-28T22%3A26%3A58Z&sr=b&sp=r&sig=ZbUiVX8NyRKy%2F6YCWkg131AVlNtT%2BzZ%2B1LicpDOBetc%3D)
2026-03-28 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994932/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DY13XDF/42810869?sv=2020-08-04&st=2026-03-28T22%3A01%3A59Z&se=2026-03-28T22%3A26%3A59Z&sr=b&sp=r&sig=FCMXSpevxSyZRl0Z0VANwCsNVYcTGX2VuTfaZYnad0M%3D)
2026-03-28 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994876/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DY13XDF/42810869?sv=2020-08-04&st=2026-03-28T22%3A01%3A59Z&se=2026-03-28T22%3A26%3A59Z&sr=b&sp=r&sig=FCMXSpevxSyZRl0Z0VANwCsNVYcTGX2VuTfaZYnad0M%3D)
2026-03-28 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994828/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DY13XDF/42810869?sv=2020-08-04&st=2026-03-28T22%3A01%3A59Z&se=2026-03-28T22%3A26%3A59Z&sr=b&sp=r&sig=FCMXSpevxSyZRl0Z0VANwCsNVYcTGX2VuTfaZYnad0M%3D)
2026-03-28 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038817/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038817>
2026-03-28 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699111015/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF13XPW/42811334?sv=2020-08-04&st=2026-03-28T22%3A01%3A58Z&se=2026-03-28T22%3A26%3A58Z&sr=b&sp=r&sig=IaKRLAZfI72tCuDzXhHdVv5UuGmFx5%2Bys8PCMcTmf1c%3D)
2026-03-28 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011621/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP59FDN/42810928?sv=2020-08-04&st=2026-03-28T22%3A01%3A58Z&se=2026-03-28T22%3A26%3A58Z&sr=b&sp=r&sig=ZbUiVX8NyRKy%2F6YCWkg131AVlNtT%2BzZ%2B1LicpDOBetc%3D)
2026-03-28 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038842/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HS19GYN/42810950?sv=2020-08-04&st=2026-03-28T22%3A01%3A57Z&se=2026-03-28T22%3A26%3A57Z&sr=b&sp=r&sig=96MKHybbSRUkGdibvkSkCtuF%2FChn%2BRdVR1EkP2SXC%2FI%3D)
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472f6990>
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3459172-6804-5615-b390-f6fc4febd79c/f3459172-6804-5615-b390-f6fc4febd79c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP59FDN%252F699011617%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011617/600 saved to cache
2026-03-28 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f3459172-6804-5615-b390-f6fc4febd79c
2026-03-28 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049801/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD64FZX/42811100?sv=2020-08-04&st=2026-03-28T22%3A01%3A57Z&se=2026-03-28T22%3A26%3A57Z&sr=b&sp=r&sig=Dwyi0onZG26vosKetvMpU1c04CHcIlFHDTCIHVQ3O7A%3D)
2026-03-28 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049778/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049778>
2026-03-28 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074210/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074210>
2026-03-28 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060189/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060189>
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f94410>
2026-03-28 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3459172-6804-5615-b390-f6fc4febd79c/f3459172-6804-5615-b390-f6fc4febd79c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP59FDN%252F699011611%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011611/600 saved to cache
2026-03-28 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f3459172-6804-5615-b390-f6fc4febd79c
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472a0090>
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c155e91-825b-5797-9727-36735366f7f9/6c155e91-825b-5797-9727-36735366f7f9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDY13XDF%252F698994932%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994932/600 saved to cache
2026-03-28 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6c155e91-825b-5797-9727-36735366f7f9
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54778e9d0>
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c155e91-825b-5797-9727-36735366f7f9/6c155e91-825b-5797-9727-36735366f7f9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDY13XDF%252F698994876%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994876/600 saved to cache
2026-03-28 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6c155e91-825b-5797-9727-36735366f7f9
2026-03-28 22:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110971/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF13XPW/42811334?sv=2020-08-04&st=2026-03-28T22%3A01%3A58Z&se=2026-03-28T22%3A26%3A58Z&sr=b&sp=r&sig=IaKRLAZfI72tCuDzXhHdVv5UuGmFx5%2Bys8PCMcTmf1c%3D)
2026-03-28 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038787/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038787>
2026-03-28 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074203/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074203>
2026-03-28 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060169/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060169>
2026-03-28 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143664/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143664>
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557134b50>
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c155e91-825b-5797-9727-36735366f7f9/6c155e91-825b-5797-9727-36735366f7f9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDY13XDF%252F698994828%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994828/600 saved to cache
2026-03-28 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6c155e91-825b-5797-9727-36735366f7f9
2026-03-28 22:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038817/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HS19GYN/42810950?sv=2020-08-04&st=2026-03-28T22%3A01%3A57Z&se=2026-03-28T22%3A26%3A57Z&sr=b&sp=r&sig=96MKHybbSRUkGdibvkSkCtuF%2FChn%2BRdVR1EkP2SXC%2FI%3D)
2026-03-28 22:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049819/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD64FZX/42811100?sv=2020-08-04&st=2026-03-28T22%3A01%3A57Z&se=2026-03-28T22%3A26%3A57Z&sr=b&sp=r&sig=Dwyi0onZG26vosKetvMpU1c04CHcIlFHDTCIHVQ3O7A%3D)
2026-03-28 22:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074217/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM63ETA/42811195?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=2NbmZDcOnFW6Po4d67twxE1bAr32VvI6Mv3oQSg7FqY%3D)
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54723b110>
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c23f5d21-755d-59bb-a7da-864dc76d3107/c23f5d21-755d-59bb-a7da-864dc76d3107_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF13XPW%252F699111015%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699111015/600 saved to cache
2026-03-28 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c23f5d21-755d-59bb-a7da-864dc76d3107
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547731190>
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3459172-6804-5615-b390-f6fc4febd79c/f3459172-6804-5615-b390-f6fc4febd79c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP59FDN%252F699011621%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011621/600 saved to cache
2026-03-28 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f3459172-6804-5615-b390-f6fc4febd79c
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473b9910>
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_546eaaae-2d78-532a-abb1-eac4aea0023f/546eaaae-2d78-532a-abb1-eac4aea0023f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHS19GYN%252F699038842%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038842/600 saved to cache
2026-03-28 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 546eaaae-2d78-532a-abb1-eac4aea0023f
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557618750>
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_534d9bbb-c0a6-50f4-bc13-9009bdc08d59/534d9bbb-c0a6-50f4-bc13-9009bdc08d59_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD64FZX%252F699049801%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049801/600 saved to cache
2026-03-28 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 534d9bbb-c0a6-50f4-bc13-9009bdc08d59
2026-03-28 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110937/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110937>
2026-03-28 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994738/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DY13XDF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011575/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011575>
2026-03-28 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011578/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011578>
2026-03-28 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994752/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994752>
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544dce90>
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c23f5d21-755d-59bb-a7da-864dc76d3107/c23f5d21-755d-59bb-a7da-864dc76d3107_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF13XPW%252F699110971%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110971/600 saved to cache
2026-03-28 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c23f5d21-755d-59bb-a7da-864dc76d3107
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b5310>
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_546eaaae-2d78-532a-abb1-eac4aea0023f/546eaaae-2d78-532a-abb1-eac4aea0023f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHS19GYN%252F699038817%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038817/600 saved to cache
2026-03-28 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 546eaaae-2d78-532a-abb1-eac4aea0023f
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b83d0>
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_534d9bbb-c0a6-50f4-bc13-9009bdc08d59/534d9bbb-c0a6-50f4-bc13-9009bdc08d59_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD64FZX%252F699049819%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049819/600 saved to cache
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 534d9bbb-c0a6-50f4-bc13-9009bdc08d59
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547ef950>
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595887ba-7187-5162-8a50-188caa6efdd9/595887ba-7187-5162-8a50-188caa6efdd9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM63ETA%252F699074217%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074217/600 saved to cache
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 595887ba-7187-5162-8a50-188caa6efdd9
2026-03-28 22:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074210/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM63ETA/42811195?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=2NbmZDcOnFW6Po4d67twxE1bAr32VvI6Mv3oQSg7FqY%3D)
2026-03-28 22:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049778/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD64FZX/42811100?sv=2020-08-04&st=2026-03-28T22%3A01%3A57Z&se=2026-03-28T22%3A26%3A57Z&sr=b&sp=r&sig=Dwyi0onZG26vosKetvMpU1c04CHcIlFHDTCIHVQ3O7A%3D)
2026-03-28 22:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060189/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA21OVG/42811124?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=V82shKhtqB4rTcaiwqPXnkTP%2BoliWo3nMVb6T0BN5SU%3D)
2026-03-28 22:02:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110924/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110924>
2026-03-28 22:02:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049739/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049739>
2026-03-28 22:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038787/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HS19GYN/42810950?sv=2020-08-04&st=2026-03-28T22%3A01%3A57Z&se=2026-03-28T22%3A26%3A57Z&sr=b&sp=r&sig=96MKHybbSRUkGdibvkSkCtuF%2FChn%2BRdVR1EkP2SXC%2FI%3D)
2026-03-28 22:02:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038751/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038751>
2026-03-28 22:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074203/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM63ETA/42811195?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=2NbmZDcOnFW6Po4d67twxE1bAr32VvI6Mv3oQSg7FqY%3D)
2026-03-28 22:02:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074188/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074188>
2026-03-28 22:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060169/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA21OVG/42811124?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=V82shKhtqB4rTcaiwqPXnkTP%2BoliWo3nMVb6T0BN5SU%3D)
2026-03-28 22:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143664/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA57YVV/42811409?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=nyWRKONE8HKvE1Bd8e5fHoTy4qWWUPVu8%2FwiG6QJKuE%3D)
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542e11d0>
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595887ba-7187-5162-8a50-188caa6efdd9/595887ba-7187-5162-8a50-188caa6efdd9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM63ETA%252F699074210%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074210/600 saved to cache
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 595887ba-7187-5162-8a50-188caa6efdd9
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555e37c50>
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_534d9bbb-c0a6-50f4-bc13-9009bdc08d59/534d9bbb-c0a6-50f4-bc13-9009bdc08d59_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD64FZX%252F699049778%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049778/600 saved to cache
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 534d9bbb-c0a6-50f4-bc13-9009bdc08d59
2026-03-28 22:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011575/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP59FDN/42810928?sv=2020-08-04&st=2026-03-28T22%3A01%3A58Z&se=2026-03-28T22%3A26%3A58Z&sr=b&sp=r&sig=ZbUiVX8NyRKy%2F6YCWkg131AVlNtT%2BzZ%2B1LicpDOBetc%3D)
2026-03-28 22:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110937/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF13XPW/42811334?sv=2020-08-04&st=2026-03-28T22%3A01%3A58Z&se=2026-03-28T22%3A26%3A58Z&sr=b&sp=r&sig=IaKRLAZfI72tCuDzXhHdVv5UuGmFx5%2Bys8PCMcTmf1c%3D)
2026-03-28 22:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011578/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP59FDN/42810928?sv=2020-08-04&st=2026-03-28T22%3A01%3A58Z&se=2026-03-28T22%3A26%3A58Z&sr=b&sp=r&sig=ZbUiVX8NyRKy%2F6YCWkg131AVlNtT%2BzZ%2B1LicpDOBetc%3D)
2026-03-28 22:02:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060128/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060128>
2026-03-28 22:02:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143622/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143622>
2026-03-28 22:02:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038738/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038738>
2026-03-28 22:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994738/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DY13XDF/42810869?sv=2020-08-04&st=2026-03-28T22%3A01%3A59Z&se=2026-03-28T22%3A26%3A59Z&sr=b&sp=r&sig=FCMXSpevxSyZRl0Z0VANwCsNVYcTGX2VuTfaZYnad0M%3D)
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542e3e90>
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d1c14a-d5f3-5567-89ad-8d86774c1313/87d1c14a-d5f3-5567-89ad-8d86774c1313_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA21OVG%252F699060189%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060189/600 saved to cache
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 87d1c14a-d5f3-5567-89ad-8d86774c1313
2026-03-28 22:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994752/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DY13XDF/42810869?sv=2020-08-04&st=2026-03-28T22%3A01%3A59Z&se=2026-03-28T22%3A26%3A59Z&sr=b&sp=r&sig=FCMXSpevxSyZRl0Z0VANwCsNVYcTGX2VuTfaZYnad0M%3D)
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477032d0>
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_546eaaae-2d78-532a-abb1-eac4aea0023f/546eaaae-2d78-532a-abb1-eac4aea0023f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHS19GYN%252F699038787%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038787/600 saved to cache
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 546eaaae-2d78-532a-abb1-eac4aea0023f
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b1410>
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595887ba-7187-5162-8a50-188caa6efdd9/595887ba-7187-5162-8a50-188caa6efdd9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM63ETA%252F699074203%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074203/600 saved to cache
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 595887ba-7187-5162-8a50-188caa6efdd9
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f80e90>
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d1c14a-d5f3-5567-89ad-8d86774c1313/87d1c14a-d5f3-5567-89ad-8d86774c1313_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA21OVG%252F699060169%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060169/600 saved to cache
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 87d1c14a-d5f3-5567-89ad-8d86774c1313
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54728e550>
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_088c09e3-d7eb-592d-ab1c-79cc7e5bdf02/088c09e3-d7eb-592d-ab1c-79cc7e5bdf02_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA57YVV%252F699143664%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143664/600 saved to cache
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02
2026-03-28 22:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038751/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HS19GYN/42810950?sv=2020-08-04&st=2026-03-28T22%3A01%3A57Z&se=2026-03-28T22%3A26%3A57Z&sr=b&sp=r&sig=96MKHybbSRUkGdibvkSkCtuF%2FChn%2BRdVR1EkP2SXC%2FI%3D)
2026-03-28 22:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074188/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM63ETA/42811195?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=2NbmZDcOnFW6Po4d67twxE1bAr32VvI6Mv3oQSg7FqY%3D)
2026-03-28 22:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110924/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF13XPW/42811334?sv=2020-08-04&st=2026-03-28T22%3A01%3A58Z&se=2026-03-28T22%3A26%3A58Z&sr=b&sp=r&sig=IaKRLAZfI72tCuDzXhHdVv5UuGmFx5%2Bys8PCMcTmf1c%3D)
2026-03-28 22:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049739/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD64FZX/42811100?sv=2020-08-04&st=2026-03-28T22%3A01%3A57Z&se=2026-03-28T22%3A26%3A57Z&sr=b&sp=r&sig=Dwyi0onZG26vosKetvMpU1c04CHcIlFHDTCIHVQ3O7A%3D)
2026-03-28 22:02:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074184/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074184>
2026-03-28 22:02:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060113/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060113>
2026-03-28 22:02:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143597/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143597>
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f81450>
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3459172-6804-5615-b390-f6fc4febd79c/f3459172-6804-5615-b390-f6fc4febd79c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP59FDN%252F699011575%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011575/600 saved to cache
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f3459172-6804-5615-b390-f6fc4febd79c
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554230a10>
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c23f5d21-755d-59bb-a7da-864dc76d3107/c23f5d21-755d-59bb-a7da-864dc76d3107_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF13XPW%252F699110937%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110937/600 saved to cache
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c23f5d21-755d-59bb-a7da-864dc76d3107
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547dff90>
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3459172-6804-5615-b390-f6fc4febd79c/f3459172-6804-5615-b390-f6fc4febd79c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP59FDN%252F699011578%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011578/600 saved to cache
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f3459172-6804-5615-b390-f6fc4febd79c
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549b0a50>
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c155e91-825b-5797-9727-36735366f7f9/6c155e91-825b-5797-9727-36735366f7f9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDY13XDF%252F698994738%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994738/600 saved to cache
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6c155e91-825b-5797-9727-36735366f7f9
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473b9890>
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c155e91-825b-5797-9727-36735366f7f9/6c155e91-825b-5797-9727-36735366f7f9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDY13XDF%252F698994752%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994752/600 saved to cache
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6c155e91-825b-5797-9727-36735366f7f9
2026-03-28 22:02:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c155e91-825b-5797-9727-36735366f7f9, skipping ID generation
2026-03-28 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6c155e91-825b-5797-9727-36735366f7f9 sending to next pipeline
2026-03-28 22:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6c155e91-825b-5797-9727-36735366f7f9, identifier: DY13%20XDF
2026-03-28 22:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6c155e91-825b-5797-9727-36735366f7f9 with identifier: DY13%20XDF
2026-03-28 22:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6c155e91-825b-5797-9727-36735366f7f9 with identifier: DY13%20XDF
2026-03-28 22:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6c155e91-825b-5797-9727-36735366f7f9 with identifier: DY13%20XDF to the API
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994752/600>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c155e91-825b-5797-9727-36735366f7f9/6c155e91-825b-5797-9727-36735366f7f9_expert_report_file_73fa36eb-ef32-4104-9345-aaab0be16e8e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DY13%20XDF-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6c155e91-825b-5797-9727-36735366f7f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DY13 XDF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DY13%20XDF&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 114843,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c155e91-825b-5797-9727-36735366f7f9/6c155e91-825b-5797-9727-36735366f7f9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45067,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994738/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c155e91-825b-5797-9727-36735366f7f9/6c155e91-825b-5797-9727-36735366f7f9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43252,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994752/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c155e91-825b-5797-9727-36735366f7f9/6c155e91-825b-5797-9727-36735366f7f9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40231,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994775/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c155e91-825b-5797-9727-36735366f7f9/6c155e91-825b-5797-9727-36735366f7f9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40408,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994791/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c155e91-825b-5797-9727-36735366f7f9/6c155e91-825b-5797-9727-36735366f7f9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40369,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994813/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c155e91-825b-5797-9727-36735366f7f9/6c155e91-825b-5797-9727-36735366f7f9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38285,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994828/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c155e91-825b-5797-9727-36735366f7f9/6c155e91-825b-5797-9727-36735366f7f9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74312,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994857/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c155e91-825b-5797-9727-36735366f7f9/6c155e91-825b-5797-9727-36735366f7f9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61670,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994876/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c155e91-825b-5797-9727-36735366f7f9/6c155e91-825b-5797-9727-36735366f7f9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83316,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994903/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c155e91-825b-5797-9727-36735366f7f9/6c155e91-825b-5797-9727-36735366f7f9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83293,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY13XDF/698994932/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.4 T 16V 140 SRI Hatchback',
'transmission': 'manual',
'trim': 'T 16V 140 SRI',
'vin': 'W0LPF6EC7D8043064',
'year': 2013}
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY13%2520XDF%27 HTTP/1.1" 200 None
2026-03-28 22:02:06 [bca.uk] INFO: Saving data for DY13%20XDF: {'created_time': 1774735326.369403, 'last_price_update_time': 1774735326.369413, 'auction_closing_time': 1774864800.0}
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DY13%2520XDF') HTTP/1.1" 204 0
2026-03-28 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038738/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HS19GYN/42810950?sv=2020-08-04&st=2026-03-28T22%3A01%3A57Z&se=2026-03-28T22%3A26%3A57Z&sr=b&sp=r&sig=96MKHybbSRUkGdibvkSkCtuF%2FChn%2BRdVR1EkP2SXC%2FI%3D)
2026-03-28 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011553/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SP59FDN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110902/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110902>
2026-03-28 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049720/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049720>
2026-03-28 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074178/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074178>
2026-03-28 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038730/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038730>
2026-03-28 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143622/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA57YVV/42811409?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=nyWRKONE8HKvE1Bd8e5fHoTy4qWWUPVu8%2FwiG6QJKuE%3D)
2026-03-28 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060128/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA21OVG/42811124?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=V82shKhtqB4rTcaiwqPXnkTP%2BoliWo3nMVb6T0BN5SU%3D)
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554965d50>
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_546eaaae-2d78-532a-abb1-eac4aea0023f/546eaaae-2d78-532a-abb1-eac4aea0023f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHS19GYN%252F699038751%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038751/600 saved to cache
2026-03-28 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 546eaaae-2d78-532a-abb1-eac4aea0023f
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554253c10>
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595887ba-7187-5162-8a50-188caa6efdd9/595887ba-7187-5162-8a50-188caa6efdd9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM63ETA%252F699074188%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074188/600 saved to cache
2026-03-28 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 595887ba-7187-5162-8a50-188caa6efdd9
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fbfb10>
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c23f5d21-755d-59bb-a7da-864dc76d3107/c23f5d21-755d-59bb-a7da-864dc76d3107_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF13XPW%252F699110924%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110924/600 saved to cache
2026-03-28 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c23f5d21-755d-59bb-a7da-864dc76d3107
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543dced0>
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_534d9bbb-c0a6-50f4-bc13-9009bdc08d59/534d9bbb-c0a6-50f4-bc13-9009bdc08d59_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD64FZX%252F699049739%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049739/600 saved to cache
2026-03-28 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 534d9bbb-c0a6-50f4-bc13-9009bdc08d59
2026-03-28 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074184/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM63ETA/42811195?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=2NbmZDcOnFW6Po4d67twxE1bAr32VvI6Mv3oQSg7FqY%3D)
2026-03-28 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060107/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060107>
2026-03-28 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143570/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143570>
2026-03-28 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074173/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074173>
2026-03-28 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060113/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA21OVG/42811124?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=V82shKhtqB4rTcaiwqPXnkTP%2BoliWo3nMVb6T0BN5SU%3D)
2026-03-28 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143597/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA57YVV/42811409?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=nyWRKONE8HKvE1Bd8e5fHoTy4qWWUPVu8%2FwiG6QJKuE%3D)
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473db910>
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_546eaaae-2d78-532a-abb1-eac4aea0023f/546eaaae-2d78-532a-abb1-eac4aea0023f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHS19GYN%252F699038738%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038738/600 saved to cache
2026-03-28 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 546eaaae-2d78-532a-abb1-eac4aea0023f
2026-03-28 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54777d490>
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_088c09e3-d7eb-592d-ab1c-79cc7e5bdf02/088c09e3-d7eb-592d-ab1c-79cc7e5bdf02_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA57YVV%252F699143622%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143622/600 saved to cache
2026-03-28 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02
2026-03-28 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547224150>
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d1c14a-d5f3-5567-89ad-8d86774c1313/87d1c14a-d5f3-5567-89ad-8d86774c1313_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA21OVG%252F699060128%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060128/600 saved to cache
2026-03-28 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 87d1c14a-d5f3-5567-89ad-8d86774c1313
2026-03-28 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143555/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143555>
2026-03-28 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060095/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060095>
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b6510>
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595887ba-7187-5162-8a50-188caa6efdd9/595887ba-7187-5162-8a50-188caa6efdd9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM63ETA%252F699074184%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074184/600 saved to cache
2026-03-28 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 595887ba-7187-5162-8a50-188caa6efdd9
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55490a6d0>
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d1c14a-d5f3-5567-89ad-8d86774c1313/87d1c14a-d5f3-5567-89ad-8d86774c1313_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA21OVG%252F699060113%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060113/600 saved to cache
2026-03-28 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 87d1c14a-d5f3-5567-89ad-8d86774c1313
2026-03-28 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547df150>
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_088c09e3-d7eb-592d-ab1c-79cc7e5bdf02/088c09e3-d7eb-592d-ab1c-79cc7e5bdf02_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA57YVV%252F699143597%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143597/600 saved to cache
2026-03-28 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02
2026-03-28 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049720/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD64FZX/42811100?sv=2020-08-04&st=2026-03-28T22%3A01%3A57Z&se=2026-03-28T22%3A26%3A57Z&sr=b&sp=r&sig=Dwyi0onZG26vosKetvMpU1c04CHcIlFHDTCIHVQ3O7A%3D)
2026-03-28 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011553/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP59FDN/42810928?sv=2020-08-04&st=2026-03-28T22%3A01%3A58Z&se=2026-03-28T22%3A26%3A58Z&sr=b&sp=r&sig=ZbUiVX8NyRKy%2F6YCWkg131AVlNtT%2BzZ%2B1LicpDOBetc%3D)
2026-03-28 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110902/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF13XPW/42811334?sv=2020-08-04&st=2026-03-28T22%3A01%3A58Z&se=2026-03-28T22%3A26%3A58Z&sr=b&sp=r&sig=IaKRLAZfI72tCuDzXhHdVv5UuGmFx5%2Bys8PCMcTmf1c%3D)
2026-03-28 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074178/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM63ETA/42811195?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=2NbmZDcOnFW6Po4d67twxE1bAr32VvI6Mv3oQSg7FqY%3D)
2026-03-28 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110982/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110982>
2026-03-28 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188575/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188575>
2026-03-28 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188642/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188642>
2026-03-28 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038730/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HS19GYN/42810950?sv=2020-08-04&st=2026-03-28T22%3A01%3A57Z&se=2026-03-28T22%3A26%3A57Z&sr=b&sp=r&sig=96MKHybbSRUkGdibvkSkCtuF%2FChn%2BRdVR1EkP2SXC%2FI%3D)
2026-03-28 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060095/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA21OVG/42811124?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=V82shKhtqB4rTcaiwqPXnkTP%2BoliWo3nMVb6T0BN5SU%3D)
2026-03-28 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060107/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA21OVG/42811124?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=V82shKhtqB4rTcaiwqPXnkTP%2BoliWo3nMVb6T0BN5SU%3D)
2026-03-28 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074173/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM63ETA/42811195?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=2NbmZDcOnFW6Po4d67twxE1bAr32VvI6Mv3oQSg7FqY%3D)
2026-03-28 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699033043/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699033043>
2026-03-28 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049702/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049702>
2026-03-28 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023578/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023578>
2026-03-28 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143555/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA57YVV/42811409?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=nyWRKONE8HKvE1Bd8e5fHoTy4qWWUPVu8%2FwiG6QJKuE%3D)
2026-03-28 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143570/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA57YVV/42811409?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=nyWRKONE8HKvE1Bd8e5fHoTy4qWWUPVu8%2FwiG6QJKuE%3D)
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473b10d0>
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_534d9bbb-c0a6-50f4-bc13-9009bdc08d59/534d9bbb-c0a6-50f4-bc13-9009bdc08d59_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD64FZX%252F699049720%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049720/600 saved to cache
2026-03-28 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 534d9bbb-c0a6-50f4-bc13-9009bdc08d59
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5589decd0>
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3459172-6804-5615-b390-f6fc4febd79c/f3459172-6804-5615-b390-f6fc4febd79c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP59FDN%252F699011553%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011553/600 saved to cache
2026-03-28 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f3459172-6804-5615-b390-f6fc4febd79c
2026-03-28 22:02:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3459172-6804-5615-b390-f6fc4febd79c, skipping ID generation
2026-03-28 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f3459172-6804-5615-b390-f6fc4febd79c sending to next pipeline
2026-03-28 22:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f3459172-6804-5615-b390-f6fc4febd79c, identifier: SP59%20FDN
2026-03-28 22:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f3459172-6804-5615-b390-f6fc4febd79c with identifier: SP59%20FDN
2026-03-28 22:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f3459172-6804-5615-b390-f6fc4febd79c with identifier: SP59%20FDN
2026-03-28 22:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f3459172-6804-5615-b390-f6fc4febd79c with identifier: SP59%20FDN to the API
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011553/600>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3459172-6804-5615-b390-f6fc4febd79c/f3459172-6804-5615-b390-f6fc4febd79c_expert_report_file_6158ed19-1997-4058-b190-e2610ad86d64.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SP59%20FDN-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f3459172-6804-5615-b390-f6fc4febd79c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SP59 FDN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SP59%20FDN&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'AUDI',
'model': 'A3 SPORTBACK',
'odometer': 58928,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3459172-6804-5615-b390-f6fc4febd79c/f3459172-6804-5615-b390-f6fc4febd79c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41608,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011553/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3459172-6804-5615-b390-f6fc4febd79c/f3459172-6804-5615-b390-f6fc4febd79c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39803,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011566/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3459172-6804-5615-b390-f6fc4febd79c/f3459172-6804-5615-b390-f6fc4febd79c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37868,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011575/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3459172-6804-5615-b390-f6fc4febd79c/f3459172-6804-5615-b390-f6fc4febd79c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38193,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011578/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3459172-6804-5615-b390-f6fc4febd79c/f3459172-6804-5615-b390-f6fc4febd79c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37438,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011589/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3459172-6804-5615-b390-f6fc4febd79c/f3459172-6804-5615-b390-f6fc4febd79c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35543,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011593/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3459172-6804-5615-b390-f6fc4febd79c/f3459172-6804-5615-b390-f6fc4febd79c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68029,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011600/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3459172-6804-5615-b390-f6fc4febd79c/f3459172-6804-5615-b390-f6fc4febd79c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60001,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011611/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3459172-6804-5615-b390-f6fc4febd79c/f3459172-6804-5615-b390-f6fc4febd79c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72073,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011617/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3459172-6804-5615-b390-f6fc4febd79c/f3459172-6804-5615-b390-f6fc4febd79c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70892,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP59FDN/699011621/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'AUDI A3 SPORTBACK 1.8 TFSI SPORT S-T Hatchback',
'transmission': 'automatic',
'trim': 'TFSI SPORT S-T',
'vin': 'WAUZZZ8PXAA044194',
'year': 2009}
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP59%2520FDN%27 HTTP/1.1" 200 None
2026-03-28 22:02:07 [bca.uk] INFO: Saving data for SP59%20FDN: {'created_time': 1774735327.575228, 'last_price_update_time': 1774735327.575238, 'auction_closing_time': 1774864800.0}
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SP59%2520FDN') HTTP/1.1" 204 0
2026-03-28 22:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110982/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY65OSN/42811345?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=nIVSbgrO1i9Xr%2BfbSLpc%2BtaM0zcISF5O%2FO1r76QJkIA%3D)
2026-03-28 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038707/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038707>
2026-03-28 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060079/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060079>
2026-03-28 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143540/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143540>
2026-03-28 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074168/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074168>
2026-03-28 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188563/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188563>
2026-03-28 22:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188575/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN69YVF/42797384?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=2YQhuVPOEs8nllGGk7BCLIWyloC%2FrwsAAUaDV7wMkMk%3D)
2026-03-28 22:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188642/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG14YNA/42808187?sv=2020-08-04&st=2026-03-28T22%3A01%3A55Z&se=2026-03-28T22%3A26%3A55Z&sr=b&sp=r&sig=DGiN%2BSfP9fEeRz4iomC5Qiv6ES1KZsQ9RCNgoJLwpnk%3D)
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547171250>
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c23f5d21-755d-59bb-a7da-864dc76d3107/c23f5d21-755d-59bb-a7da-864dc76d3107_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF13XPW%252F699110902%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110902/600 saved to cache
2026-03-28 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c23f5d21-755d-59bb-a7da-864dc76d3107
2026-03-28 22:02:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c23f5d21-755d-59bb-a7da-864dc76d3107, skipping ID generation
2026-03-28 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c23f5d21-755d-59bb-a7da-864dc76d3107 sending to next pipeline
2026-03-28 22:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c23f5d21-755d-59bb-a7da-864dc76d3107, identifier: AF13%20XPW
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54771bb90>
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595887ba-7187-5162-8a50-188caa6efdd9/595887ba-7187-5162-8a50-188caa6efdd9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM63ETA%252F699074178%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074178/600 saved to cache
2026-03-28 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 595887ba-7187-5162-8a50-188caa6efdd9
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54771bb90>
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_546eaaae-2d78-532a-abb1-eac4aea0023f/546eaaae-2d78-532a-abb1-eac4aea0023f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHS19GYN%252F699038730%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038730/600 saved to cache
2026-03-28 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 546eaaae-2d78-532a-abb1-eac4aea0023f
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547756690>
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d1c14a-d5f3-5567-89ad-8d86774c1313/87d1c14a-d5f3-5567-89ad-8d86774c1313_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA21OVG%252F699060095%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060095/600 saved to cache
2026-03-28 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 87d1c14a-d5f3-5567-89ad-8d86774c1313
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b82290>
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d1c14a-d5f3-5567-89ad-8d86774c1313/87d1c14a-d5f3-5567-89ad-8d86774c1313_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA21OVG%252F699060107%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060107/600 saved to cache
2026-03-28 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 87d1c14a-d5f3-5567-89ad-8d86774c1313
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547718290>
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595887ba-7187-5162-8a50-188caa6efdd9/595887ba-7187-5162-8a50-188caa6efdd9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM63ETA%252F699074173%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074173/600 saved to cache
2026-03-28 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 595887ba-7187-5162-8a50-188caa6efdd9
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f81990>
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_088c09e3-d7eb-592d-ab1c-79cc7e5bdf02/088c09e3-d7eb-592d-ab1c-79cc7e5bdf02_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA57YVV%252F699143555%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143555/600 saved to cache
2026-03-28 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547719b10>
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_088c09e3-d7eb-592d-ab1c-79cc7e5bdf02/088c09e3-d7eb-592d-ab1c-79cc7e5bdf02_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA57YVV%252F699143570%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143570/600 saved to cache
2026-03-28 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02
2026-03-28 22:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c23f5d21-755d-59bb-a7da-864dc76d3107 with identifier: AF13%20XPW
2026-03-28 22:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c23f5d21-755d-59bb-a7da-864dc76d3107 with identifier: AF13%20XPW
2026-03-28 22:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c23f5d21-755d-59bb-a7da-864dc76d3107 with identifier: AF13%20XPW to the API
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110902/600>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c23f5d21-755d-59bb-a7da-864dc76d3107/c23f5d21-755d-59bb-a7da-864dc76d3107_expert_report_file_81cb98c6-b82a-47dd-a656-87ae9f6c0b90.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AF13%20XPW-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c23f5d21-755d-59bb-a7da-864dc76d3107',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AF13 XPW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AF13%20XPW&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'PEUGEOT',
'model': '308',
'odometer': 42026,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c23f5d21-755d-59bb-a7da-864dc76d3107/c23f5d21-755d-59bb-a7da-864dc76d3107_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44925,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110892/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c23f5d21-755d-59bb-a7da-864dc76d3107/c23f5d21-755d-59bb-a7da-864dc76d3107_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44311,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110902/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c23f5d21-755d-59bb-a7da-864dc76d3107/c23f5d21-755d-59bb-a7da-864dc76d3107_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42582,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110914/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c23f5d21-755d-59bb-a7da-864dc76d3107/c23f5d21-755d-59bb-a7da-864dc76d3107_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39663,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110924/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c23f5d21-755d-59bb-a7da-864dc76d3107/c23f5d21-755d-59bb-a7da-864dc76d3107_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38723,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110937/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c23f5d21-755d-59bb-a7da-864dc76d3107/c23f5d21-755d-59bb-a7da-864dc76d3107_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40191,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110953/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c23f5d21-755d-59bb-a7da-864dc76d3107/c23f5d21-755d-59bb-a7da-864dc76d3107_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83962,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110971/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c23f5d21-755d-59bb-a7da-864dc76d3107/c23f5d21-755d-59bb-a7da-864dc76d3107_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71400,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699110990/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c23f5d21-755d-59bb-a7da-864dc76d3107/c23f5d21-755d-59bb-a7da-864dc76d3107_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85428,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699111015/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c23f5d21-755d-59bb-a7da-864dc76d3107/c23f5d21-755d-59bb-a7da-864dc76d3107_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56843,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF13XPW/699111030/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 1.6 HDI 92 ACCESS Hatchback',
'transmission': 'manual',
'trim': 'HDI 92 ACCESS',
'vin': 'VF34C9HP0DS030256',
'year': 2013}
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF13%2520XPW%27 HTTP/1.1" 200 None
2026-03-28 22:02:08 [bca.uk] INFO: Saving data for AF13%20XPW: {'created_time': 1774735328.378224, 'last_price_update_time': 1774735328.378236, 'auction_closing_time': 1774951200.0}
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AF13%2520XPW') HTTP/1.1" 204 0
2026-03-28 22:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049702/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD64FZX/42811100?sv=2020-08-04&st=2026-03-28T22%3A01%3A57Z&se=2026-03-28T22%3A26%3A57Z&sr=b&sp=r&sig=Dwyi0onZG26vosKetvMpU1c04CHcIlFHDTCIHVQ3O7A%3D)
2026-03-28 22:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023554/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023554>
2026-03-28 22:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188631/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188631>
2026-03-28 22:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143530/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143530>
2026-03-28 22:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699093951/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093951>
2026-03-28 22:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699033023/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699033023>
2026-03-28 22:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699033043/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT71NEN/42810987?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=rH6uqkSHrsaaYdvpCA%2FsZzV6mE0zUHVzVmdfRT1wrj0%3D)
2026-03-28 22:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023578/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV70UZS/42810918?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=OuGBCg%2BAeGR0D2f%2BeITBsmUKuqiSK1uvUwiSvUi6IQs%3D)
2026-03-28 22:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55456dd10>
2026-03-28 22:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c536c8-20b9-5eb5-bd31-426ff92c052b/d4c536c8-20b9-5eb5-bd31-426ff92c052b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY65OSN%252F699110982%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110982/600 saved to cache
2026-03-28 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d4c536c8-20b9-5eb5-bd31-426ff92c052b
2026-03-28 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554914050>
2026-03-28 22:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0d2c8c1-587d-52a8-bac1-4dade51bc1df/b0d2c8c1-587d-52a8-bac1-4dade51bc1df_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN69YVF%252F699188575%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188575/600 saved to cache
2026-03-28 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b0d2c8c1-587d-52a8-bac1-4dade51bc1df
2026-03-28 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547278750>
2026-03-28 22:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_238a280e-8233-56ab-b3e9-1e6814e8a2fb/238a280e-8233-56ab-b3e9-1e6814e8a2fb_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG14YNA%252F699188642%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188642/600 saved to cache
2026-03-28 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 238a280e-8233-56ab-b3e9-1e6814e8a2fb
2026-03-28 22:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060079/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA21OVG/42811124?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=V82shKhtqB4rTcaiwqPXnkTP%2BoliWo3nMVb6T0BN5SU%3D)
2026-03-28 22:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038707/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HS19GYN/42810950?sv=2020-08-04&st=2026-03-28T22%3A01%3A57Z&se=2026-03-28T22%3A26%3A57Z&sr=b&sp=r&sig=96MKHybbSRUkGdibvkSkCtuF%2FChn%2BRdVR1EkP2SXC%2FI%3D)
2026-03-28 22:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074168/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM63ETA/42811195?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=2NbmZDcOnFW6Po4d67twxE1bAr32VvI6Mv3oQSg7FqY%3D)
2026-03-28 22:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188550/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188550>
2026-03-28 22:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188563/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN69YVF/42797384?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=2YQhuVPOEs8nllGGk7BCLIWyloC%2FrwsAAUaDV7wMkMk%3D)
2026-03-28 22:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f7bd90>
2026-03-28 22:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_534d9bbb-c0a6-50f4-bc13-9009bdc08d59/534d9bbb-c0a6-50f4-bc13-9009bdc08d59_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD64FZX%252F699049702%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049702/600 saved to cache
2026-03-28 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 534d9bbb-c0a6-50f4-bc13-9009bdc08d59
2026-03-28 22:02:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 534d9bbb-c0a6-50f4-bc13-9009bdc08d59, skipping ID generation
2026-03-28 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 534d9bbb-c0a6-50f4-bc13-9009bdc08d59 sending to next pipeline
2026-03-28 22:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 534d9bbb-c0a6-50f4-bc13-9009bdc08d59, identifier: LD64%20FZX
2026-03-28 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554914ad0>
2026-03-28 22:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5421d270-4706-56d4-861e-d213204bb57b/5421d270-4706-56d4-861e-d213204bb57b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT71NEN%252F699033043%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699033043/600 saved to cache
2026-03-28 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5421d270-4706-56d4-861e-d213204bb57b
2026-03-28 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472f4790>
2026-03-28 22:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c249da5-1d51-5bc9-a40c-4417dbaa5b62/9c249da5-1d51-5bc9-a40c-4417dbaa5b62_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV70UZS%252F699023578%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023578/600 saved to cache
2026-03-28 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9c249da5-1d51-5bc9-a40c-4417dbaa5b62
2026-03-28 22:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 534d9bbb-c0a6-50f4-bc13-9009bdc08d59 with identifier: LD64%20FZX
2026-03-28 22:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 534d9bbb-c0a6-50f4-bc13-9009bdc08d59 with identifier: LD64%20FZX
2026-03-28 22:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 534d9bbb-c0a6-50f4-bc13-9009bdc08d59 with identifier: LD64%20FZX to the API
2026-03-28 22:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049702/600>
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_534d9bbb-c0a6-50f4-bc13-9009bdc08d59/534d9bbb-c0a6-50f4-bc13-9009bdc08d59_expert_report_file_88686304-2464-4fb8-ac15-bbeabde242cb.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD64%20FZX-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '534d9bbb-c0a6-50f4-bc13-9009bdc08d59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD64 FZX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD64%20FZX&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 49641,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_534d9bbb-c0a6-50f4-bc13-9009bdc08d59/534d9bbb-c0a6-50f4-bc13-9009bdc08d59_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44658,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049693/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_534d9bbb-c0a6-50f4-bc13-9009bdc08d59/534d9bbb-c0a6-50f4-bc13-9009bdc08d59_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43859,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049702/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_534d9bbb-c0a6-50f4-bc13-9009bdc08d59/534d9bbb-c0a6-50f4-bc13-9009bdc08d59_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41479,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049712/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_534d9bbb-c0a6-50f4-bc13-9009bdc08d59/534d9bbb-c0a6-50f4-bc13-9009bdc08d59_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39918,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049720/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_534d9bbb-c0a6-50f4-bc13-9009bdc08d59/534d9bbb-c0a6-50f4-bc13-9009bdc08d59_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38694,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049729/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_534d9bbb-c0a6-50f4-bc13-9009bdc08d59/534d9bbb-c0a6-50f4-bc13-9009bdc08d59_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38571,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049739/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_534d9bbb-c0a6-50f4-bc13-9009bdc08d59/534d9bbb-c0a6-50f4-bc13-9009bdc08d59_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100359,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049755/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_534d9bbb-c0a6-50f4-bc13-9009bdc08d59/534d9bbb-c0a6-50f4-bc13-9009bdc08d59_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69802,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049778/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_534d9bbb-c0a6-50f4-bc13-9009bdc08d59/534d9bbb-c0a6-50f4-bc13-9009bdc08d59_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76228,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049801/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_534d9bbb-c0a6-50f4-bc13-9009bdc08d59/534d9bbb-c0a6-50f4-bc13-9009bdc08d59_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73919,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD64FZX/699049819/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.2 TSI 90 SE Hatchback',
'transmission': 'manual',
'trim': 'TSI 90 SE',
'vin': 'WVWZZZ6RZFY147536',
'year': 2014}
2026-03-28 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD64%2520FZX%27 HTTP/1.1" 200 None
2026-03-28 22:02:09 [bca.uk] INFO: Saving data for LD64%20FZX: {'created_time': 1774735329.124199, 'last_price_update_time': 1774735329.124209, 'auction_closing_time': 1774951200.0}
2026-03-28 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD64%2520FZX') HTTP/1.1" 204 0
2026-03-28 22:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143540/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA57YVV/42811409?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=nyWRKONE8HKvE1Bd8e5fHoTy4qWWUPVu8%2FwiG6QJKuE%3D)
2026-03-28 22:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143530/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA57YVV/42811409?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=nyWRKONE8HKvE1Bd8e5fHoTy4qWWUPVu8%2FwiG6QJKuE%3D)
2026-03-28 22:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188617/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188617>
2026-03-28 22:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110973/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110973>
2026-03-28 22:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699093951/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY65OSN/42811345?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=nIVSbgrO1i9Xr%2BfbSLpc%2BtaM0zcISF5O%2FO1r76QJkIA%3D)
2026-03-28 22:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699033023/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT71NEN/42810987?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=rH6uqkSHrsaaYdvpCA%2FsZzV6mE0zUHVzVmdfRT1wrj0%3D)
2026-03-28 22:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188631/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG14YNA/42808187?sv=2020-08-04&st=2026-03-28T22%3A01%3A55Z&se=2026-03-28T22%3A26%3A55Z&sr=b&sp=r&sig=DGiN%2BSfP9fEeRz4iomC5Qiv6ES1KZsQ9RCNgoJLwpnk%3D)
2026-03-28 22:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023554/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV70UZS/42810918?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=OuGBCg%2BAeGR0D2f%2BeITBsmUKuqiSK1uvUwiSvUi6IQs%3D)
2026-03-28 22:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557298d90>
2026-03-28 22:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d1c14a-d5f3-5567-89ad-8d86774c1313/87d1c14a-d5f3-5567-89ad-8d86774c1313_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA21OVG%252F699060079%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060079/600 saved to cache
2026-03-28 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 87d1c14a-d5f3-5567-89ad-8d86774c1313
2026-03-28 22:02:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87d1c14a-d5f3-5567-89ad-8d86774c1313, skipping ID generation
2026-03-28 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87d1c14a-d5f3-5567-89ad-8d86774c1313 sending to next pipeline
2026-03-28 22:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 87d1c14a-d5f3-5567-89ad-8d86774c1313, identifier: CA21%20OVG
2026-03-28 22:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54778df10>
2026-03-28 22:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_546eaaae-2d78-532a-abb1-eac4aea0023f/546eaaae-2d78-532a-abb1-eac4aea0023f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHS19GYN%252F699038707%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038707/600 saved to cache
2026-03-28 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 546eaaae-2d78-532a-abb1-eac4aea0023f
2026-03-28 22:02:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 546eaaae-2d78-532a-abb1-eac4aea0023f, skipping ID generation
2026-03-28 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 546eaaae-2d78-532a-abb1-eac4aea0023f sending to next pipeline
2026-03-28 22:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 546eaaae-2d78-532a-abb1-eac4aea0023f, identifier: HS19%20GYN
2026-03-28 22:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554253610>
2026-03-28 22:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595887ba-7187-5162-8a50-188caa6efdd9/595887ba-7187-5162-8a50-188caa6efdd9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM63ETA%252F699074168%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074168/600 saved to cache
2026-03-28 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 595887ba-7187-5162-8a50-188caa6efdd9
2026-03-28 22:02:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 595887ba-7187-5162-8a50-188caa6efdd9, skipping ID generation
2026-03-28 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 595887ba-7187-5162-8a50-188caa6efdd9 sending to next pipeline
2026-03-28 22:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 595887ba-7187-5162-8a50-188caa6efdd9, identifier: YM63%20ETA
2026-03-28 22:02:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547f6f90>
2026-03-28 22:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0d2c8c1-587d-52a8-bac1-4dade51bc1df/b0d2c8c1-587d-52a8-bac1-4dade51bc1df_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN69YVF%252F699188563%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188563/600 saved to cache
2026-03-28 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b0d2c8c1-587d-52a8-bac1-4dade51bc1df
2026-03-28 22:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 87d1c14a-d5f3-5567-89ad-8d86774c1313 with identifier: CA21%20OVG
2026-03-28 22:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 87d1c14a-d5f3-5567-89ad-8d86774c1313 with identifier: CA21%20OVG
2026-03-28 22:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 87d1c14a-d5f3-5567-89ad-8d86774c1313 with identifier: CA21%20OVG to the API
2026-03-28 22:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060079/600>
{'auction_title': '',
'c_o_2_emission_value': 142,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d1c14a-d5f3-5567-89ad-8d86774c1313/87d1c14a-d5f3-5567-89ad-8d86774c1313_expert_report_file_33c39f18-f868-44bc-b64a-9ed199cf37ce.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CA21%20OVG-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '87d1c14a-d5f3-5567-89ad-8d86774c1313',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CA21 OVG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CA21%20OVG&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VAUXHALL',
'model': 'GRANDLAND X',
'odometer': 53553,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d1c14a-d5f3-5567-89ad-8d86774c1313/87d1c14a-d5f3-5567-89ad-8d86774c1313_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40226,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060057/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d1c14a-d5f3-5567-89ad-8d86774c1313/87d1c14a-d5f3-5567-89ad-8d86774c1313_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40842,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060067/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d1c14a-d5f3-5567-89ad-8d86774c1313/87d1c14a-d5f3-5567-89ad-8d86774c1313_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37627,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060079/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d1c14a-d5f3-5567-89ad-8d86774c1313/87d1c14a-d5f3-5567-89ad-8d86774c1313_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38386,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060095/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d1c14a-d5f3-5567-89ad-8d86774c1313/87d1c14a-d5f3-5567-89ad-8d86774c1313_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36346,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060107/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d1c14a-d5f3-5567-89ad-8d86774c1313/87d1c14a-d5f3-5567-89ad-8d86774c1313_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36047,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060113/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d1c14a-d5f3-5567-89ad-8d86774c1313/87d1c14a-d5f3-5567-89ad-8d86774c1313_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70525,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060128/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d1c14a-d5f3-5567-89ad-8d86774c1313/87d1c14a-d5f3-5567-89ad-8d86774c1313_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77131,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060148/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d1c14a-d5f3-5567-89ad-8d86774c1313/87d1c14a-d5f3-5567-89ad-8d86774c1313_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83155,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060169/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d1c14a-d5f3-5567-89ad-8d86774c1313/87d1c14a-d5f3-5567-89ad-8d86774c1313_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87969,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA21OVG/699060189/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'VAUXHALL GRANDLAND X 1.2 T 130 ELITE Hatchback',
'transmission': 'manual',
'trim': 'T 130 ELITE',
'vin': 'W0VZRHNS7M6817996',
'year': 2021}
2026-03-28 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA21%2520OVG%27 HTTP/1.1" 200 None
2026-03-28 22:02:10 [bca.uk] INFO: Saving data for CA21%20OVG: {'created_time': 1774735330.261545, 'last_price_update_time': 1774735330.261557, 'auction_closing_time': 1774951200.0}
2026-03-28 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CA21%2520OVG') HTTP/1.1" 204 0
2026-03-28 22:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 546eaaae-2d78-532a-abb1-eac4aea0023f with identifier: HS19%20GYN
2026-03-28 22:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 22:02:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=multicoloured HTTP/1.1" 200 None
2026-03-28 22:02:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 22:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 546eaaae-2d78-532a-abb1-eac4aea0023f with identifier: HS19%20GYN
2026-03-28 22:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 546eaaae-2d78-532a-abb1-eac4aea0023f with identifier: HS19%20GYN to the API
2026-03-28 22:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038707/600>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_546eaaae-2d78-532a-abb1-eac4aea0023f/546eaaae-2d78-532a-abb1-eac4aea0023f_expert_report_file_cb4882e9-26b8-4155-a7cb-1498a2ef0809.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HS19%20GYN-GB',
'category': 'Car',
'color': 'multicoloured',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '546eaaae-2d78-532a-abb1-eac4aea0023f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HS19 GYN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HS19%20GYN&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 46565,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_546eaaae-2d78-532a-abb1-eac4aea0023f/546eaaae-2d78-532a-abb1-eac4aea0023f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40443,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038692/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_546eaaae-2d78-532a-abb1-eac4aea0023f/546eaaae-2d78-532a-abb1-eac4aea0023f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41215,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038707/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_546eaaae-2d78-532a-abb1-eac4aea0023f/546eaaae-2d78-532a-abb1-eac4aea0023f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38457,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038720/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_546eaaae-2d78-532a-abb1-eac4aea0023f/546eaaae-2d78-532a-abb1-eac4aea0023f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39426,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038730/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_546eaaae-2d78-532a-abb1-eac4aea0023f/546eaaae-2d78-532a-abb1-eac4aea0023f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38317,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038738/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_546eaaae-2d78-532a-abb1-eac4aea0023f/546eaaae-2d78-532a-abb1-eac4aea0023f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37456,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038751/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_546eaaae-2d78-532a-abb1-eac4aea0023f/546eaaae-2d78-532a-abb1-eac4aea0023f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72103,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038773/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_546eaaae-2d78-532a-abb1-eac4aea0023f/546eaaae-2d78-532a-abb1-eac4aea0023f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67482,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038787/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_546eaaae-2d78-532a-abb1-eac4aea0023f/546eaaae-2d78-532a-abb1-eac4aea0023f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81644,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038817/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_546eaaae-2d78-532a-abb1-eac4aea0023f/546eaaae-2d78-532a-abb1-eac4aea0023f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75248,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS19GYN/699038842/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'RENAULT CAPTUR 1.5 DCI 90 ICONIC Hatchback',
'transmission': 'manual',
'trim': 'DCI 90 ICONIC',
'vin': 'VF1R8700663051596',
'year': 2019}
2026-03-28 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HS19%2520GYN%27 HTTP/1.1" 200 None
2026-03-28 22:02:10 [bca.uk] INFO: Saving data for HS19%20GYN: {'created_time': 1774735330.823671, 'last_price_update_time': 1774735330.823682, 'auction_closing_time': 1774951200.0}
2026-03-28 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HS19%2520GYN') HTTP/1.1" 204 0
2026-03-28 22:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 595887ba-7187-5162-8a50-188caa6efdd9 with identifier: YM63%20ETA
2026-03-28 22:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 22:02:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-28 22:02:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 22:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 595887ba-7187-5162-8a50-188caa6efdd9 with identifier: YM63%20ETA
2026-03-28 22:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 595887ba-7187-5162-8a50-188caa6efdd9 with identifier: YM63%20ETA to the API
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074168/600>
{'auction_title': '',
'c_o_2_emission_value': 169,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595887ba-7187-5162-8a50-188caa6efdd9/595887ba-7187-5162-8a50-188caa6efdd9_expert_report_file_509397fe-228c-4255-8570-c41f3683e1e5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YM63%20ETA-GB',
'category': 'Car',
'color': 'gold',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '595887ba-7187-5162-8a50-188caa6efdd9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YM63 ETA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YM63%20ETA&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLVO',
'model': 'XC70',
'odometer': 39272,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595887ba-7187-5162-8a50-188caa6efdd9/595887ba-7187-5162-8a50-188caa6efdd9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45083,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074164/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595887ba-7187-5162-8a50-188caa6efdd9/595887ba-7187-5162-8a50-188caa6efdd9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44318,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074168/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595887ba-7187-5162-8a50-188caa6efdd9/595887ba-7187-5162-8a50-188caa6efdd9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45350,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074173/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595887ba-7187-5162-8a50-188caa6efdd9/595887ba-7187-5162-8a50-188caa6efdd9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43095,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074178/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595887ba-7187-5162-8a50-188caa6efdd9/595887ba-7187-5162-8a50-188caa6efdd9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38787,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074184/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595887ba-7187-5162-8a50-188caa6efdd9/595887ba-7187-5162-8a50-188caa6efdd9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38190,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074188/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595887ba-7187-5162-8a50-188caa6efdd9/595887ba-7187-5162-8a50-188caa6efdd9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87106,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074199/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595887ba-7187-5162-8a50-188caa6efdd9/595887ba-7187-5162-8a50-188caa6efdd9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72306,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074203/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595887ba-7187-5162-8a50-188caa6efdd9/595887ba-7187-5162-8a50-188caa6efdd9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83778,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074210/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595887ba-7187-5162-8a50-188caa6efdd9/595887ba-7187-5162-8a50-188caa6efdd9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70915,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM63ETA/699074217/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VOLVO XC70 2.4 D5 215 AWD SE LUX G/T Estate',
'transmission': 'manual',
'trim': 'D5 215 AWD SE LUX G/T',
'vin': 'YV1BZ8256E1187921',
'year': 2014}
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM63%2520ETA%27 HTTP/1.1" 200 None
2026-03-28 22:02:11 [bca.uk] INFO: Saving data for YM63%20ETA: {'created_time': 1774735331.380096, 'last_price_update_time': 1774735331.380109, 'auction_closing_time': 1774951200.0}
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YM63%2520ETA') HTTP/1.1" 204 0
2026-03-28 22:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699033000/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699033000>
2026-03-28 22:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188536/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188536>
2026-03-28 22:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699093941/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093941>
2026-03-28 22:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023529/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023529>
2026-03-28 22:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188607/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188607>
2026-03-28 22:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032976/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032976>
2026-03-28 22:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023504/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023504>
2026-03-28 22:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188550/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN69YVF/42797384?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=2YQhuVPOEs8nllGGk7BCLIWyloC%2FrwsAAUaDV7wMkMk%3D)
2026-03-28 22:02:11 [scrapy.extensions.logstats] INFO: Crawled 53 pages (at 49 pages/min), scraped 76 items (at 55 items/min)
2026-03-28 22:02:11 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 22:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55430c5d0>
2026-03-28 22:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_088c09e3-d7eb-592d-ab1c-79cc7e5bdf02/088c09e3-d7eb-592d-ab1c-79cc7e5bdf02_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA57YVV%252F699143540%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143540/600 saved to cache
2026-03-28 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02
2026-03-28 22:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b29790>
2026-03-28 22:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_088c09e3-d7eb-592d-ab1c-79cc7e5bdf02/088c09e3-d7eb-592d-ab1c-79cc7e5bdf02_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA57YVV%252F699143530%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143530/600 saved to cache
2026-03-28 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02
2026-03-28 22:02:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02, skipping ID generation
2026-03-28 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02 sending to next pipeline
2026-03-28 22:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02, identifier: CA57%20YVV
2026-03-28 22:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547287d90>
2026-03-28 22:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c536c8-20b9-5eb5-bd31-426ff92c052b/d4c536c8-20b9-5eb5-bd31-426ff92c052b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY65OSN%252F699093951%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699093951/600 saved to cache
2026-03-28 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d4c536c8-20b9-5eb5-bd31-426ff92c052b
2026-03-28 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b28450>
2026-03-28 22:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5421d270-4706-56d4-861e-d213204bb57b/5421d270-4706-56d4-861e-d213204bb57b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT71NEN%252F699033023%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699033023/600 saved to cache
2026-03-28 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5421d270-4706-56d4-861e-d213204bb57b
2026-03-28 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542d5890>
2026-03-28 22:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_238a280e-8233-56ab-b3e9-1e6814e8a2fb/238a280e-8233-56ab-b3e9-1e6814e8a2fb_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG14YNA%252F699188631%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188631/600 saved to cache
2026-03-28 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 238a280e-8233-56ab-b3e9-1e6814e8a2fb
2026-03-28 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547317050>
2026-03-28 22:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c249da5-1d51-5bc9-a40c-4417dbaa5b62/9c249da5-1d51-5bc9-a40c-4417dbaa5b62_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV70UZS%252F699023554%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023554/600 saved to cache
2026-03-28 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9c249da5-1d51-5bc9-a40c-4417dbaa5b62
2026-03-28 22:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02 with identifier: CA57%20YVV
2026-03-28 22:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02 with identifier: CA57%20YVV
2026-03-28 22:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02 with identifier: CA57%20YVV to the API
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143530/600>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088c09e3-d7eb-592d-ab1c-79cc7e5bdf02/088c09e3-d7eb-592d-ab1c-79cc7e5bdf02_expert_report_file_1d97c261-2351-4d24-9f12-a8d51cdc93b4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CA57%20YVV-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '088c09e3-d7eb-592d-ab1c-79cc7e5bdf02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CA57 YVV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CA57%20YVV&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'PEUGEOT',
'model': '308',
'odometer': 69939,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088c09e3-d7eb-592d-ab1c-79cc7e5bdf02/088c09e3-d7eb-592d-ab1c-79cc7e5bdf02_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44470,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143511/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088c09e3-d7eb-592d-ab1c-79cc7e5bdf02/088c09e3-d7eb-592d-ab1c-79cc7e5bdf02_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42883,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143521/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088c09e3-d7eb-592d-ab1c-79cc7e5bdf02/088c09e3-d7eb-592d-ab1c-79cc7e5bdf02_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40543,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143530/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088c09e3-d7eb-592d-ab1c-79cc7e5bdf02/088c09e3-d7eb-592d-ab1c-79cc7e5bdf02_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38304,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143540/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088c09e3-d7eb-592d-ab1c-79cc7e5bdf02/088c09e3-d7eb-592d-ab1c-79cc7e5bdf02_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38560,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143555/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088c09e3-d7eb-592d-ab1c-79cc7e5bdf02/088c09e3-d7eb-592d-ab1c-79cc7e5bdf02_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38837,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143570/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088c09e3-d7eb-592d-ab1c-79cc7e5bdf02/088c09e3-d7eb-592d-ab1c-79cc7e5bdf02_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79760,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143597/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088c09e3-d7eb-592d-ab1c-79cc7e5bdf02/088c09e3-d7eb-592d-ab1c-79cc7e5bdf02_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72628,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143622/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088c09e3-d7eb-592d-ab1c-79cc7e5bdf02/088c09e3-d7eb-592d-ab1c-79cc7e5bdf02_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79687,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143640/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088c09e3-d7eb-592d-ab1c-79cc7e5bdf02/088c09e3-d7eb-592d-ab1c-79cc7e5bdf02_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67693,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA57YVV/699143664/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 1.6 VTI SPORT Hatchback',
'transmission': 'manual',
'trim': 'VTI SPORT',
'vin': 'VF34C5FWC55030079',
'year': 2008}
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA57%2520YVV%27 HTTP/1.1" 200 None
2026-03-28 22:02:12 [bca.uk] INFO: Saving data for CA57%20YVV: {'created_time': 1774735332.356792, 'last_price_update_time': 1774735332.356805, 'auction_closing_time': 1774864800.0}
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CA57%2520YVV') HTTP/1.1" 204 0
2026-03-28 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110973/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY65OSN/42811345?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=nIVSbgrO1i9Xr%2BfbSLpc%2BtaM0zcISF5O%2FO1r76QJkIA%3D)
2026-03-28 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110963/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110963>
2026-03-28 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188594/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188594>
2026-03-28 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032926/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032926>
2026-03-28 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032941/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032941>
2026-03-28 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188516/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188516>
2026-03-28 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023482/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023482>
2026-03-28 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188617/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG14YNA/42808187?sv=2020-08-04&st=2026-03-28T22%3A01%3A55Z&se=2026-03-28T22%3A26%3A55Z&sr=b&sp=r&sig=DGiN%2BSfP9fEeRz4iomC5Qiv6ES1KZsQ9RCNgoJLwpnk%3D)
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477eec90>
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0d2c8c1-587d-52a8-bac1-4dade51bc1df/b0d2c8c1-587d-52a8-bac1-4dade51bc1df_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN69YVF%252F699188550%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188550/600 saved to cache
2026-03-28 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b0d2c8c1-587d-52a8-bac1-4dade51bc1df
2026-03-28 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699093941/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY65OSN/42811345?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=nIVSbgrO1i9Xr%2BfbSLpc%2BtaM0zcISF5O%2FO1r76QJkIA%3D)
2026-03-28 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023504/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV70UZS/42810918?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=OuGBCg%2BAeGR0D2f%2BeITBsmUKuqiSK1uvUwiSvUi6IQs%3D)
2026-03-28 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699033000/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT71NEN/42810987?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=rH6uqkSHrsaaYdvpCA%2FsZzV6mE0zUHVzVmdfRT1wrj0%3D)
2026-03-28 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188536/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN69YVF/42797384?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=2YQhuVPOEs8nllGGk7BCLIWyloC%2FrwsAAUaDV7wMkMk%3D)
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542d25d0>
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c536c8-20b9-5eb5-bd31-426ff92c052b/d4c536c8-20b9-5eb5-bd31-426ff92c052b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY65OSN%252F699110973%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110973/600 saved to cache
2026-03-28 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d4c536c8-20b9-5eb5-bd31-426ff92c052b
2026-03-28 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023529/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV70UZS/42810918?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=OuGBCg%2BAeGR0D2f%2BeITBsmUKuqiSK1uvUwiSvUi6IQs%3D)
2026-03-28 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032976/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT71NEN/42810987?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=rH6uqkSHrsaaYdvpCA%2FsZzV6mE0zUHVzVmdfRT1wrj0%3D)
2026-03-28 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023473/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023473>
2026-03-28 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188516/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN69YVF/42797384?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=2YQhuVPOEs8nllGGk7BCLIWyloC%2FrwsAAUaDV7wMkMk%3D)
2026-03-28 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023482/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV70UZS/42810918?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=OuGBCg%2BAeGR0D2f%2BeITBsmUKuqiSK1uvUwiSvUi6IQs%3D)
2026-03-28 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032926/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT71NEN/42810987?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=rH6uqkSHrsaaYdvpCA%2FsZzV6mE0zUHVzVmdfRT1wrj0%3D)
2026-03-28 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188607/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG14YNA/42808187?sv=2020-08-04&st=2026-03-28T22%3A01%3A55Z&se=2026-03-28T22%3A26%3A55Z&sr=b&sp=r&sig=DGiN%2BSfP9fEeRz4iomC5Qiv6ES1KZsQ9RCNgoJLwpnk%3D)
2026-03-28 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032941/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT71NEN/42810987?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=rH6uqkSHrsaaYdvpCA%2FsZzV6mE0zUHVzVmdfRT1wrj0%3D)
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54777f410>
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_238a280e-8233-56ab-b3e9-1e6814e8a2fb/238a280e-8233-56ab-b3e9-1e6814e8a2fb_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG14YNA%252F699188617%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188617/600 saved to cache
2026-03-28 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 238a280e-8233-56ab-b3e9-1e6814e8a2fb
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473db150>
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c536c8-20b9-5eb5-bd31-426ff92c052b/d4c536c8-20b9-5eb5-bd31-426ff92c052b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY65OSN%252F699093941%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699093941/600 saved to cache
2026-03-28 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d4c536c8-20b9-5eb5-bd31-426ff92c052b
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55480a990>
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c249da5-1d51-5bc9-a40c-4417dbaa5b62/9c249da5-1d51-5bc9-a40c-4417dbaa5b62_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV70UZS%252F699023504%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023504/600 saved to cache
2026-03-28 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c249da5-1d51-5bc9-a40c-4417dbaa5b62
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b80e90>
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5421d270-4706-56d4-861e-d213204bb57b/5421d270-4706-56d4-861e-d213204bb57b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT71NEN%252F699033000%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699033000/600 saved to cache
2026-03-28 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5421d270-4706-56d4-861e-d213204bb57b
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554286c90>
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0d2c8c1-587d-52a8-bac1-4dade51bc1df/b0d2c8c1-587d-52a8-bac1-4dade51bc1df_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN69YVF%252F699188536%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188536/600 saved to cache
2026-03-28 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b0d2c8c1-587d-52a8-bac1-4dade51bc1df
2026-03-28 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110963/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY65OSN/42811345?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=nIVSbgrO1i9Xr%2BfbSLpc%2BtaM0zcISF5O%2FO1r76QJkIA%3D)
2026-03-28 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023461/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023461>
2026-03-28 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699093922/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093922>
2026-03-28 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032912/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032912>
2026-03-28 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188583/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188583>
2026-03-28 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188594/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG14YNA/42808187?sv=2020-08-04&st=2026-03-28T22%3A01%3A55Z&se=2026-03-28T22%3A26%3A55Z&sr=b&sp=r&sig=DGiN%2BSfP9fEeRz4iomC5Qiv6ES1KZsQ9RCNgoJLwpnk%3D)
2026-03-28 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032900/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032900>
2026-03-28 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188577/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188577>
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b82450>
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c249da5-1d51-5bc9-a40c-4417dbaa5b62/9c249da5-1d51-5bc9-a40c-4417dbaa5b62_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV70UZS%252F699023529%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023529/600 saved to cache
2026-03-28 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c249da5-1d51-5bc9-a40c-4417dbaa5b62
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473dcf90>
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5421d270-4706-56d4-861e-d213204bb57b/5421d270-4706-56d4-861e-d213204bb57b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT71NEN%252F699032976%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032976/600 saved to cache
2026-03-28 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5421d270-4706-56d4-861e-d213204bb57b
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547761950>
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0d2c8c1-587d-52a8-bac1-4dade51bc1df/b0d2c8c1-587d-52a8-bac1-4dade51bc1df_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN69YVF%252F699188516%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188516/600 saved to cache
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b0d2c8c1-587d-52a8-bac1-4dade51bc1df
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54723bf90>
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c249da5-1d51-5bc9-a40c-4417dbaa5b62/9c249da5-1d51-5bc9-a40c-4417dbaa5b62_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV70UZS%252F699023482%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023482/600 saved to cache
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c249da5-1d51-5bc9-a40c-4417dbaa5b62
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f89950>
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5421d270-4706-56d4-861e-d213204bb57b/5421d270-4706-56d4-861e-d213204bb57b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT71NEN%252F699032926%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032926/600 saved to cache
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5421d270-4706-56d4-861e-d213204bb57b
2026-03-28 22:02:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554800d50>
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_238a280e-8233-56ab-b3e9-1e6814e8a2fb/238a280e-8233-56ab-b3e9-1e6814e8a2fb_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG14YNA%252F699188607%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188607/600 saved to cache
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 238a280e-8233-56ab-b3e9-1e6814e8a2fb
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477c74d0>
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5421d270-4706-56d4-861e-d213204bb57b/5421d270-4706-56d4-861e-d213204bb57b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT71NEN%252F699032941%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032941/600 saved to cache
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5421d270-4706-56d4-861e-d213204bb57b
2026-03-28 22:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023473/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV70UZS/42810918?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=OuGBCg%2BAeGR0D2f%2BeITBsmUKuqiSK1uvUwiSvUi6IQs%3D)
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554986550>
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c536c8-20b9-5eb5-bd31-426ff92c052b/d4c536c8-20b9-5eb5-bd31-426ff92c052b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY65OSN%252F699110963%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110963/600 saved to cache
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d4c536c8-20b9-5eb5-bd31-426ff92c052b
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54714dd50>
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_238a280e-8233-56ab-b3e9-1e6814e8a2fb/238a280e-8233-56ab-b3e9-1e6814e8a2fb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG14YNA%252F699188594%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188594/600 saved to cache
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 238a280e-8233-56ab-b3e9-1e6814e8a2fb
2026-03-28 22:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032890/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032890>
2026-03-28 22:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110942/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110942>
2026-03-28 22:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188490/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188490>
2026-03-28 22:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023437/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023437>
2026-03-28 22:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188570/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188570>
2026-03-28 22:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023447/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023447>
2026-03-28 22:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188564/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DG14YNA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032877/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MT71NEN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54723af10>
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c249da5-1d51-5bc9-a40c-4417dbaa5b62/9c249da5-1d51-5bc9-a40c-4417dbaa5b62_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV70UZS%252F699023473%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023473/600 saved to cache
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c249da5-1d51-5bc9-a40c-4417dbaa5b62
2026-03-28 22:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032900/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT71NEN/42810987?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=rH6uqkSHrsaaYdvpCA%2FsZzV6mE0zUHVzVmdfRT1wrj0%3D)
2026-03-28 22:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023426/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BV70UZS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188577/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG14YNA/42808187?sv=2020-08-04&st=2026-03-28T22%3A01%3A55Z&se=2026-03-28T22%3A26%3A55Z&sr=b&sp=r&sig=DGiN%2BSfP9fEeRz4iomC5Qiv6ES1KZsQ9RCNgoJLwpnk%3D)
2026-03-28 22:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699093922/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY65OSN/42811345?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=nIVSbgrO1i9Xr%2BfbSLpc%2BtaM0zcISF5O%2FO1r76QJkIA%3D)
2026-03-28 22:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023461/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV70UZS/42810918?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=OuGBCg%2BAeGR0D2f%2BeITBsmUKuqiSK1uvUwiSvUi6IQs%3D)
2026-03-28 22:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071288/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071288>
2026-03-28 22:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188583/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG14YNA/42808187?sv=2020-08-04&st=2026-03-28T22%3A01%3A55Z&se=2026-03-28T22%3A26%3A55Z&sr=b&sp=r&sig=DGiN%2BSfP9fEeRz4iomC5Qiv6ES1KZsQ9RCNgoJLwpnk%3D)
2026-03-28 22:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023447/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV70UZS/42810918?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=OuGBCg%2BAeGR0D2f%2BeITBsmUKuqiSK1uvUwiSvUi6IQs%3D)
2026-03-28 22:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032912/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT71NEN/42810987?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=rH6uqkSHrsaaYdvpCA%2FsZzV6mE0zUHVzVmdfRT1wrj0%3D)
2026-03-28 22:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188490/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN69YVF/42797384?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=2YQhuVPOEs8nllGGk7BCLIWyloC%2FrwsAAUaDV7wMkMk%3D)
2026-03-28 22:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188564/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG14YNA/42808187?sv=2020-08-04&st=2026-03-28T22%3A01%3A55Z&se=2026-03-28T22%3A26%3A55Z&sr=b&sp=r&sig=DGiN%2BSfP9fEeRz4iomC5Qiv6ES1KZsQ9RCNgoJLwpnk%3D)
2026-03-28 22:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032877/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT71NEN/42810987?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=rH6uqkSHrsaaYdvpCA%2FsZzV6mE0zUHVzVmdfRT1wrj0%3D)
2026-03-28 22:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110942/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY65OSN/42811345?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=nIVSbgrO1i9Xr%2BfbSLpc%2BtaM0zcISF5O%2FO1r76QJkIA%3D)
2026-03-28 22:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023437/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV70UZS/42810918?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=OuGBCg%2BAeGR0D2f%2BeITBsmUKuqiSK1uvUwiSvUi6IQs%3D)
2026-03-28 22:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188570/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG14YNA/42808187?sv=2020-08-04&st=2026-03-28T22%3A01%3A55Z&se=2026-03-28T22%3A26%3A55Z&sr=b&sp=r&sig=DGiN%2BSfP9fEeRz4iomC5Qiv6ES1KZsQ9RCNgoJLwpnk%3D)
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473051d0>
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5421d270-4706-56d4-861e-d213204bb57b/5421d270-4706-56d4-861e-d213204bb57b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT71NEN%252F699032900%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032900/600 saved to cache
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5421d270-4706-56d4-861e-d213204bb57b
2026-03-28 22:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023426/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV70UZS/42810918?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=OuGBCg%2BAeGR0D2f%2BeITBsmUKuqiSK1uvUwiSvUi6IQs%3D)
2026-03-28 22:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032890/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT71NEN/42810987?sv=2020-08-04&st=2026-03-28T22%3A01%3A56Z&se=2026-03-28T22%3A26%3A56Z&sr=b&sp=r&sig=rH6uqkSHrsaaYdvpCA%2FsZzV6mE0zUHVzVmdfRT1wrj0%3D)
2026-03-28 22:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO22KPT/42811142?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=1%2BEjPFbwTiiWyiyCZVlnljJUhR2oYtbJyuHwOJgIeoM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RO22%20KPT-GB>
2026-03-28 22:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG13FKD/42810885?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=Pgf4CbZ3Xrn2VVPEUN28cWI9Q7Qnnc%2B7z4mHlgVw6As%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BG13%20FKD-GB>
2026-03-28 22:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994117/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994117>
2026-03-28 22:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699126457/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126457>
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542888d0>
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_238a280e-8233-56ab-b3e9-1e6814e8a2fb/238a280e-8233-56ab-b3e9-1e6814e8a2fb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG14YNA%252F699188577%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188577/600 saved to cache
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 238a280e-8233-56ab-b3e9-1e6814e8a2fb
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b1f10>
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c536c8-20b9-5eb5-bd31-426ff92c052b/d4c536c8-20b9-5eb5-bd31-426ff92c052b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY65OSN%252F699093922%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699093922/600 saved to cache
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d4c536c8-20b9-5eb5-bd31-426ff92c052b
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544c3a90>
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c249da5-1d51-5bc9-a40c-4417dbaa5b62/9c249da5-1d51-5bc9-a40c-4417dbaa5b62_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV70UZS%252F699023461%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023461/600 saved to cache
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c249da5-1d51-5bc9-a40c-4417dbaa5b62
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542a6d50>
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_238a280e-8233-56ab-b3e9-1e6814e8a2fb/238a280e-8233-56ab-b3e9-1e6814e8a2fb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG14YNA%252F699188583%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188583/600 saved to cache
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 238a280e-8233-56ab-b3e9-1e6814e8a2fb
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547eefd0>
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c249da5-1d51-5bc9-a40c-4417dbaa5b62/9c249da5-1d51-5bc9-a40c-4417dbaa5b62_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV70UZS%252F699023447%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023447/600 saved to cache
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c249da5-1d51-5bc9-a40c-4417dbaa5b62
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472e7b10>
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5421d270-4706-56d4-861e-d213204bb57b/5421d270-4706-56d4-861e-d213204bb57b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT71NEN%252F699032912%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032912/600 saved to cache
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5421d270-4706-56d4-861e-d213204bb57b
2026-03-28 22:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071282/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071282>
2026-03-28 22:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071288/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG16XLF/42811219?sv=2020-08-04&st=2026-03-28T22%3A01%3A19Z&se=2026-03-28T22%3A26%3A19Z&sr=b&sp=r&sig=piDa4JVgaWBzjvnw0OZ1irSwQFsxpWFyq8MJd75hPTs%3D)
2026-03-28 22:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994077/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994077>
2026-03-28 22:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE20NXF/42811204?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=8guyqRkCVpBOXe0dgepjNvrccjw3jG3HSH7VEUA89kk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AE20%20NXF-GB>
2026-03-28 22:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK12LUP/42810942?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=CJGWCFvotVIxFu5vsyjuS7m3KqOjHqCp9HQAw7ZqR%2BE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YK12%20LUP-GB>
2026-03-28 22:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699126431/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126431>
2026-03-28 22:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG19DRZ/42810262?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=r5DoT3V6pkDiNlGEETNxtyjahcekFrVAyf%2Fq0%2Ff6cS8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YG19%20DRZ-GB>
2026-03-28 22:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ21YWB/42811229?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=CRadIFOsUYF5mJfLgLZRcdi8AXzc77Zr1rzpVvc8LYI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ21%20YWB-GB>
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b2250>
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0d2c8c1-587d-52a8-bac1-4dade51bc1df/b0d2c8c1-587d-52a8-bac1-4dade51bc1df_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN69YVF%252F699188490%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188490/600 saved to cache
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b0d2c8c1-587d-52a8-bac1-4dade51bc1df
2026-03-28 22:02:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0d2c8c1-587d-52a8-bac1-4dade51bc1df, skipping ID generation
2026-03-28 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0d2c8c1-587d-52a8-bac1-4dade51bc1df sending to next pipeline
2026-03-28 22:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b0d2c8c1-587d-52a8-bac1-4dade51bc1df, identifier: CN69%20YVF
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472e5450>
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_238a280e-8233-56ab-b3e9-1e6814e8a2fb/238a280e-8233-56ab-b3e9-1e6814e8a2fb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG14YNA%252F699188564%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188564/600 saved to cache
2026-03-28 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 238a280e-8233-56ab-b3e9-1e6814e8a2fb
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547326c50>
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5421d270-4706-56d4-861e-d213204bb57b/5421d270-4706-56d4-861e-d213204bb57b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT71NEN%252F699032877%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032877/600 saved to cache
2026-03-28 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5421d270-4706-56d4-861e-d213204bb57b
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557298090>
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c536c8-20b9-5eb5-bd31-426ff92c052b/d4c536c8-20b9-5eb5-bd31-426ff92c052b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY65OSN%252F699110942%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110942/600 saved to cache
2026-03-28 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d4c536c8-20b9-5eb5-bd31-426ff92c052b
2026-03-28 22:02:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4c536c8-20b9-5eb5-bd31-426ff92c052b, skipping ID generation
2026-03-28 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4c536c8-20b9-5eb5-bd31-426ff92c052b sending to next pipeline
2026-03-28 22:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d4c536c8-20b9-5eb5-bd31-426ff92c052b, identifier: FY65%20OSN
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472e46d0>
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c249da5-1d51-5bc9-a40c-4417dbaa5b62/9c249da5-1d51-5bc9-a40c-4417dbaa5b62_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV70UZS%252F699023437%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023437/600 saved to cache
2026-03-28 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c249da5-1d51-5bc9-a40c-4417dbaa5b62
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54778a890>
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_238a280e-8233-56ab-b3e9-1e6814e8a2fb/238a280e-8233-56ab-b3e9-1e6814e8a2fb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG14YNA%252F699188570%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188570/600 saved to cache
2026-03-28 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 238a280e-8233-56ab-b3e9-1e6814e8a2fb
2026-03-28 22:02:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 238a280e-8233-56ab-b3e9-1e6814e8a2fb, skipping ID generation
2026-03-28 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 238a280e-8233-56ab-b3e9-1e6814e8a2fb sending to next pipeline
2026-03-28 22:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 238a280e-8233-56ab-b3e9-1e6814e8a2fb, identifier: DG14%20YNA
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55430dd50>
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c249da5-1d51-5bc9-a40c-4417dbaa5b62/9c249da5-1d51-5bc9-a40c-4417dbaa5b62_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV70UZS%252F699023426%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023426/600 saved to cache
2026-03-28 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c249da5-1d51-5bc9-a40c-4417dbaa5b62
2026-03-28 22:02:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c249da5-1d51-5bc9-a40c-4417dbaa5b62, skipping ID generation
2026-03-28 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c249da5-1d51-5bc9-a40c-4417dbaa5b62 sending to next pipeline
2026-03-28 22:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9c249da5-1d51-5bc9-a40c-4417dbaa5b62, identifier: BV70%20UZS
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554808e50>
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5421d270-4706-56d4-861e-d213204bb57b/5421d270-4706-56d4-861e-d213204bb57b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT71NEN%252F699032890%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032890/600 saved to cache
2026-03-28 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5421d270-4706-56d4-861e-d213204bb57b
2026-03-28 22:02:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5421d270-4706-56d4-861e-d213204bb57b, skipping ID generation
2026-03-28 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5421d270-4706-56d4-861e-d213204bb57b sending to next pipeline
2026-03-28 22:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5421d270-4706-56d4-861e-d213204bb57b, identifier: MT71%20NEN
2026-03-28 22:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b0d2c8c1-587d-52a8-bac1-4dade51bc1df with identifier: CN69%20YVF
2026-03-28 22:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b0d2c8c1-587d-52a8-bac1-4dade51bc1df with identifier: CN69%20YVF
2026-03-28 22:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b0d2c8c1-587d-52a8-bac1-4dade51bc1df with identifier: CN69%20YVF to the API
2026-03-28 22:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188490/600>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0d2c8c1-587d-52a8-bac1-4dade51bc1df/b0d2c8c1-587d-52a8-bac1-4dade51bc1df_expert_report_file_0e7a6942-a5d6-4520-914b-327291407560.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CN69%20YVF-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b0d2c8c1-587d-52a8-bac1-4dade51bc1df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CN69 YVF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CN69%20YVF&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'MG MOTOR UK',
'model': 'MG3',
'odometer': 44980,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0d2c8c1-587d-52a8-bac1-4dade51bc1df/b0d2c8c1-587d-52a8-bac1-4dade51bc1df_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41339,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188480/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0d2c8c1-587d-52a8-bac1-4dade51bc1df/b0d2c8c1-587d-52a8-bac1-4dade51bc1df_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41654,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188490/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0d2c8c1-587d-52a8-bac1-4dade51bc1df/b0d2c8c1-587d-52a8-bac1-4dade51bc1df_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38163,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188494/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0d2c8c1-587d-52a8-bac1-4dade51bc1df/b0d2c8c1-587d-52a8-bac1-4dade51bc1df_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38604,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188503/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0d2c8c1-587d-52a8-bac1-4dade51bc1df/b0d2c8c1-587d-52a8-bac1-4dade51bc1df_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37731,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188509/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0d2c8c1-587d-52a8-bac1-4dade51bc1df/b0d2c8c1-587d-52a8-bac1-4dade51bc1df_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37478,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188516/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0d2c8c1-587d-52a8-bac1-4dade51bc1df/b0d2c8c1-587d-52a8-bac1-4dade51bc1df_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84715,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188536/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0d2c8c1-587d-52a8-bac1-4dade51bc1df/b0d2c8c1-587d-52a8-bac1-4dade51bc1df_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66576,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188550/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0d2c8c1-587d-52a8-bac1-4dade51bc1df/b0d2c8c1-587d-52a8-bac1-4dade51bc1df_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82283,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188563/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0d2c8c1-587d-52a8-bac1-4dade51bc1df/b0d2c8c1-587d-52a8-bac1-4dade51bc1df_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77491,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN69YVF/699188575/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'MG MOTOR UK MG3 1.5 VTI-TECH EXCLUSIVE Hatchback',
'transmission': 'manual',
'trim': 'VTI-TECH EXCLUSIVE',
'vin': 'SDPZ1CBDAKS067971',
'year': 2019}
2026-03-28 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN69%2520YVF%27 HTTP/1.1" 200 None
2026-03-28 22:02:15 [bca.uk] INFO: Saving data for CN69%20YVF: {'created_time': 1774735335.278249, 'last_price_update_time': 1774735335.278257, 'auction_closing_time': 1774951200.0}
2026-03-28 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CN69%2520YVF') HTTP/1.1" 204 0
2026-03-28 22:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d4c536c8-20b9-5eb5-bd31-426ff92c052b with identifier: FY65%20OSN
2026-03-28 22:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d4c536c8-20b9-5eb5-bd31-426ff92c052b with identifier: FY65%20OSN
2026-03-28 22:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d4c536c8-20b9-5eb5-bd31-426ff92c052b with identifier: FY65%20OSN to the API
2026-03-28 22:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110942/600>
{'auction_title': '',
'c_o_2_emission_value': 89,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c536c8-20b9-5eb5-bd31-426ff92c052b/d4c536c8-20b9-5eb5-bd31-426ff92c052b_expert_report_file_0f872af8-a49e-4739-8299-461dd235b5fe.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FY65%20OSN-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd4c536c8-20b9-5eb5-bd31-426ff92c052b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FY65 OSN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FY65%20OSN&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'BMW',
'model': '116D',
'odometer': 52417,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c536c8-20b9-5eb5-bd31-426ff92c052b/d4c536c8-20b9-5eb5-bd31-426ff92c052b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45771,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110925/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c536c8-20b9-5eb5-bd31-426ff92c052b/d4c536c8-20b9-5eb5-bd31-426ff92c052b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43360,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110942/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c536c8-20b9-5eb5-bd31-426ff92c052b/d4c536c8-20b9-5eb5-bd31-426ff92c052b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49066,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699093922/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c536c8-20b9-5eb5-bd31-426ff92c052b/d4c536c8-20b9-5eb5-bd31-426ff92c052b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44076,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110957/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c536c8-20b9-5eb5-bd31-426ff92c052b/d4c536c8-20b9-5eb5-bd31-426ff92c052b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49382,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699093933/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c536c8-20b9-5eb5-bd31-426ff92c052b/d4c536c8-20b9-5eb5-bd31-426ff92c052b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42017,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110963/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c536c8-20b9-5eb5-bd31-426ff92c052b/d4c536c8-20b9-5eb5-bd31-426ff92c052b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47518,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699093941/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c536c8-20b9-5eb5-bd31-426ff92c052b/d4c536c8-20b9-5eb5-bd31-426ff92c052b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37549,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110973/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c536c8-20b9-5eb5-bd31-426ff92c052b/d4c536c8-20b9-5eb5-bd31-426ff92c052b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45492,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699093951/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c536c8-20b9-5eb5-bd31-426ff92c052b/d4c536c8-20b9-5eb5-bd31-426ff92c052b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36370,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65OSN/699110982/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'BMW 116D 1.5 EFD PLUS Hatchback',
'transmission': 'manual',
'trim': 'EFD PLUS',
'vin': 'WBA1V920805D11413',
'year': 2015}
2026-03-28 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY65%2520OSN%27 HTTP/1.1" 200 None
2026-03-28 22:02:15 [bca.uk] INFO: Saving data for FY65%20OSN: {'created_time': 1774735335.674584, 'last_price_update_time': 1774735335.674593, 'auction_closing_time': 1774864800.0}
2026-03-28 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FY65%2520OSN') HTTP/1.1" 204 0
2026-03-28 22:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 238a280e-8233-56ab-b3e9-1e6814e8a2fb with identifier: DG14%20YNA
2026-03-28 22:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 22:02:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-28 22:02:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 22:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 238a280e-8233-56ab-b3e9-1e6814e8a2fb with identifier: DG14%20YNA
2026-03-28 22:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 238a280e-8233-56ab-b3e9-1e6814e8a2fb with identifier: DG14%20YNA to the API
2026-03-28 22:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188570/600>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238a280e-8233-56ab-b3e9-1e6814e8a2fb/238a280e-8233-56ab-b3e9-1e6814e8a2fb_expert_report_file_785555aa-4c8b-4dff-ad1d-f2c8f3a1e9ab.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DG14%20YNA-GB',
'category': 'Car',
'color': 'yellow',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '238a280e-8233-56ab-b3e9-1e6814e8a2fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DG14 YNA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DG14%20YNA&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VAUXHALL',
'model': 'ADAM',
'odometer': 51603,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238a280e-8233-56ab-b3e9-1e6814e8a2fb/238a280e-8233-56ab-b3e9-1e6814e8a2fb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41572,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188564/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238a280e-8233-56ab-b3e9-1e6814e8a2fb/238a280e-8233-56ab-b3e9-1e6814e8a2fb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41865,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188570/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238a280e-8233-56ab-b3e9-1e6814e8a2fb/238a280e-8233-56ab-b3e9-1e6814e8a2fb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39545,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188577/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238a280e-8233-56ab-b3e9-1e6814e8a2fb/238a280e-8233-56ab-b3e9-1e6814e8a2fb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40059,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188583/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238a280e-8233-56ab-b3e9-1e6814e8a2fb/238a280e-8233-56ab-b3e9-1e6814e8a2fb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40675,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188588/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238a280e-8233-56ab-b3e9-1e6814e8a2fb/238a280e-8233-56ab-b3e9-1e6814e8a2fb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39604,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188594/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238a280e-8233-56ab-b3e9-1e6814e8a2fb/238a280e-8233-56ab-b3e9-1e6814e8a2fb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96684,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188607/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238a280e-8233-56ab-b3e9-1e6814e8a2fb/238a280e-8233-56ab-b3e9-1e6814e8a2fb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81541,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188617/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238a280e-8233-56ab-b3e9-1e6814e8a2fb/238a280e-8233-56ab-b3e9-1e6814e8a2fb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89512,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188631/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238a280e-8233-56ab-b3e9-1e6814e8a2fb/238a280e-8233-56ab-b3e9-1e6814e8a2fb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102995,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG14YNA/699188642/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VAUXHALL ADAM 1.4 VVT 100 SLAM Hatchback',
'transmission': 'manual',
'trim': 'VVT 100 SLAM',
'vin': 'W0L0MAP08E6040602',
'year': 2014}
2026-03-28 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG14%2520YNA%27 HTTP/1.1" 200 None
2026-03-28 22:02:16 [bca.uk] INFO: Saving data for DG14%20YNA: {'created_time': 1774735336.207233, 'last_price_update_time': 1774735336.207243, 'auction_closing_time': 1774951200.0}
2026-03-28 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DG14%2520YNA') HTTP/1.1" 204 0
2026-03-28 22:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9c249da5-1d51-5bc9-a40c-4417dbaa5b62 with identifier: BV70%20UZS
2026-03-28 22:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9c249da5-1d51-5bc9-a40c-4417dbaa5b62 with identifier: BV70%20UZS
2026-03-28 22:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9c249da5-1d51-5bc9-a40c-4417dbaa5b62 with identifier: BV70%20UZS to the API
2026-03-28 22:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023426/600>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c249da5-1d51-5bc9-a40c-4417dbaa5b62/9c249da5-1d51-5bc9-a40c-4417dbaa5b62_expert_report_file_c8b94598-516c-4261-873f-13d1d2094a58.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BV70%20UZS-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9c249da5-1d51-5bc9-a40c-4417dbaa5b62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BV70 UZS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BV70%20UZS&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'KIA',
'model': 'STONIC',
'odometer': 19252,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c249da5-1d51-5bc9-a40c-4417dbaa5b62/9c249da5-1d51-5bc9-a40c-4417dbaa5b62_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40076,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023426/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c249da5-1d51-5bc9-a40c-4417dbaa5b62/9c249da5-1d51-5bc9-a40c-4417dbaa5b62_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40945,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023437/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c249da5-1d51-5bc9-a40c-4417dbaa5b62/9c249da5-1d51-5bc9-a40c-4417dbaa5b62_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38457,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023447/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c249da5-1d51-5bc9-a40c-4417dbaa5b62/9c249da5-1d51-5bc9-a40c-4417dbaa5b62_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39698,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023461/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c249da5-1d51-5bc9-a40c-4417dbaa5b62/9c249da5-1d51-5bc9-a40c-4417dbaa5b62_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37394,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023473/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c249da5-1d51-5bc9-a40c-4417dbaa5b62/9c249da5-1d51-5bc9-a40c-4417dbaa5b62_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37161,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023482/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c249da5-1d51-5bc9-a40c-4417dbaa5b62/9c249da5-1d51-5bc9-a40c-4417dbaa5b62_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89725,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023504/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c249da5-1d51-5bc9-a40c-4417dbaa5b62/9c249da5-1d51-5bc9-a40c-4417dbaa5b62_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66685,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023529/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c249da5-1d51-5bc9-a40c-4417dbaa5b62/9c249da5-1d51-5bc9-a40c-4417dbaa5b62_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79814,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023554/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c249da5-1d51-5bc9-a40c-4417dbaa5b62/9c249da5-1d51-5bc9-a40c-4417dbaa5b62_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80672,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV70UZS/699023578/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'KIA STONIC 1.0 T GDI 100 2 Hatchback',
'transmission': 'manual',
'trim': 'T GDI 100 2',
'vin': 'KNAD6817LM6473686',
'year': 2021}
2026-03-28 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV70%2520UZS%27 HTTP/1.1" 200 None
2026-03-28 22:02:16 [bca.uk] INFO: Saving data for BV70%20UZS: {'created_time': 1774735336.641995, 'last_price_update_time': 1774735336.642006, 'auction_closing_time': 1774951200.0}
2026-03-28 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BV70%2520UZS') HTTP/1.1" 204 0
2026-03-28 22:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5421d270-4706-56d4-861e-d213204bb57b with identifier: MT71%20NEN
2026-03-28 22:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5421d270-4706-56d4-861e-d213204bb57b with identifier: MT71%20NEN
2026-03-28 22:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5421d270-4706-56d4-861e-d213204bb57b with identifier: MT71%20NEN to the API
2026-03-28 22:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032890/600>
{'auction_title': '',
'c_o_2_emission_value': 133,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5421d270-4706-56d4-861e-d213204bb57b/5421d270-4706-56d4-861e-d213204bb57b_expert_report_file_aab5f253-0af3-4abf-bf5d-c25f1ddf6163.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT71%20NEN-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '5421d270-4706-56d4-861e-d213204bb57b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT71 NEN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT71%20NEN&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'KIA',
'model': 'XCEED',
'odometer': 30110,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5421d270-4706-56d4-861e-d213204bb57b/5421d270-4706-56d4-861e-d213204bb57b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43465,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032877/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5421d270-4706-56d4-861e-d213204bb57b/5421d270-4706-56d4-861e-d213204bb57b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43924,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032890/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5421d270-4706-56d4-861e-d213204bb57b/5421d270-4706-56d4-861e-d213204bb57b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40708,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032900/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5421d270-4706-56d4-861e-d213204bb57b/5421d270-4706-56d4-861e-d213204bb57b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42197,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032912/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5421d270-4706-56d4-861e-d213204bb57b/5421d270-4706-56d4-861e-d213204bb57b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38836,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032926/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5421d270-4706-56d4-861e-d213204bb57b/5421d270-4706-56d4-861e-d213204bb57b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37788,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032941/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5421d270-4706-56d4-861e-d213204bb57b/5421d270-4706-56d4-861e-d213204bb57b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86130,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699032976/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5421d270-4706-56d4-861e-d213204bb57b/5421d270-4706-56d4-861e-d213204bb57b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88568,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699033000/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5421d270-4706-56d4-861e-d213204bb57b/5421d270-4706-56d4-861e-d213204bb57b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97756,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699033023/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5421d270-4706-56d4-861e-d213204bb57b/5421d270-4706-56d4-861e-d213204bb57b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85446,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT71NEN/699033043/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'KIA XCEED 1.6 CRDI 48V 115 3 ISG Hatchback',
'transmission': 'manual',
'trim': 'CRDI 48V 115 3 ISG',
'vin': 'U5YH5F19LML077195',
'year': 2021}
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT71%2520NEN%27 HTTP/1.1" 200 None
2026-03-28 22:02:17 [bca.uk] INFO: Saving data for MT71%20NEN: {'created_time': 1774735337.054301, 'last_price_update_time': 1774735337.05431, 'auction_closing_time': 1774951200.0}
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT71%2520NEN') HTTP/1.1" 204 0
2026-03-28 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699126457/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WU66XNV/42811422?sv=2020-08-04&st=2026-03-28T22%3A01%3A16Z&se=2026-03-28T22%3A26%3A16Z&sr=b&sp=r&sig=iEWCiRexucMVz979VRM55ID%2B0dAdHnqV0R4MKdIaGkA%3D)
2026-03-28 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994117/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP11OHH/42810859?sv=2020-08-04&st=2026-03-28T22%3A01%3A17Z&se=2026-03-28T22%3A26%3A17Z&sr=b&sp=r&sig=b7CgL1od%2BxWYmvFyCkZBnwP%2Fc8hvRbuQDmBfA%2FtGEC4%3D)
2026-03-28 22:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093999/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093999>
2026-03-28 22:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071266/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071266>
2026-03-28 22:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110911/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110911>
2026-03-28 22:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093969/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093969>
2026-03-28 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO22KPT/42811142?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=1%2BEjPFbwTiiWyiyCZVlnljJUhR2oYtbJyuHwOJgIeoM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547efb10>
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1/87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG16XLF%252F699071288%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071288/600 saved to cache
2026-03-28 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1
2026-03-28 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG13FKD/42810885?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=Pgf4CbZ3Xrn2VVPEUN28cWI9Q7Qnnc%2B7z4mHlgVw6As%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994077/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP11OHH/42810859?sv=2020-08-04&st=2026-03-28T22%3A01%3A17Z&se=2026-03-28T22%3A26%3A17Z&sr=b&sp=r&sig=b7CgL1od%2BxWYmvFyCkZBnwP%2Fc8hvRbuQDmBfA%2FtGEC4%3D)
2026-03-28 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699126431/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WU66XNV/42811422?sv=2020-08-04&st=2026-03-28T22%3A01%3A16Z&se=2026-03-28T22%3A26%3A16Z&sr=b&sp=r&sig=iEWCiRexucMVz979VRM55ID%2B0dAdHnqV0R4MKdIaGkA%3D)
2026-03-28 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55423a390>
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51da0f1d-592f-5dda-b1f6-cadeb5cfb790/51da0f1d-592f-5dda-b1f6-cadeb5cfb790_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWU66XNV%252F699126457%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699126457/600 saved to cache
2026-03-28 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 51da0f1d-592f-5dda-b1f6-cadeb5cfb790
2026-03-28 22:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093983/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093983>
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f80c90>
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9153a9c4-5990-5981-85ad-c93a9119ac4b/9153a9c4-5990-5981-85ad-c93a9119ac4b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP11OHH%252F698994117%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994117/600 saved to cache
2026-03-28 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9153a9c4-5990-5981-85ad-c93a9119ac4b
2026-03-28 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ21YWB/42811229?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=CRadIFOsUYF5mJfLgLZRcdi8AXzc77Zr1rzpVvc8LYI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093969/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VX52YYH/42811323?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=sBcdU%2Bi00fGyPAIkGghzLoIMWb9WJk%2B0Sty%2BOKRiKzA%3D)
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54777f410>
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f8a9fc-307f-5fd9-9f57-53be64230a5a/a7f8a9fc-307f-5fd9-9f57-53be64230a5a_expert_report_file_7d59f5e9-e682-4ca0-8448-667be9f6ce79.pdf HTTP/1.1" 201 0
2026-03-28 22:02:17 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a7f8a9fc-307f-5fd9-9f57-53be64230a5a
2026-03-28 22:02:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7f8a9fc-307f-5fd9-9f57-53be64230a5a, skipping ID generation
2026-03-28 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a7f8a9fc-307f-5fd9-9f57-53be64230a5a
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRO22KPT-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RO22KPT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK12LUP/42810942?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=CJGWCFvotVIxFu5vsyjuS7m3KqOjHqCp9HQAw7ZqR%2BE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG19DRZ/42810262?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=r5DoT3V6pkDiNlGEETNxtyjahcekFrVAyf%2Fq0%2Ff6cS8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110911/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ73EOT/42811363?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=Z275yW1rsbj3FapfEeIfN9OJqcCvXddViu6M84JP7AA%3D)
2026-03-28 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071282/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG16XLF/42811219?sv=2020-08-04&st=2026-03-28T22%3A01%3A19Z&se=2026-03-28T22%3A26%3A19Z&sr=b&sp=r&sig=piDa4JVgaWBzjvnw0OZ1irSwQFsxpWFyq8MJd75hPTs%3D)
2026-03-28 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071266/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG16XLF/42811219?sv=2020-08-04&st=2026-03-28T22%3A01%3A19Z&se=2026-03-28T22%3A26%3A19Z&sr=b&sp=r&sig=piDa4JVgaWBzjvnw0OZ1irSwQFsxpWFyq8MJd75hPTs%3D)
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699059947%27 HTTP/1.1" 200 None
2026-03-28 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059947 not downloaded yet
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554279190>
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43f7303a-a2f6-5f86-b81e-26af26f2b888/43f7303a-a2f6-5f86-b81e-26af26f2b888_expert_report_file_be1cdd4a-6c5a-4c13-8cad-418d456aa10f.pdf HTTP/1.1" 201 0
2026-03-28 22:02:17 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 43f7303a-a2f6-5f86-b81e-26af26f2b888
2026-03-28 22:02:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43f7303a-a2f6-5f86-b81e-26af26f2b888, skipping ID generation
2026-03-28 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43f7303a-a2f6-5f86-b81e-26af26f2b888
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBG13FKD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BG13FKD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544aaed0>
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9153a9c4-5990-5981-85ad-c93a9119ac4b/9153a9c4-5990-5981-85ad-c93a9119ac4b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP11OHH%252F698994077%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994077/600 saved to cache
2026-03-28 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9153a9c4-5990-5981-85ad-c93a9119ac4b
2026-03-28 22:02:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9153a9c4-5990-5981-85ad-c93a9119ac4b, skipping ID generation
2026-03-28 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9153a9c4-5990-5981-85ad-c93a9119ac4b sending to next pipeline
2026-03-28 22:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9153a9c4-5990-5981-85ad-c93a9119ac4b, identifier: FP11%20OHH
2026-03-28 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547381d90>
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51da0f1d-592f-5dda-b1f6-cadeb5cfb790/51da0f1d-592f-5dda-b1f6-cadeb5cfb790_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWU66XNV%252F699126431%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699126431/600 saved to cache
2026-03-28 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 51da0f1d-592f-5dda-b1f6-cadeb5cfb790
2026-03-28 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE20NXF/42811204?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=8guyqRkCVpBOXe0dgepjNvrccjw3jG3HSH7VEUA89kk%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699059958%27 HTTP/1.1" 200 None
2026-03-28 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059958 not downloaded yet
2026-03-28 22:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9153a9c4-5990-5981-85ad-c93a9119ac4b with identifier: FP11%20OHH
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FElectric HTTP/1.1" 200 None
2026-03-28 22:02:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 22:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9153a9c4-5990-5981-85ad-c93a9119ac4b with identifier: FP11%20OHH
2026-03-28 22:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9153a9c4-5990-5981-85ad-c93a9119ac4b with identifier: FP11%20OHH to the API
2026-03-28 22:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994077/600>
{'auction_title': '',
'c_o_2_emission_value': 93,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9153a9c4-5990-5981-85ad-c93a9119ac4b/9153a9c4-5990-5981-85ad-c93a9119ac4b_expert_report_file_1c80c08e-e4a1-4058-8529-00aa69bcc420.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FP11%20OHH-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '9153a9c4-5990-5981-85ad-c93a9119ac4b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FP11 OHH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FP11%20OHH&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'TOYOTA',
'model': 'AURIS',
'odometer': 172111,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9153a9c4-5990-5981-85ad-c93a9119ac4b/9153a9c4-5990-5981-85ad-c93a9119ac4b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38068,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994067/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9153a9c4-5990-5981-85ad-c93a9119ac4b/9153a9c4-5990-5981-85ad-c93a9119ac4b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38621,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994077/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9153a9c4-5990-5981-85ad-c93a9119ac4b/9153a9c4-5990-5981-85ad-c93a9119ac4b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36914,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994101/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9153a9c4-5990-5981-85ad-c93a9119ac4b/9153a9c4-5990-5981-85ad-c93a9119ac4b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35703,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994117/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9153a9c4-5990-5981-85ad-c93a9119ac4b/9153a9c4-5990-5981-85ad-c93a9119ac4b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31777,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994133/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9153a9c4-5990-5981-85ad-c93a9119ac4b/9153a9c4-5990-5981-85ad-c93a9119ac4b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32537,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994149/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9153a9c4-5990-5981-85ad-c93a9119ac4b/9153a9c4-5990-5981-85ad-c93a9119ac4b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103889,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994170/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9153a9c4-5990-5981-85ad-c93a9119ac4b/9153a9c4-5990-5981-85ad-c93a9119ac4b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88981,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994197/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9153a9c4-5990-5981-85ad-c93a9119ac4b/9153a9c4-5990-5981-85ad-c93a9119ac4b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93668,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994225/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9153a9c4-5990-5981-85ad-c93a9119ac4b/9153a9c4-5990-5981-85ad-c93a9119ac4b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81870,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP11OHH/698994243/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'TOYOTA AURIS 1.8 VVTI HYBRID T SPIRIT Hatchback',
'transmission': 'automatic',
'trim': 'VVTI HYBRID T SPIRIT',
'vin': 'SB1KS56E00E035079',
'year': 2011}
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP11%2520OHH%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [bca.uk] INFO: Saving data for FP11%20OHH: {'created_time': 1774735338.133718, 'last_price_update_time': 1774735338.133729, 'auction_closing_time': 1774864800.0}
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FP11%2520OHH') HTTP/1.1" 204 0
2026-03-28 22:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093999/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VX52YYH/42811323?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=sBcdU%2Bi00fGyPAIkGghzLoIMWb9WJk%2B0Sty%2BOKRiKzA%3D)
2026-03-28 22:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN12MPO/42811411?sv=2020-08-04&st=2026-03-28T22%3A02%3A17Z&se=2026-03-28T22%3A27%3A17Z&sr=b&sp=r&sig=vaDbKC9GOS5YR997de0XgHeErST%2FlNyRRDf7oBjUPCM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KN12%20MPO-GB>
2026-03-28 22:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142709/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WU66XNV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093934/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093934>
2026-03-28 22:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071256/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BG16XLF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994727%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994727 not downloaded yet
2026-03-28 22:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110891/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110891>
2026-03-28 22:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093945/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093945>
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699059966%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059966 not downloaded yet
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994745%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994745 not downloaded yet
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699059978%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059978 not downloaded yet
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544aa710>
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c9a210-8239-5652-942c-af89b324b768/02c9a210-8239-5652-942c-af89b324b768_expert_report_file_117aebb7-3483-416c-be24-1575cabfff36.pdf HTTP/1.1" 201 0
2026-03-28 22:02:18 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 02c9a210-8239-5652-942c-af89b324b768
2026-03-28 22:02:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02c9a210-8239-5652-942c-af89b324b768, skipping ID generation
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 02c9a210-8239-5652-942c-af89b324b768
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGJ21YWB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GJ21YWB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54739cf50>
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d9ff90-12a7-5f3d-86ac-c640dc2351b5/08d9ff90-12a7-5f3d-86ac-c640dc2351b5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVX52YYH%252F699093969%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093969/600 saved to cache
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08d9ff90-12a7-5f3d-86ac-c640dc2351b5
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54739ce90>
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_927dcf7c-8068-5099-8312-bf23933749d3/927dcf7c-8068-5099-8312-bf23933749d3_expert_report_file_c804860e-b86c-423f-a811-b5ddd66faaef.pdf HTTP/1.1" 201 0
2026-03-28 22:02:18 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 927dcf7c-8068-5099-8312-bf23933749d3
2026-03-28 22:02:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 927dcf7c-8068-5099-8312-bf23933749d3, skipping ID generation
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 927dcf7c-8068-5099-8312-bf23933749d3
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYK12LUP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YK12LUP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547135990>
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e897ee42-3f14-5f4f-8d1c-2a827ef07283/e897ee42-3f14-5f4f-8d1c-2a827ef07283_expert_report_file_77c91bd7-b7cd-4684-bbfc-4b929957e2f8.pdf HTTP/1.1" 201 0
2026-03-28 22:02:18 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e897ee42-3f14-5f4f-8d1c-2a827ef07283
2026-03-28 22:02:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e897ee42-3f14-5f4f-8d1c-2a827ef07283, skipping ID generation
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e897ee42-3f14-5f4f-8d1c-2a827ef07283
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYG19DRZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YG19DRZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471368d0>
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2f45d0-e564-5ded-8cb4-0288835f055c/ab2f45d0-e564-5ded-8cb4-0288835f055c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ73EOT%252F699110911%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110911/600 saved to cache
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ab2f45d0-e564-5ded-8cb4-0288835f055c
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554927ed0>
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1/87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG16XLF%252F699071282%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071282/600 saved to cache
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54739ea90>
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1/87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG16XLF%252F699071266%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071266/600 saved to cache
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b60950>
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40869bfc-8bb4-569d-b730-83efe1f5fcf1/40869bfc-8bb4-569d-b730-83efe1f5fcf1_expert_report_file_95aaed23-debd-4611-8206-47c54ec44312.pdf HTTP/1.1" 201 0
2026-03-28 22:02:18 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 40869bfc-8bb4-569d-b730-83efe1f5fcf1
2026-03-28 22:02:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40869bfc-8bb4-569d-b730-83efe1f5fcf1, skipping ID generation
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 40869bfc-8bb4-569d-b730-83efe1f5fcf1
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAE20NXF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AE20NXF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994764%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994764 not downloaded yet
2026-03-28 22:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093905/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093905>
2026-03-28 22:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093929/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093929>
2026-03-28 22:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110904/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110904>
2026-03-28 22:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL70OLP/42811185?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=n62RmwLfnQZ03W3xhwAvTmCKoFM9E%2F3s1A1vq6NMiI8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PL70%20OLP-GB>
2026-03-28 22:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN70GXV/42810784?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=REEScumDOtyVBVpKc04a5HkY54ZSMEmR%2FcWZluykBfY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WN70%20GXV-GB>
2026-03-28 22:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059939/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RO22KPT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV09XGM/42811125?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=lKpavDYFQqgkULrvpTDcr9vB3FwsBeTumcp5OugnDUc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV09%20XGM-GB>
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699059987%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059987 not downloaded yet
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074180%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074180 not downloaded yet
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011602%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011602 not downloaded yet
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176611%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176611 not downloaded yet
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074171%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074171 not downloaded yet
2026-03-28 22:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093983/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP15GZB/42811287?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=7tUa0hwrEujFHU3KRxrEE1EA%2FQ%2B2aDgCCCKK2Q5cFLc%3D)
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994781%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994781 not downloaded yet
2026-03-28 22:02:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54739e010>
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d9ff90-12a7-5f3d-86ac-c640dc2351b5/08d9ff90-12a7-5f3d-86ac-c640dc2351b5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVX52YYH%252F699093999%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093999/600 saved to cache
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 08d9ff90-12a7-5f3d-86ac-c640dc2351b5
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699060052%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060052 not downloaded yet
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074186%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074186 not downloaded yet
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011607%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011607 not downloaded yet
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176616%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176616 not downloaded yet
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074177%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074177 not downloaded yet
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994803%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994803 not downloaded yet
2026-03-28 22:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142709/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WU66XNV/42811422?sv=2020-08-04&st=2026-03-28T22%3A01%3A16Z&se=2026-03-28T22%3A26%3A16Z&sr=b&sp=r&sig=iEWCiRexucMVz979VRM55ID%2B0dAdHnqV0R4MKdIaGkA%3D)
2026-03-28 22:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071256/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG16XLF/42811219?sv=2020-08-04&st=2026-03-28T22%3A01%3A19Z&se=2026-03-28T22%3A26%3A19Z&sr=b&sp=r&sig=piDa4JVgaWBzjvnw0OZ1irSwQFsxpWFyq8MJd75hPTs%3D)
2026-03-28 22:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059947/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059947>
2026-03-28 22:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994711/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BG13FKD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699060070%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060070 not downloaded yet
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074192%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074192 not downloaded yet
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011612%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011612 not downloaded yet
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176621%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176621 not downloaded yet
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074182%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074182 not downloaded yet
2026-03-28 22:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110891/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ73EOT/42811363?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=Z275yW1rsbj3FapfEeIfN9OJqcCvXddViu6M84JP7AA%3D)
2026-03-28 22:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093945/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP15GZB/42811287?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=7tUa0hwrEujFHU3KRxrEE1EA%2FQ%2B2aDgCCCKK2Q5cFLc%3D)
2026-03-28 22:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093934/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VX52YYH/42811323?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=sBcdU%2Bi00fGyPAIkGghzLoIMWb9WJk%2B0Sty%2BOKRiKzA%3D)
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994827%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994827 not downloaded yet
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699060085%27 HTTP/1.1" 200 None
2026-03-28 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060085 not downloaded yet
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074196%27 HTTP/1.1" 200 None
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074196 not downloaded yet
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011615%27 HTTP/1.1" 200 None
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011615 not downloaded yet
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176626%27 HTTP/1.1" 200 None
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176626 not downloaded yet
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074189%27 HTTP/1.1" 200 None
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074189 not downloaded yet
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994849%27 HTTP/1.1" 200 None
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994849 not downloaded yet
2026-03-28 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477cc150>
2026-03-28 22:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283b6c92-cce2-544a-9b3b-da049a06ca33/283b6c92-cce2-544a-9b3b-da049a06ca33_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP15GZB%252F699093983%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093983/600 saved to cache
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 283b6c92-cce2-544a-9b3b-da049a06ca33
2026-03-28 22:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059939/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO22KPT/42811142?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=1%2BEjPFbwTiiWyiyCZVlnljJUhR2oYtbJyuHwOJgIeoM%3D)
2026-03-28 22:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093929/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP15GZB/42811287?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=7tUa0hwrEujFHU3KRxrEE1EA%2FQ%2B2aDgCCCKK2Q5cFLc%3D)
2026-03-28 22:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110904/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ70EHU/42811341?sv=2020-08-04&st=2026-03-28T22%3A01%3A12Z&se=2026-03-28T22%3A26%3A12Z&sr=b&sp=r&sig=jIMEwQ1nhHjk3xUWtYxp4DaMU%2Fd7rUcdJRYrXhJEbps%3D)
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699060108%27 HTTP/1.1" 200 None
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060108 not downloaded yet
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074198%27 HTTP/1.1" 200 None
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074198 not downloaded yet
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011619%27 HTTP/1.1" 200 None
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011619 not downloaded yet
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176631%27 HTTP/1.1" 200 None
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176631 not downloaded yet
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074194%27 HTTP/1.1" 200 None
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074194 not downloaded yet
2026-03-28 22:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093905/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VX52YYH/42811323?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=sBcdU%2Bi00fGyPAIkGghzLoIMWb9WJk%2B0Sty%2BOKRiKzA%3D)
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994874%27 HTTP/1.1" 200 None
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994874 not downloaded yet
2026-03-28 22:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54727a750>
2026-03-28 22:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51da0f1d-592f-5dda-b1f6-cadeb5cfb790/51da0f1d-592f-5dda-b1f6-cadeb5cfb790_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWU66XNV%252F699142709%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142709/600 saved to cache
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 51da0f1d-592f-5dda-b1f6-cadeb5cfb790
2026-03-28 22:02:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51da0f1d-592f-5dda-b1f6-cadeb5cfb790, skipping ID generation
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 51da0f1d-592f-5dda-b1f6-cadeb5cfb790 sending to next pipeline
2026-03-28 22:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 51da0f1d-592f-5dda-b1f6-cadeb5cfb790, identifier: WU66%20XNV
2026-03-28 22:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554238d90>
2026-03-28 22:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1/87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG16XLF%252F699071256%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071256/600 saved to cache
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1
2026-03-28 22:02:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1, skipping ID generation
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1 sending to next pipeline
2026-03-28 22:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1, identifier: BG16%20XLF
2026-03-28 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54710c9d0>
2026-03-28 22:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2f45d0-e564-5ded-8cb4-0288835f055c/ab2f45d0-e564-5ded-8cb4-0288835f055c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ73EOT%252F699110891%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110891/600 saved to cache
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ab2f45d0-e564-5ded-8cb4-0288835f055c
2026-03-28 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474dda50>
2026-03-28 22:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283b6c92-cce2-544a-9b3b-da049a06ca33/283b6c92-cce2-544a-9b3b-da049a06ca33_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP15GZB%252F699093945%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093945/600 saved to cache
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 283b6c92-cce2-544a-9b3b-da049a06ca33
2026-03-28 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473d0cd0>
2026-03-28 22:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d9ff90-12a7-5f3d-86ac-c640dc2351b5/08d9ff90-12a7-5f3d-86ac-c640dc2351b5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVX52YYH%252F699093934%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093934/600 saved to cache
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08d9ff90-12a7-5f3d-86ac-c640dc2351b5
2026-03-28 22:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL70OLP/42811185?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=n62RmwLfnQZ03W3xhwAvTmCKoFM9E%2F3s1A1vq6NMiI8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074205%27 HTTP/1.1" 200 None
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074205 not downloaded yet
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011623%27 HTTP/1.1" 200 None
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011623 not downloaded yet
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176640%27 HTTP/1.1" 200 None
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176640 not downloaded yet
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074202%27 HTTP/1.1" 200 None
2026-03-28 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074202 not downloaded yet
2026-03-28 22:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 51da0f1d-592f-5dda-b1f6-cadeb5cfb790 with identifier: WU66%20XNV
2026-03-28 22:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 51da0f1d-592f-5dda-b1f6-cadeb5cfb790 with identifier: WU66%20XNV
2026-03-28 22:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 51da0f1d-592f-5dda-b1f6-cadeb5cfb790 with identifier: WU66%20XNV to the API
2026-03-28 22:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142709/600>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51da0f1d-592f-5dda-b1f6-cadeb5cfb790/51da0f1d-592f-5dda-b1f6-cadeb5cfb790_expert_report_file_6e24f79b-711e-40ea-be00-34bfc25c4574.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WU66%20XNV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '51da0f1d-592f-5dda-b1f6-cadeb5cfb790',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WU66 XNV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WU66%20XNV&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'PEUGEOT',
'model': '308',
'odometer': 68999,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51da0f1d-592f-5dda-b1f6-cadeb5cfb790/51da0f1d-592f-5dda-b1f6-cadeb5cfb790_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37766,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142709/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51da0f1d-592f-5dda-b1f6-cadeb5cfb790/51da0f1d-592f-5dda-b1f6-cadeb5cfb790_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37952,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142718/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51da0f1d-592f-5dda-b1f6-cadeb5cfb790/51da0f1d-592f-5dda-b1f6-cadeb5cfb790_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54996,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699126431/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51da0f1d-592f-5dda-b1f6-cadeb5cfb790/51da0f1d-592f-5dda-b1f6-cadeb5cfb790_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36096,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142731/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51da0f1d-592f-5dda-b1f6-cadeb5cfb790/51da0f1d-592f-5dda-b1f6-cadeb5cfb790_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50864,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699126457/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51da0f1d-592f-5dda-b1f6-cadeb5cfb790/51da0f1d-592f-5dda-b1f6-cadeb5cfb790_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35299,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142741/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51da0f1d-592f-5dda-b1f6-cadeb5cfb790/51da0f1d-592f-5dda-b1f6-cadeb5cfb790_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50407,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699126482/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51da0f1d-592f-5dda-b1f6-cadeb5cfb790/51da0f1d-592f-5dda-b1f6-cadeb5cfb790_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32950,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142749/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51da0f1d-592f-5dda-b1f6-cadeb5cfb790/51da0f1d-592f-5dda-b1f6-cadeb5cfb790_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40383,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699126499/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51da0f1d-592f-5dda-b1f6-cadeb5cfb790/51da0f1d-592f-5dda-b1f6-cadeb5cfb790_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33349,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WU66XNV/699142764/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 1.2 P/T 130 ALLURE EAT6 Hatchback',
'transmission': 'automatic',
'trim': 'P/T 130 ALLURE EAT6',
'vin': 'VF3LPHNYWGS251550',
'year': 2016}
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU66%2520XNV%27 HTTP/1.1" 200 None
2026-03-28 22:02:20 [bca.uk] INFO: Saving data for WU66%20XNV: {'created_time': 1774735340.275341, 'last_price_update_time': 1774735340.275357, 'auction_closing_time': 1774864800.0}
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WU66%2520XNV') HTTP/1.1" 204 0
2026-03-28 22:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1 with identifier: BG16%20XLF
2026-03-28 22:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1 with identifier: BG16%20XLF
2026-03-28 22:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1 with identifier: BG16%20XLF to the API
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071256/600>
{'auction_title': '',
'c_o_2_emission_value': 87,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1/87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1_expert_report_file_1b58908a-a574-424f-9c4f-9d473d3d235b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BG16%20XLF-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BG16 XLF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BG16%20XLF&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'DS AUTOMOBILES',
'model': 'DS 3',
'odometer': 54942,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1/87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40942,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071256/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1/87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40676,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071260/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1/87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38102,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071266/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1/87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36591,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071274/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1/87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35588,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071282/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1/87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36267,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071288/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1/87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92003,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071302/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1/87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80553,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071320/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1/87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87969,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071336/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1/87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87134,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG16XLF/699071352/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'DS AUTOMOBILES DS 3 1.6 BLUEHDI 100 ELEGANCE Hatchback',
'transmission': 'manual',
'trim': 'BLUEHDI 100 ELEGANCE',
'vin': 'VF7SABHY6GW533745',
'year': 2016}
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG16%2520XLF%27 HTTP/1.1" 200 None
2026-03-28 22:02:20 [bca.uk] INFO: Saving data for BG16%20XLF: {'created_time': 1774735340.68456, 'last_price_update_time': 1774735340.68457, 'auction_closing_time': 1774864800.0}
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BG16%2520XLF') HTTP/1.1" 204 0
2026-03-28 22:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN12MPO/42811411?sv=2020-08-04&st=2026-03-28T22%3A02%3A17Z&se=2026-03-28T22%3A27%3A17Z&sr=b&sp=r&sig=vaDbKC9GOS5YR997de0XgHeErST%2FlNyRRDf7oBjUPCM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN70GXV/42810784?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=REEScumDOtyVBVpKc04a5HkY54ZSMEmR%2FcWZluykBfY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994898%27 HTTP/1.1" 200 None
2026-03-28 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994898 not downloaded yet
2026-03-28 22:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994711/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG13FKD/42810885?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=Pgf4CbZ3Xrn2VVPEUN28cWI9Q7Qnnc%2B7z4mHlgVw6As%3D)
2026-03-28 22:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994764/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994764>
2026-03-28 22:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074177/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074177>
2026-03-28 22:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059947/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO22KPT/42811142?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=1%2BEjPFbwTiiWyiyCZVlnljJUhR2oYtbJyuHwOJgIeoM%3D)
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074211%27 HTTP/1.1" 200 None
2026-03-28 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074211 not downloaded yet
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011627%27 HTTP/1.1" 200 None
2026-03-28 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011627 not downloaded yet
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176651%27 HTTP/1.1" 200 None
2026-03-28 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176651 not downloaded yet
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074208%27 HTTP/1.1" 200 None
2026-03-28 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074208 not downloaded yet
2026-03-28 22:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547325090>
2026-03-28 22:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f8a9fc-307f-5fd9-9f57-53be64230a5a/a7f8a9fc-307f-5fd9-9f57-53be64230a5a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO22KPT%252F699059939%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059939/600 saved to cache
2026-03-28 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7f8a9fc-307f-5fd9-9f57-53be64230a5a
2026-03-28 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473dc210>
2026-03-28 22:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283b6c92-cce2-544a-9b3b-da049a06ca33/283b6c92-cce2-544a-9b3b-da049a06ca33_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP15GZB%252F699093929%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093929/600 saved to cache
2026-03-28 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 283b6c92-cce2-544a-9b3b-da049a06ca33
2026-03-28 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477a77d0>
2026-03-28 22:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf35b337-845e-537f-a976-08188cca66f3/cf35b337-845e-537f-a976-08188cca66f3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ70EHU%252F699110904%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110904/600 saved to cache
2026-03-28 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf35b337-845e-537f-a976-08188cca66f3
2026-03-28 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554909d90>
2026-03-28 22:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d9ff90-12a7-5f3d-86ac-c640dc2351b5/08d9ff90-12a7-5f3d-86ac-c640dc2351b5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVX52YYH%252F699093905%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093905/600 saved to cache
2026-03-28 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08d9ff90-12a7-5f3d-86ac-c640dc2351b5
2026-03-28 22:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV09XGM/42811125?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=lKpavDYFQqgkULrvpTDcr9vB3FwsBeTumcp5OugnDUc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176616/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176616>
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074218%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074218 not downloaded yet
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011629%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011629 not downloaded yet
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176660%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176660 not downloaded yet
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074216%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074216 not downloaded yet
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474e68d0>
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f7b21e0-59a7-5686-a122-ac8b5ae9229a/3f7b21e0-59a7-5686-a122-ac8b5ae9229a_expert_report_file_e3818ce2-dc7c-4030-ad15-5ff6de25e1af.pdf HTTP/1.1" 201 0
2026-03-28 22:02:21 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3f7b21e0-59a7-5686-a122-ac8b5ae9229a
2026-03-28 22:02:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f7b21e0-59a7-5686-a122-ac8b5ae9229a, skipping ID generation
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3f7b21e0-59a7-5686-a122-ac8b5ae9229a
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPL70OLP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PL70OLP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547105250>
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0cc7482-767b-567d-a58d-775f8d1bb696/e0cc7482-767b-567d-a58d-775f8d1bb696_expert_report_file_3f22f061-7349-4a4b-bfe0-f6bb875e5f3b.pdf HTTP/1.1" 201 0
2026-03-28 22:02:21 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e0cc7482-767b-567d-a58d-775f8d1bb696
2026-03-28 22:02:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0cc7482-767b-567d-a58d-775f8d1bb696, skipping ID generation
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e0cc7482-767b-567d-a58d-775f8d1bb696
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKN12MPO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KN12MPO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547360490>
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e568b76a-20a9-5c16-99a7-ea60aeecf1e0/e568b76a-20a9-5c16-99a7-ea60aeecf1e0_expert_report_file_712ebcfd-75d5-47a4-8d0d-7ab6bf843b60.pdf HTTP/1.1" 201 0
2026-03-28 22:02:21 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e568b76a-20a9-5c16-99a7-ea60aeecf1e0
2026-03-28 22:02:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e568b76a-20a9-5c16-99a7-ea60aeecf1e0, skipping ID generation
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e568b76a-20a9-5c16-99a7-ea60aeecf1e0
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWN70GXV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WN70GXV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473c8fd0>
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43f7303a-a2f6-5f86-b81e-26af26f2b888/43f7303a-a2f6-5f86-b81e-26af26f2b888_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG13FKD%252F698994711%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994711/600 saved to cache
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43f7303a-a2f6-5f86-b81e-26af26f2b888
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547257e50>
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f8a9fc-307f-5fd9-9f57-53be64230a5a/a7f8a9fc-307f-5fd9-9f57-53be64230a5a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO22KPT%252F699059947%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059947/600 saved to cache
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7f8a9fc-307f-5fd9-9f57-53be64230a5a
2026-03-28 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176626/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176626>
2026-03-28 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994803/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994803>
2026-03-28 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074186/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074186>
2026-03-28 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994849/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994849>
2026-03-28 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011607/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011607>
2026-03-28 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011615/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011615>
2026-03-28 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074189/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074189>
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074226%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074226 not downloaded yet
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011632%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011632 not downloaded yet
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176669%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176669 not downloaded yet
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074224%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074224 not downloaded yet
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074169%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074169 not downloaded yet
2026-03-28 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074194/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074194>
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143072%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143072 not downloaded yet
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981012%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981012 not downloaded yet
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074175%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074175 not downloaded yet
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555c91310>
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42f4349-1b81-5dc4-a105-671ff23a08dd/c42f4349-1b81-5dc4-a105-671ff23a08dd_expert_report_file_71199454-b99d-4fed-9754-3d9e747d983c.pdf HTTP/1.1" 201 0
2026-03-28 22:02:21 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c42f4349-1b81-5dc4-a105-671ff23a08dd
2026-03-28 22:02:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c42f4349-1b81-5dc4-a105-671ff23a08dd, skipping ID generation
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c42f4349-1b81-5dc4-a105-671ff23a08dd
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAV09XGM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AV09XGM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143094%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143094 not downloaded yet
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981026%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981026 not downloaded yet
2026-03-28 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074177/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE20NXF/42811204?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=8guyqRkCVpBOXe0dgepjNvrccjw3jG3HSH7VEUA89kk%3D)
2026-03-28 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074205/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074205>
2026-03-28 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074202/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074202>
2026-03-28 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176640/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176640>
2026-03-28 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011623/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011623>
2026-03-28 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994898/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994898>
2026-03-28 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994764/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG13FKD/42810885?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=Pgf4CbZ3Xrn2VVPEUN28cWI9Q7Qnnc%2B7z4mHlgVw6As%3D)
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074181%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074181 not downloaded yet
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699047024%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047024 not downloaded yet
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143116%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143116 not downloaded yet
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981046%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981046 not downloaded yet
2026-03-28 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176616/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG19DRZ/42810262?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=r5DoT3V6pkDiNlGEETNxtyjahcekFrVAyf%2Fq0%2Ff6cS8%3D)
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074187%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074187 not downloaded yet
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699047034%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047034 not downloaded yet
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143131%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143131 not downloaded yet
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981063%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981063 not downloaded yet
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074193%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074193 not downloaded yet
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699047044%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047044 not downloaded yet
2026-03-28 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011607/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK12LUP/42810942?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=CJGWCFvotVIxFu5vsyjuS7m3KqOjHqCp9HQAw7ZqR%2BE%3D)
2026-03-28 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074186/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ21YWB/42811229?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=CRadIFOsUYF5mJfLgLZRcdi8AXzc77Zr1rzpVvc8LYI%3D)
2026-03-28 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011615/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK12LUP/42810942?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=CJGWCFvotVIxFu5vsyjuS7m3KqOjHqCp9HQAw7ZqR%2BE%3D)
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143150%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143150 not downloaded yet
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981096%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981096 not downloaded yet
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b70ad0>
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40869bfc-8bb4-569d-b730-83efe1f5fcf1/40869bfc-8bb4-569d-b730-83efe1f5fcf1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE20NXF%252F699074177%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074177/600 saved to cache
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40869bfc-8bb4-569d-b730-83efe1f5fcf1
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547373310>
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43f7303a-a2f6-5f86-b81e-26af26f2b888/43f7303a-a2f6-5f86-b81e-26af26f2b888_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG13FKD%252F698994764%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994764/600 saved to cache
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 43f7303a-a2f6-5f86-b81e-26af26f2b888
2026-03-28 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074189/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE20NXF/42811204?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=8guyqRkCVpBOXe0dgepjNvrccjw3jG3HSH7VEUA89kk%3D)
2026-03-28 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994803/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG13FKD/42810885?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=Pgf4CbZ3Xrn2VVPEUN28cWI9Q7Qnnc%2B7z4mHlgVw6As%3D)
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074201%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074201 not downloaded yet
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699047051%27 HTTP/1.1" 200 None
2026-03-28 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047051 not downloaded yet
2026-03-28 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994849/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG13FKD/42810885?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=Pgf4CbZ3Xrn2VVPEUN28cWI9Q7Qnnc%2B7z4mHlgVw6As%3D)
2026-03-28 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074194/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE20NXF/42811204?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=8guyqRkCVpBOXe0dgepjNvrccjw3jG3HSH7VEUA89kk%3D)
2026-03-28 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143183%27 HTTP/1.1" 200 None
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143183 not downloaded yet
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981140%27 HTTP/1.1" 200 None
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981140 not downloaded yet
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074207%27 HTTP/1.1" 200 None
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074207 not downloaded yet
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699047063%27 HTTP/1.1" 200 None
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047063 not downloaded yet
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547f5d90>
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e897ee42-3f14-5f4f-8d1c-2a827ef07283/e897ee42-3f14-5f4f-8d1c-2a827ef07283_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG19DRZ%252F699176616%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176616/600 saved to cache
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e897ee42-3f14-5f4f-8d1c-2a827ef07283
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f98450>
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_927dcf7c-8068-5099-8312-bf23933749d3/927dcf7c-8068-5099-8312-bf23933749d3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK12LUP%252F699011607%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011607/600 saved to cache
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 927dcf7c-8068-5099-8312-bf23933749d3
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547dc390>
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c9a210-8239-5652-942c-af89b324b768/02c9a210-8239-5652-942c-af89b324b768_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ21YWB%252F699074186%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074186/600 saved to cache
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 02c9a210-8239-5652-942c-af89b324b768
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547267490>
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_927dcf7c-8068-5099-8312-bf23933749d3/927dcf7c-8068-5099-8312-bf23933749d3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK12LUP%252F699011615%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011615/600 saved to cache
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 927dcf7c-8068-5099-8312-bf23933749d3
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143208%27 HTTP/1.1" 200 None
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143208 not downloaded yet
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981177%27 HTTP/1.1" 200 None
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981177 not downloaded yet
2026-03-28 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176626/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG19DRZ/42810262?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=r5DoT3V6pkDiNlGEETNxtyjahcekFrVAyf%2Fq0%2Ff6cS8%3D)
2026-03-28 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011623/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK12LUP/42810942?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=CJGWCFvotVIxFu5vsyjuS7m3KqOjHqCp9HQAw7ZqR%2BE%3D)
2026-03-28 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994898/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG13FKD/42810885?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=Pgf4CbZ3Xrn2VVPEUN28cWI9Q7Qnnc%2B7z4mHlgVw6As%3D)
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074214%27 HTTP/1.1" 200 None
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074214 not downloaded yet
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699047077%27 HTTP/1.1" 200 None
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047077 not downloaded yet
2026-03-28 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074205/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ21YWB/42811229?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=CRadIFOsUYF5mJfLgLZRcdi8AXzc77Zr1rzpVvc8LYI%3D)
2026-03-28 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074202/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE20NXF/42811204?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=8guyqRkCVpBOXe0dgepjNvrccjw3jG3HSH7VEUA89kk%3D)
2026-03-28 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176640/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG19DRZ/42810262?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=r5DoT3V6pkDiNlGEETNxtyjahcekFrVAyf%2Fq0%2Ff6cS8%3D)
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143229%27 HTTP/1.1" 200 None
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143229 not downloaded yet
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981211%27 HTTP/1.1" 200 None
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981211 not downloaded yet
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542fc910>
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40869bfc-8bb4-569d-b730-83efe1f5fcf1/40869bfc-8bb4-569d-b730-83efe1f5fcf1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE20NXF%252F699074189%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074189/600 saved to cache
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40869bfc-8bb4-569d-b730-83efe1f5fcf1
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54713d550>
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43f7303a-a2f6-5f86-b81e-26af26f2b888/43f7303a-a2f6-5f86-b81e-26af26f2b888_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG13FKD%252F698994803%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994803/600 saved to cache
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 43f7303a-a2f6-5f86-b81e-26af26f2b888
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b22a50>
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43f7303a-a2f6-5f86-b81e-26af26f2b888/43f7303a-a2f6-5f86-b81e-26af26f2b888_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG13FKD%252F698994849%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994849/600 saved to cache
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 43f7303a-a2f6-5f86-b81e-26af26f2b888
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542383d0>
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40869bfc-8bb4-569d-b730-83efe1f5fcf1/40869bfc-8bb4-569d-b730-83efe1f5fcf1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE20NXF%252F699074194%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074194/600 saved to cache
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40869bfc-8bb4-569d-b730-83efe1f5fcf1
2026-03-28 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143094/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143094>
2026-03-28 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981026/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981026>
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074222%27 HTTP/1.1" 200 None
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074222 not downloaded yet
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699047090%27 HTTP/1.1" 200 None
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047090 not downloaded yet
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143248%27 HTTP/1.1" 200 None
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143248 not downloaded yet
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981257%27 HTTP/1.1" 200 None
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981257 not downloaded yet
2026-03-28 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981046/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981046>
2026-03-28 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047044/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047044>
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699047103%27 HTTP/1.1" 200 None
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047103 not downloaded yet
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54733c390>
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e897ee42-3f14-5f4f-8d1c-2a827ef07283/e897ee42-3f14-5f4f-8d1c-2a827ef07283_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG19DRZ%252F699176626%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176626/600 saved to cache
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e897ee42-3f14-5f4f-8d1c-2a827ef07283
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542bad50>
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_927dcf7c-8068-5099-8312-bf23933749d3/927dcf7c-8068-5099-8312-bf23933749d3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK12LUP%252F699011623%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011623/600 saved to cache
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 927dcf7c-8068-5099-8312-bf23933749d3
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54739f790>
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43f7303a-a2f6-5f86-b81e-26af26f2b888/43f7303a-a2f6-5f86-b81e-26af26f2b888_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG13FKD%252F698994898%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994898/600 saved to cache
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 43f7303a-a2f6-5f86-b81e-26af26f2b888
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543de6d0>
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c9a210-8239-5652-942c-af89b324b768/02c9a210-8239-5652-942c-af89b324b768_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ21YWB%252F699074205%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074205/600 saved to cache
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 02c9a210-8239-5652-942c-af89b324b768
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547207e90>
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40869bfc-8bb4-569d-b730-83efe1f5fcf1/40869bfc-8bb4-569d-b730-83efe1f5fcf1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE20NXF%252F699074202%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074202/600 saved to cache
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40869bfc-8bb4-569d-b730-83efe1f5fcf1
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542ba510>
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e897ee42-3f14-5f4f-8d1c-2a827ef07283/e897ee42-3f14-5f4f-8d1c-2a827ef07283_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG19DRZ%252F699176640%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176640/600 saved to cache
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e897ee42-3f14-5f4f-8d1c-2a827ef07283
2026-03-28 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074193/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074193>
2026-03-28 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047034/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047034>
2026-03-28 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143131/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143131>
2026-03-28 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981063/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981063>
2026-03-28 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047051/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047051>
2026-03-28 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074201/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074201>
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699047113%27 HTTP/1.1" 200 None
2026-03-28 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047113 not downloaded yet
2026-03-28 22:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981140/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981140>
2026-03-28 22:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143208/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143208>
2026-03-28 22:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047063/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047063>
2026-03-28 22:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074207/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074207>
2026-03-28 22:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981177/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981177>
2026-03-28 22:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143183/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143183>
2026-03-28 22:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143094/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN12MPO/42811411?sv=2020-08-04&st=2026-03-28T22%3A02%3A17Z&se=2026-03-28T22%3A27%3A17Z&sr=b&sp=r&sig=vaDbKC9GOS5YR997de0XgHeErST%2FlNyRRDf7oBjUPCM%3D)
2026-03-28 22:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981026/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN70GXV/42810784?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=REEScumDOtyVBVpKc04a5HkY54ZSMEmR%2FcWZluykBfY%3D)
2026-03-28 22:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047044/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV09XGM/42811125?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=lKpavDYFQqgkULrvpTDcr9vB3FwsBeTumcp5OugnDUc%3D)
2026-03-28 22:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047034/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV09XGM/42811125?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=lKpavDYFQqgkULrvpTDcr9vB3FwsBeTumcp5OugnDUc%3D)
2026-03-28 22:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074193/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL70OLP/42811185?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=n62RmwLfnQZ03W3xhwAvTmCKoFM9E%2F3s1A1vq6NMiI8%3D)
2026-03-28 22:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981046/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN70GXV/42810784?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=REEScumDOtyVBVpKc04a5HkY54ZSMEmR%2FcWZluykBfY%3D)
2026-03-28 22:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143131/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN12MPO/42811411?sv=2020-08-04&st=2026-03-28T22%3A02%3A17Z&se=2026-03-28T22%3A27%3A17Z&sr=b&sp=r&sig=vaDbKC9GOS5YR997de0XgHeErST%2FlNyRRDf7oBjUPCM%3D)
2026-03-28 22:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981063/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN70GXV/42810784?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=REEScumDOtyVBVpKc04a5HkY54ZSMEmR%2FcWZluykBfY%3D)
2026-03-28 22:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047051/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV09XGM/42811125?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=lKpavDYFQqgkULrvpTDcr9vB3FwsBeTumcp5OugnDUc%3D)
2026-03-28 22:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074201/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL70OLP/42811185?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=n62RmwLfnQZ03W3xhwAvTmCKoFM9E%2F3s1A1vq6NMiI8%3D)
2026-03-28 22:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047063/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV09XGM/42811125?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=lKpavDYFQqgkULrvpTDcr9vB3FwsBeTumcp5OugnDUc%3D)
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544aaf10>
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0cc7482-767b-567d-a58d-775f8d1bb696/e0cc7482-767b-567d-a58d-775f8d1bb696_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN12MPO%252F699143094%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143094/600 saved to cache
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e0cc7482-767b-567d-a58d-775f8d1bb696
2026-03-28 22:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143208/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN12MPO/42811411?sv=2020-08-04&st=2026-03-28T22%3A02%3A17Z&se=2026-03-28T22%3A27%3A17Z&sr=b&sp=r&sig=vaDbKC9GOS5YR997de0XgHeErST%2FlNyRRDf7oBjUPCM%3D)
2026-03-28 22:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981140/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN70GXV/42810784?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=REEScumDOtyVBVpKc04a5HkY54ZSMEmR%2FcWZluykBfY%3D)
2026-03-28 22:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981177/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN70GXV/42810784?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=REEScumDOtyVBVpKc04a5HkY54ZSMEmR%2FcWZluykBfY%3D)
2026-03-28 22:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047113/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047113>
2026-03-28 22:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981257/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981257>
2026-03-28 22:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047103/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047103>
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55495f190>
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e568b76a-20a9-5c16-99a7-ea60aeecf1e0/e568b76a-20a9-5c16-99a7-ea60aeecf1e0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN70GXV%252F698981026%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981026/600 saved to cache
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e568b76a-20a9-5c16-99a7-ea60aeecf1e0
2026-03-28 22:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143183/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN12MPO/42811411?sv=2020-08-04&st=2026-03-28T22%3A02%3A17Z&se=2026-03-28T22%3A27%3A17Z&sr=b&sp=r&sig=vaDbKC9GOS5YR997de0XgHeErST%2FlNyRRDf7oBjUPCM%3D)
2026-03-28 22:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074207/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL70OLP/42811185?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=n62RmwLfnQZ03W3xhwAvTmCKoFM9E%2F3s1A1vq6NMiI8%3D)
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554ab9d50>
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42f4349-1b81-5dc4-a105-671ff23a08dd/c42f4349-1b81-5dc4-a105-671ff23a08dd_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV09XGM%252F699047044%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047044/600 saved to cache
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c42f4349-1b81-5dc4-a105-671ff23a08dd
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556fae090>
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42f4349-1b81-5dc4-a105-671ff23a08dd/c42f4349-1b81-5dc4-a105-671ff23a08dd_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV09XGM%252F699047034%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047034/600 saved to cache
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c42f4349-1b81-5dc4-a105-671ff23a08dd
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55491d910>
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f7b21e0-59a7-5686-a122-ac8b5ae9229a/3f7b21e0-59a7-5686-a122-ac8b5ae9229a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL70OLP%252F699074193%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074193/600 saved to cache
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f7b21e0-59a7-5686-a122-ac8b5ae9229a
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542fe4d0>
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e568b76a-20a9-5c16-99a7-ea60aeecf1e0/e568b76a-20a9-5c16-99a7-ea60aeecf1e0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN70GXV%252F698981046%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981046/600 saved to cache
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e568b76a-20a9-5c16-99a7-ea60aeecf1e0
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55491fb90>
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0cc7482-767b-567d-a58d-775f8d1bb696/e0cc7482-767b-567d-a58d-775f8d1bb696_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN12MPO%252F699143131%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143131/600 saved to cache
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e0cc7482-767b-567d-a58d-775f8d1bb696
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55495e890>
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e568b76a-20a9-5c16-99a7-ea60aeecf1e0/e568b76a-20a9-5c16-99a7-ea60aeecf1e0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN70GXV%252F698981063%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981063/600 saved to cache
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e568b76a-20a9-5c16-99a7-ea60aeecf1e0
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55491e510>
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42f4349-1b81-5dc4-a105-671ff23a08dd/c42f4349-1b81-5dc4-a105-671ff23a08dd_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV09XGM%252F699047051%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047051/600 saved to cache
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c42f4349-1b81-5dc4-a105-671ff23a08dd
2026-03-28 22:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074222/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074222>
2026-03-28 22:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143229/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143229>
2026-03-28 22:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047077/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047077>
2026-03-28 22:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047090/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047090>
2026-03-28 22:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981211/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981211>
2026-03-28 22:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143248/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143248>
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556fad150>
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f7b21e0-59a7-5686-a122-ac8b5ae9229a/3f7b21e0-59a7-5686-a122-ac8b5ae9229a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL70OLP%252F699074201%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074201/600 saved to cache
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f7b21e0-59a7-5686-a122-ac8b5ae9229a
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547754a10>
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42f4349-1b81-5dc4-a105-671ff23a08dd/c42f4349-1b81-5dc4-a105-671ff23a08dd_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV09XGM%252F699047063%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047063/600 saved to cache
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c42f4349-1b81-5dc4-a105-671ff23a08dd
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547238dd0>
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0cc7482-767b-567d-a58d-775f8d1bb696/e0cc7482-767b-567d-a58d-775f8d1bb696_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN12MPO%252F699143208%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143208/600 saved to cache
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e0cc7482-767b-567d-a58d-775f8d1bb696
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547363150>
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e568b76a-20a9-5c16-99a7-ea60aeecf1e0/e568b76a-20a9-5c16-99a7-ea60aeecf1e0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN70GXV%252F698981140%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981140/600 saved to cache
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e568b76a-20a9-5c16-99a7-ea60aeecf1e0
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fbc090>
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e568b76a-20a9-5c16-99a7-ea60aeecf1e0/e568b76a-20a9-5c16-99a7-ea60aeecf1e0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN70GXV%252F698981177%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981177/600 saved to cache
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e568b76a-20a9-5c16-99a7-ea60aeecf1e0
2026-03-28 22:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074214/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074214>
2026-03-28 22:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981096/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981096>
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547249b50>
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0cc7482-767b-567d-a58d-775f8d1bb696/e0cc7482-767b-567d-a58d-775f8d1bb696_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN12MPO%252F699143183%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143183/600 saved to cache
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e0cc7482-767b-567d-a58d-775f8d1bb696
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554909ad0>
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f7b21e0-59a7-5686-a122-ac8b5ae9229a/3f7b21e0-59a7-5686-a122-ac8b5ae9229a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL70OLP%252F699074207%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074207/600 saved to cache
2026-03-28 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f7b21e0-59a7-5686-a122-ac8b5ae9229a
2026-03-28 22:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143150/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143150>
2026-03-28 22:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074187/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074187>
2026-03-28 22:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143116/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143116>
2026-03-28 22:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981257/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN70GXV/42810784?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=REEScumDOtyVBVpKc04a5HkY54ZSMEmR%2FcWZluykBfY%3D)
2026-03-28 22:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047103/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV09XGM/42811125?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=lKpavDYFQqgkULrvpTDcr9vB3FwsBeTumcp5OugnDUc%3D)
2026-03-28 22:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047113/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV09XGM/42811125?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=lKpavDYFQqgkULrvpTDcr9vB3FwsBeTumcp5OugnDUc%3D)
2026-03-28 22:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074181/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074181>
2026-03-28 22:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047024/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047024>
2026-03-28 22:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981211/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN70GXV/42810784?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=REEScumDOtyVBVpKc04a5HkY54ZSMEmR%2FcWZluykBfY%3D)
2026-03-28 22:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074222/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL70OLP/42811185?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=n62RmwLfnQZ03W3xhwAvTmCKoFM9E%2F3s1A1vq6NMiI8%3D)
2026-03-28 22:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047090/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV09XGM/42811125?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=lKpavDYFQqgkULrvpTDcr9vB3FwsBeTumcp5OugnDUc%3D)
2026-03-28 22:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047077/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV09XGM/42811125?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=lKpavDYFQqgkULrvpTDcr9vB3FwsBeTumcp5OugnDUc%3D)
2026-03-28 22:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143248/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN12MPO/42811411?sv=2020-08-04&st=2026-03-28T22%3A02%3A17Z&se=2026-03-28T22%3A27%3A17Z&sr=b&sp=r&sig=vaDbKC9GOS5YR997de0XgHeErST%2FlNyRRDf7oBjUPCM%3D)
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b52d50>
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e568b76a-20a9-5c16-99a7-ea60aeecf1e0/e568b76a-20a9-5c16-99a7-ea60aeecf1e0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN70GXV%252F698981257%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981257/600 saved to cache
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e568b76a-20a9-5c16-99a7-ea60aeecf1e0
2026-03-28 22:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981096/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN70GXV/42810784?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=REEScumDOtyVBVpKc04a5HkY54ZSMEmR%2FcWZluykBfY%3D)
2026-03-28 22:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074187/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL70OLP/42811185?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=n62RmwLfnQZ03W3xhwAvTmCKoFM9E%2F3s1A1vq6NMiI8%3D)
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547158f90>
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42f4349-1b81-5dc4-a105-671ff23a08dd/c42f4349-1b81-5dc4-a105-671ff23a08dd_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV09XGM%252F699047103%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047103/600 saved to cache
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c42f4349-1b81-5dc4-a105-671ff23a08dd
2026-03-28 22:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047014/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AV09XGM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143150/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN12MPO/42811411?sv=2020-08-04&st=2026-03-28T22%3A02%3A17Z&se=2026-03-28T22%3A27%3A17Z&sr=b&sp=r&sig=vaDbKC9GOS5YR997de0XgHeErST%2FlNyRRDf7oBjUPCM%3D)
2026-03-28 22:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143229/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN12MPO/42811411?sv=2020-08-04&st=2026-03-28T22%3A02%3A17Z&se=2026-03-28T22%3A27%3A17Z&sr=b&sp=r&sig=vaDbKC9GOS5YR997de0XgHeErST%2FlNyRRDf7oBjUPCM%3D)
2026-03-28 22:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074214/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL70OLP/42811185?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=n62RmwLfnQZ03W3xhwAvTmCKoFM9E%2F3s1A1vq6NMiI8%3D)
2026-03-28 22:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074175/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074175>
2026-03-28 22:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143116/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN12MPO/42811411?sv=2020-08-04&st=2026-03-28T22%3A02%3A17Z&se=2026-03-28T22%3A27%3A17Z&sr=b&sp=r&sig=vaDbKC9GOS5YR997de0XgHeErST%2FlNyRRDf7oBjUPCM%3D)
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547248450>
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42f4349-1b81-5dc4-a105-671ff23a08dd/c42f4349-1b81-5dc4-a105-671ff23a08dd_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV09XGM%252F699047113%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047113/600 saved to cache
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c42f4349-1b81-5dc4-a105-671ff23a08dd
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547777550>
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e568b76a-20a9-5c16-99a7-ea60aeecf1e0/e568b76a-20a9-5c16-99a7-ea60aeecf1e0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN70GXV%252F698981211%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981211/600 saved to cache
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e568b76a-20a9-5c16-99a7-ea60aeecf1e0
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473d3850>
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f7b21e0-59a7-5686-a122-ac8b5ae9229a/3f7b21e0-59a7-5686-a122-ac8b5ae9229a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL70OLP%252F699074222%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074222/600 saved to cache
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3f7b21e0-59a7-5686-a122-ac8b5ae9229a
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477765d0>
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42f4349-1b81-5dc4-a105-671ff23a08dd/c42f4349-1b81-5dc4-a105-671ff23a08dd_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV09XGM%252F699047090%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047090/600 saved to cache
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c42f4349-1b81-5dc4-a105-671ff23a08dd
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473dd2d0>
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42f4349-1b81-5dc4-a105-671ff23a08dd/c42f4349-1b81-5dc4-a105-671ff23a08dd_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV09XGM%252F699047077%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047077/600 saved to cache
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c42f4349-1b81-5dc4-a105-671ff23a08dd
2026-03-28 22:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047024/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV09XGM/42811125?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=lKpavDYFQqgkULrvpTDcr9vB3FwsBeTumcp5OugnDUc%3D)
2026-03-28 22:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074181/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL70OLP/42811185?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=n62RmwLfnQZ03W3xhwAvTmCKoFM9E%2F3s1A1vq6NMiI8%3D)
2026-03-28 22:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981012/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981012>
2026-03-28 22:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143072/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143072>
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a6d950>
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0cc7482-767b-567d-a58d-775f8d1bb696/e0cc7482-767b-567d-a58d-775f8d1bb696_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN12MPO%252F699143248%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143248/600 saved to cache
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e0cc7482-767b-567d-a58d-775f8d1bb696
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556f7e750>
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e568b76a-20a9-5c16-99a7-ea60aeecf1e0/e568b76a-20a9-5c16-99a7-ea60aeecf1e0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN70GXV%252F698981096%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981096/600 saved to cache
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e568b76a-20a9-5c16-99a7-ea60aeecf1e0
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543e9710>
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f7b21e0-59a7-5686-a122-ac8b5ae9229a/3f7b21e0-59a7-5686-a122-ac8b5ae9229a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL70OLP%252F699074187%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074187/600 saved to cache
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f7b21e0-59a7-5686-a122-ac8b5ae9229a
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54713acd0>
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0cc7482-767b-567d-a58d-775f8d1bb696/e0cc7482-767b-567d-a58d-775f8d1bb696_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN12MPO%252F699143150%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143150/600 saved to cache
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e0cc7482-767b-567d-a58d-775f8d1bb696
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542794d0>
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0cc7482-767b-567d-a58d-775f8d1bb696/e0cc7482-767b-567d-a58d-775f8d1bb696_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN12MPO%252F699143229%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143229/600 saved to cache
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e0cc7482-767b-567d-a58d-775f8d1bb696
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556f7e750>
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f7b21e0-59a7-5686-a122-ac8b5ae9229a/3f7b21e0-59a7-5686-a122-ac8b5ae9229a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL70OLP%252F699074214%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074214/600 saved to cache
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3f7b21e0-59a7-5686-a122-ac8b5ae9229a
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554252d50>
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0cc7482-767b-567d-a58d-775f8d1bb696/e0cc7482-767b-567d-a58d-775f8d1bb696_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN12MPO%252F699143116%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143116/600 saved to cache
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e0cc7482-767b-567d-a58d-775f8d1bb696
2026-03-28 22:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176669/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176669>
2026-03-28 22:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074169/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074169>
2026-03-28 22:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011632/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011632>
2026-03-28 22:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074224/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074224>
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477a6210>
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42f4349-1b81-5dc4-a105-671ff23a08dd/c42f4349-1b81-5dc4-a105-671ff23a08dd_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV09XGM%252F699047024%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047024/600 saved to cache
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c42f4349-1b81-5dc4-a105-671ff23a08dd
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472f6710>
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f7b21e0-59a7-5686-a122-ac8b5ae9229a/3f7b21e0-59a7-5686-a122-ac8b5ae9229a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL70OLP%252F699074181%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074181/600 saved to cache
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f7b21e0-59a7-5686-a122-ac8b5ae9229a
2026-03-28 22:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047014/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV09XGM/42811125?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=lKpavDYFQqgkULrvpTDcr9vB3FwsBeTumcp5OugnDUc%3D)
2026-03-28 22:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074226/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074226>
2026-03-28 22:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981003/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WN70GXV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074216/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074216>
2026-03-28 22:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074165/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PL70OLP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176660/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176660>
2026-03-28 22:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143056/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KN12MPO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074175/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL70OLP/42811185?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=n62RmwLfnQZ03W3xhwAvTmCKoFM9E%2F3s1A1vq6NMiI8%3D)
2026-03-28 22:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074169/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL70OLP/42811185?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=n62RmwLfnQZ03W3xhwAvTmCKoFM9E%2F3s1A1vq6NMiI8%3D)
2026-03-28 22:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011629/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011629>
2026-03-28 22:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074218/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074218>
2026-03-28 22:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143072/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN12MPO/42811411?sv=2020-08-04&st=2026-03-28T22%3A02%3A17Z&se=2026-03-28T22%3A27%3A17Z&sr=b&sp=r&sig=vaDbKC9GOS5YR997de0XgHeErST%2FlNyRRDf7oBjUPCM%3D)
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554284810>
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42f4349-1b81-5dc4-a105-671ff23a08dd/c42f4349-1b81-5dc4-a105-671ff23a08dd_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV09XGM%252F699047014%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047014/600 saved to cache
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c42f4349-1b81-5dc4-a105-671ff23a08dd
2026-03-28 22:02:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c42f4349-1b81-5dc4-a105-671ff23a08dd, skipping ID generation
2026-03-28 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c42f4349-1b81-5dc4-a105-671ff23a08dd sending to next pipeline
2026-03-28 22:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c42f4349-1b81-5dc4-a105-671ff23a08dd, identifier: AV09%20XGM
2026-03-28 22:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c42f4349-1b81-5dc4-a105-671ff23a08dd with identifier: AV09%20XGM
2026-03-28 22:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c42f4349-1b81-5dc4-a105-671ff23a08dd with identifier: AV09%20XGM
2026-03-28 22:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c42f4349-1b81-5dc4-a105-671ff23a08dd with identifier: AV09%20XGM to the API
2026-03-28 22:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047014/600>
{'auction_title': '',
'c_o_2_emission_value': 153,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42f4349-1b81-5dc4-a105-671ff23a08dd/c42f4349-1b81-5dc4-a105-671ff23a08dd_expert_report_file_71199454-b99d-4fed-9754-3d9e747d983c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV09%20XGM-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c42f4349-1b81-5dc4-a105-671ff23a08dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV09 XGM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV09%20XGM&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'VOLVO',
'model': 'V50',
'odometer': 205325,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42f4349-1b81-5dc4-a105-671ff23a08dd/c42f4349-1b81-5dc4-a105-671ff23a08dd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50096,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047014/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42f4349-1b81-5dc4-a105-671ff23a08dd/c42f4349-1b81-5dc4-a105-671ff23a08dd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49720,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047024/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42f4349-1b81-5dc4-a105-671ff23a08dd/c42f4349-1b81-5dc4-a105-671ff23a08dd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48843,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047034/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42f4349-1b81-5dc4-a105-671ff23a08dd/c42f4349-1b81-5dc4-a105-671ff23a08dd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49504,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047044/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42f4349-1b81-5dc4-a105-671ff23a08dd/c42f4349-1b81-5dc4-a105-671ff23a08dd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41427,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047051/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42f4349-1b81-5dc4-a105-671ff23a08dd/c42f4349-1b81-5dc4-a105-671ff23a08dd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41255,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047063/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42f4349-1b81-5dc4-a105-671ff23a08dd/c42f4349-1b81-5dc4-a105-671ff23a08dd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66108,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047077/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42f4349-1b81-5dc4-a105-671ff23a08dd/c42f4349-1b81-5dc4-a105-671ff23a08dd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80636,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047090/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42f4349-1b81-5dc4-a105-671ff23a08dd/c42f4349-1b81-5dc4-a105-671ff23a08dd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99723,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047103/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42f4349-1b81-5dc4-a105-671ff23a08dd/c42f4349-1b81-5dc4-a105-671ff23a08dd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76828,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV09XGM/699047113/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VOLVO V50 2.0 D R DESIGN Estate',
'transmission': 'manual',
'trim': 'D R DESIGN',
'vin': 'YV1MW7541A2523584',
'year': 2009}
2026-03-28 22:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV09%2520XGM%27 HTTP/1.1" 200 None
2026-03-28 22:02:25 [bca.uk] INFO: Saving data for AV09%20XGM: {'created_time': 1774735345.860829, 'last_price_update_time': 1774735345.86084, 'auction_closing_time': 1774864800.0}
2026-03-28 22:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV09%2520XGM') HTTP/1.1" 204 0
2026-03-28 22:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176669/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG19DRZ/42810262?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=r5DoT3V6pkDiNlGEETNxtyjahcekFrVAyf%2Fq0%2Ff6cS8%3D)
2026-03-28 22:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011632/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK12LUP/42810942?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=CJGWCFvotVIxFu5vsyjuS7m3KqOjHqCp9HQAw7ZqR%2BE%3D)
2026-03-28 22:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981012/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN70GXV/42810784?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=REEScumDOtyVBVpKc04a5HkY54ZSMEmR%2FcWZluykBfY%3D)
2026-03-28 22:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143056/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN12MPO/42811411?sv=2020-08-04&st=2026-03-28T22%3A02%3A17Z&se=2026-03-28T22%3A27%3A17Z&sr=b&sp=r&sig=vaDbKC9GOS5YR997de0XgHeErST%2FlNyRRDf7oBjUPCM%3D)
2026-03-28 22:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074165/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL70OLP/42811185?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=n62RmwLfnQZ03W3xhwAvTmCKoFM9E%2F3s1A1vq6NMiI8%3D)
2026-03-28 22:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176660/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG19DRZ/42810262?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=r5DoT3V6pkDiNlGEETNxtyjahcekFrVAyf%2Fq0%2Ff6cS8%3D)
2026-03-28 22:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074216/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE20NXF/42811204?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=8guyqRkCVpBOXe0dgepjNvrccjw3jG3HSH7VEUA89kk%3D)
2026-03-28 22:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074224/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE20NXF/42811204?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=8guyqRkCVpBOXe0dgepjNvrccjw3jG3HSH7VEUA89kk%3D)
2026-03-28 22:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477a4550>
2026-03-28 22:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f7b21e0-59a7-5686-a122-ac8b5ae9229a/3f7b21e0-59a7-5686-a122-ac8b5ae9229a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL70OLP%252F699074175%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074175/600 saved to cache
2026-03-28 22:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f7b21e0-59a7-5686-a122-ac8b5ae9229a
2026-03-28 22:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477a5a90>
2026-03-28 22:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f7b21e0-59a7-5686-a122-ac8b5ae9229a/3f7b21e0-59a7-5686-a122-ac8b5ae9229a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL70OLP%252F699074169%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074169/600 saved to cache
2026-03-28 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f7b21e0-59a7-5686-a122-ac8b5ae9229a
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477c6950>
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0cc7482-767b-567d-a58d-775f8d1bb696/e0cc7482-767b-567d-a58d-775f8d1bb696_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN12MPO%252F699143072%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143072/600 saved to cache
2026-03-28 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e0cc7482-767b-567d-a58d-775f8d1bb696
2026-03-28 22:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981003/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN70GXV/42810784?sv=2020-08-04&st=2026-03-28T22%3A02%3A18Z&se=2026-03-28T22%3A27%3A18Z&sr=b&sp=r&sig=REEScumDOtyVBVpKc04a5HkY54ZSMEmR%2FcWZluykBfY%3D)
2026-03-28 22:02:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011627/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011627>
2026-03-28 22:02:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074208/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074208>
2026-03-28 22:02:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176651/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176651>
2026-03-28 22:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074226/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ21YWB/42811229?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=CRadIFOsUYF5mJfLgLZRcdi8AXzc77Zr1rzpVvc8LYI%3D)
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547ed950>
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e897ee42-3f14-5f4f-8d1c-2a827ef07283/e897ee42-3f14-5f4f-8d1c-2a827ef07283_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG19DRZ%252F699176669%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176669/600 saved to cache
2026-03-28 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e897ee42-3f14-5f4f-8d1c-2a827ef07283
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473b6990>
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_927dcf7c-8068-5099-8312-bf23933749d3/927dcf7c-8068-5099-8312-bf23933749d3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK12LUP%252F699011632%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011632/600 saved to cache
2026-03-28 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 927dcf7c-8068-5099-8312-bf23933749d3
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477db910>
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e568b76a-20a9-5c16-99a7-ea60aeecf1e0/e568b76a-20a9-5c16-99a7-ea60aeecf1e0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN70GXV%252F698981012%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981012/600 saved to cache
2026-03-28 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e568b76a-20a9-5c16-99a7-ea60aeecf1e0
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557fcc290>
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0cc7482-767b-567d-a58d-775f8d1bb696/e0cc7482-767b-567d-a58d-775f8d1bb696_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN12MPO%252F699143056%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143056/600 saved to cache
2026-03-28 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0cc7482-767b-567d-a58d-775f8d1bb696
2026-03-28 22:02:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0cc7482-767b-567d-a58d-775f8d1bb696, skipping ID generation
2026-03-28 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0cc7482-767b-567d-a58d-775f8d1bb696 sending to next pipeline
2026-03-28 22:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e0cc7482-767b-567d-a58d-775f8d1bb696, identifier: KN12%20MPO
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54738e650>
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f7b21e0-59a7-5686-a122-ac8b5ae9229a/3f7b21e0-59a7-5686-a122-ac8b5ae9229a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL70OLP%252F699074165%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074165/600 saved to cache
2026-03-28 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f7b21e0-59a7-5686-a122-ac8b5ae9229a
2026-03-28 22:02:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f7b21e0-59a7-5686-a122-ac8b5ae9229a, skipping ID generation
2026-03-28 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f7b21e0-59a7-5686-a122-ac8b5ae9229a sending to next pipeline
2026-03-28 22:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3f7b21e0-59a7-5686-a122-ac8b5ae9229a, identifier: PL70%20OLP
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474a9090>
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e897ee42-3f14-5f4f-8d1c-2a827ef07283/e897ee42-3f14-5f4f-8d1c-2a827ef07283_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG19DRZ%252F699176660%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176660/600 saved to cache
2026-03-28 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e897ee42-3f14-5f4f-8d1c-2a827ef07283
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474aab90>
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40869bfc-8bb4-569d-b730-83efe1f5fcf1/40869bfc-8bb4-569d-b730-83efe1f5fcf1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE20NXF%252F699074216%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074216/600 saved to cache
2026-03-28 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 40869bfc-8bb4-569d-b730-83efe1f5fcf1
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547efe50>
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40869bfc-8bb4-569d-b730-83efe1f5fcf1/40869bfc-8bb4-569d-b730-83efe1f5fcf1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE20NXF%252F699074224%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074224/600 saved to cache
2026-03-28 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 40869bfc-8bb4-569d-b730-83efe1f5fcf1
2026-03-28 22:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e0cc7482-767b-567d-a58d-775f8d1bb696 with identifier: KN12%20MPO
2026-03-28 22:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e0cc7482-767b-567d-a58d-775f8d1bb696 with identifier: KN12%20MPO
2026-03-28 22:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e0cc7482-767b-567d-a58d-775f8d1bb696 with identifier: KN12%20MPO to the API
2026-03-28 22:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143056/600>
{'auction_title': '',
'c_o_2_emission_value': 145,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cc7482-767b-567d-a58d-775f8d1bb696/e0cc7482-767b-567d-a58d-775f8d1bb696_expert_report_file_3f22f061-7349-4a4b-bfe0-f6bb875e5f3b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KN12%20MPO-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e0cc7482-767b-567d-a58d-775f8d1bb696',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KN12 MPO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KN12%20MPO&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'PEUGEOT',
'model': '207',
'odometer': 89592,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cc7482-767b-567d-a58d-775f8d1bb696/e0cc7482-767b-567d-a58d-775f8d1bb696_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52301,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143056/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cc7482-767b-567d-a58d-775f8d1bb696/e0cc7482-767b-567d-a58d-775f8d1bb696_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52818,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143072/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cc7482-767b-567d-a58d-775f8d1bb696/e0cc7482-767b-567d-a58d-775f8d1bb696_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50732,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143094/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cc7482-767b-567d-a58d-775f8d1bb696/e0cc7482-767b-567d-a58d-775f8d1bb696_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48724,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143116/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cc7482-767b-567d-a58d-775f8d1bb696/e0cc7482-767b-567d-a58d-775f8d1bb696_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44180,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143131/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cc7482-767b-567d-a58d-775f8d1bb696/e0cc7482-767b-567d-a58d-775f8d1bb696_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44998,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143150/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cc7482-767b-567d-a58d-775f8d1bb696/e0cc7482-767b-567d-a58d-775f8d1bb696_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103459,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143183/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cc7482-767b-567d-a58d-775f8d1bb696/e0cc7482-767b-567d-a58d-775f8d1bb696_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81249,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143208/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cc7482-767b-567d-a58d-775f8d1bb696/e0cc7482-767b-567d-a58d-775f8d1bb696_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90580,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143229/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cc7482-767b-567d-a58d-775f8d1bb696/e0cc7482-767b-567d-a58d-775f8d1bb696_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94316,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN12MPO/699143248/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'PEUGEOT 207 1.4 ACTIVE Hatchback',
'transmission': 'manual',
'trim': 'ACTIVE',
'vin': 'VF3WCKFT0CE019850',
'year': 2012}
2026-03-28 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN12%2520MPO%27 HTTP/1.1" 200 None
2026-03-28 22:02:27 [bca.uk] INFO: Saving data for KN12%20MPO: {'created_time': 1774735347.113878, 'last_price_update_time': 1774735347.113895, 'auction_closing_time': 1774864800.0}
2026-03-28 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KN12%2520MPO') HTTP/1.1" 204 0
2026-03-28 22:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3f7b21e0-59a7-5686-a122-ac8b5ae9229a with identifier: PL70%20OLP
2026-03-28 22:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3f7b21e0-59a7-5686-a122-ac8b5ae9229a with identifier: PL70%20OLP
2026-03-28 22:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3f7b21e0-59a7-5686-a122-ac8b5ae9229a with identifier: PL70%20OLP to the API
2026-03-28 22:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074165/600>
{'auction_title': '',
'c_o_2_emission_value': 155,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f7b21e0-59a7-5686-a122-ac8b5ae9229a/3f7b21e0-59a7-5686-a122-ac8b5ae9229a_expert_report_file_e3818ce2-dc7c-4030-ad15-5ff6de25e1af.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PL70%20OLP-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3f7b21e0-59a7-5686-a122-ac8b5ae9229a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PL70 OLP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PL70%20OLP&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'E220 D',
'odometer': 32611,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f7b21e0-59a7-5686-a122-ac8b5ae9229a/3f7b21e0-59a7-5686-a122-ac8b5ae9229a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44965,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074165/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f7b21e0-59a7-5686-a122-ac8b5ae9229a/3f7b21e0-59a7-5686-a122-ac8b5ae9229a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43179,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074169/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f7b21e0-59a7-5686-a122-ac8b5ae9229a/3f7b21e0-59a7-5686-a122-ac8b5ae9229a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41212,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074175/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f7b21e0-59a7-5686-a122-ac8b5ae9229a/3f7b21e0-59a7-5686-a122-ac8b5ae9229a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39530,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074181/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f7b21e0-59a7-5686-a122-ac8b5ae9229a/3f7b21e0-59a7-5686-a122-ac8b5ae9229a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35276,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074187/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f7b21e0-59a7-5686-a122-ac8b5ae9229a/3f7b21e0-59a7-5686-a122-ac8b5ae9229a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34848,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074193/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f7b21e0-59a7-5686-a122-ac8b5ae9229a/3f7b21e0-59a7-5686-a122-ac8b5ae9229a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77340,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074201/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f7b21e0-59a7-5686-a122-ac8b5ae9229a/3f7b21e0-59a7-5686-a122-ac8b5ae9229a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71341,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074207/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f7b21e0-59a7-5686-a122-ac8b5ae9229a/3f7b21e0-59a7-5686-a122-ac8b5ae9229a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86725,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074214/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f7b21e0-59a7-5686-a122-ac8b5ae9229a/3f7b21e0-59a7-5686-a122-ac8b5ae9229a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78301,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL70OLP/699074222/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ E220 D 2.0 AMG LINE NIGHT ED.PREM.PLUS 9G Coupe',
'transmission': 'manual',
'trim': 'AMG LINE NIGHT ED.PREM.PLUS 9G',
'vin': 'W1K2383142F157960',
'year': 2021}
2026-03-28 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PL70%2520OLP%27 HTTP/1.1" 200 None
2026-03-28 22:02:27 [bca.uk] INFO: Saving data for PL70%20OLP: {'created_time': 1774735347.530796, 'last_price_update_time': 1774735347.530806, 'auction_closing_time': 1774951200.0}
2026-03-28 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PL70%2520OLP') HTTP/1.1" 204 0
2026-03-28 22:02:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074211/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074211>
2026-03-28 22:02:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074198/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074198>
2026-03-28 22:02:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176631/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176631>
2026-03-28 22:02:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011619/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011619>
2026-03-28 22:02:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699060108/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060108>
2026-03-28 22:02:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994874/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994874>
2026-03-28 22:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074218/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ21YWB/42811229?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=CRadIFOsUYF5mJfLgLZRcdi8AXzc77Zr1rzpVvc8LYI%3D)
2026-03-28 22:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011629/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK12LUP/42810942?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=CJGWCFvotVIxFu5vsyjuS7m3KqOjHqCp9HQAw7ZqR%2BE%3D)
2026-03-28 22:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474a9bd0>
2026-03-28 22:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e568b76a-20a9-5c16-99a7-ea60aeecf1e0/e568b76a-20a9-5c16-99a7-ea60aeecf1e0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN70GXV%252F698981003%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981003/600 saved to cache
2026-03-28 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e568b76a-20a9-5c16-99a7-ea60aeecf1e0
2026-03-28 22:02:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e568b76a-20a9-5c16-99a7-ea60aeecf1e0, skipping ID generation
2026-03-28 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e568b76a-20a9-5c16-99a7-ea60aeecf1e0 sending to next pipeline
2026-03-28 22:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e568b76a-20a9-5c16-99a7-ea60aeecf1e0, identifier: WN70%20GXV
2026-03-28 22:02:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477a5750>
2026-03-28 22:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c9a210-8239-5652-942c-af89b324b768/02c9a210-8239-5652-942c-af89b324b768_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ21YWB%252F699074226%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074226/600 saved to cache
2026-03-28 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 02c9a210-8239-5652-942c-af89b324b768
2026-03-28 22:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e568b76a-20a9-5c16-99a7-ea60aeecf1e0 with identifier: WN70%20GXV
2026-03-28 22:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e568b76a-20a9-5c16-99a7-ea60aeecf1e0 with identifier: WN70%20GXV
2026-03-28 22:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e568b76a-20a9-5c16-99a7-ea60aeecf1e0 with identifier: WN70%20GXV to the API
2026-03-28 22:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981003/600>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e568b76a-20a9-5c16-99a7-ea60aeecf1e0/e568b76a-20a9-5c16-99a7-ea60aeecf1e0_expert_report_file_712ebcfd-75d5-47a4-8d0d-7ab6bf843b60.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WN70%20GXV-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e568b76a-20a9-5c16-99a7-ea60aeecf1e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WN70 GXV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WN70%20GXV&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'FIAT',
'model': '500',
'odometer': 7156,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e568b76a-20a9-5c16-99a7-ea60aeecf1e0/e568b76a-20a9-5c16-99a7-ea60aeecf1e0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45287,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981003/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e568b76a-20a9-5c16-99a7-ea60aeecf1e0/e568b76a-20a9-5c16-99a7-ea60aeecf1e0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45350,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981012/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e568b76a-20a9-5c16-99a7-ea60aeecf1e0/e568b76a-20a9-5c16-99a7-ea60aeecf1e0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43229,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981026/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e568b76a-20a9-5c16-99a7-ea60aeecf1e0/e568b76a-20a9-5c16-99a7-ea60aeecf1e0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43309,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981046/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e568b76a-20a9-5c16-99a7-ea60aeecf1e0/e568b76a-20a9-5c16-99a7-ea60aeecf1e0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40691,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981063/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e568b76a-20a9-5c16-99a7-ea60aeecf1e0/e568b76a-20a9-5c16-99a7-ea60aeecf1e0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40990,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981096/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e568b76a-20a9-5c16-99a7-ea60aeecf1e0/e568b76a-20a9-5c16-99a7-ea60aeecf1e0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94480,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981140/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e568b76a-20a9-5c16-99a7-ea60aeecf1e0/e568b76a-20a9-5c16-99a7-ea60aeecf1e0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64597,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981177/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e568b76a-20a9-5c16-99a7-ea60aeecf1e0/e568b76a-20a9-5c16-99a7-ea60aeecf1e0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83720,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981211/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e568b76a-20a9-5c16-99a7-ea60aeecf1e0/e568b76a-20a9-5c16-99a7-ea60aeecf1e0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84646,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN70GXV/698981257/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'FIAT 500 1.0 M/H POP Hatchback',
'transmission': 'manual',
'trim': 'M/H POP',
'vin': 'ZFA3120000JE04717',
'year': 2020}
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN70%2520GXV%27 HTTP/1.1" 200 None
2026-03-28 22:02:28 [bca.uk] INFO: Saving data for WN70%20GXV: {'created_time': 1774735348.142378, 'last_price_update_time': 1774735348.142389, 'auction_closing_time': 1774951200.0}
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WN70%2520GXV') HTTP/1.1" 204 0
2026-03-28 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074196/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074196>
2026-03-28 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994827/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994827>
2026-03-28 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699060085/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060085>
2026-03-28 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176621/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176621>
2026-03-28 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074182/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074182>
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554826f10>
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c9a210-8239-5652-942c-af89b324b768/02c9a210-8239-5652-942c-af89b324b768_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ21YWB%252F699074218%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074218/600 saved to cache
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 02c9a210-8239-5652-942c-af89b324b768
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474aa110>
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_927dcf7c-8068-5099-8312-bf23933749d3/927dcf7c-8068-5099-8312-bf23933749d3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK12LUP%252F699011629%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011629/600 saved to cache
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 927dcf7c-8068-5099-8312-bf23933749d3
2026-03-28 22:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011627/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK12LUP/42810942?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=CJGWCFvotVIxFu5vsyjuS7m3KqOjHqCp9HQAw7ZqR%2BE%3D)
2026-03-28 22:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176651/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG19DRZ/42810262?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=r5DoT3V6pkDiNlGEETNxtyjahcekFrVAyf%2Fq0%2Ff6cS8%3D)
2026-03-28 22:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074208/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE20NXF/42811204?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=8guyqRkCVpBOXe0dgepjNvrccjw3jG3HSH7VEUA89kk%3D)
2026-03-28 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074192/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074192>
2026-03-28 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011612/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011612>
2026-03-28 22:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011619/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK12LUP/42810942?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=CJGWCFvotVIxFu5vsyjuS7m3KqOjHqCp9HQAw7ZqR%2BE%3D)
2026-03-28 22:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994874/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG13FKD/42810885?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=Pgf4CbZ3Xrn2VVPEUN28cWI9Q7Qnnc%2B7z4mHlgVw6As%3D)
2026-03-28 22:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074198/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ21YWB/42811229?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=CRadIFOsUYF5mJfLgLZRcdi8AXzc77Zr1rzpVvc8LYI%3D)
2026-03-28 22:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699060108/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO22KPT/42811142?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=1%2BEjPFbwTiiWyiyCZVlnljJUhR2oYtbJyuHwOJgIeoM%3D)
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549b9050>
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_927dcf7c-8068-5099-8312-bf23933749d3/927dcf7c-8068-5099-8312-bf23933749d3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK12LUP%252F699011627%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011627/600 saved to cache
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 927dcf7c-8068-5099-8312-bf23933749d3
2026-03-28 22:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074211/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ21YWB/42811229?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=CRadIFOsUYF5mJfLgLZRcdi8AXzc77Zr1rzpVvc8LYI%3D)
2026-03-28 22:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176631/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG19DRZ/42810262?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=r5DoT3V6pkDiNlGEETNxtyjahcekFrVAyf%2Fq0%2Ff6cS8%3D)
2026-03-28 22:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176621/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG19DRZ/42810262?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=r5DoT3V6pkDiNlGEETNxtyjahcekFrVAyf%2Fq0%2Ff6cS8%3D)
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b83a50>
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e897ee42-3f14-5f4f-8d1c-2a827ef07283/e897ee42-3f14-5f4f-8d1c-2a827ef07283_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG19DRZ%252F699176651%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176651/600 saved to cache
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e897ee42-3f14-5f4f-8d1c-2a827ef07283
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477ae950>
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40869bfc-8bb4-569d-b730-83efe1f5fcf1/40869bfc-8bb4-569d-b730-83efe1f5fcf1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE20NXF%252F699074208%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074208/600 saved to cache
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40869bfc-8bb4-569d-b730-83efe1f5fcf1
2026-03-28 22:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699060085/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO22KPT/42811142?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=1%2BEjPFbwTiiWyiyCZVlnljJUhR2oYtbJyuHwOJgIeoM%3D)
2026-03-28 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699060070/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060070>
2026-03-28 22:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074182/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE20NXF/42811204?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=8guyqRkCVpBOXe0dgepjNvrccjw3jG3HSH7VEUA89kk%3D)
2026-03-28 22:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074196/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ21YWB/42811229?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=CRadIFOsUYF5mJfLgLZRcdi8AXzc77Zr1rzpVvc8LYI%3D)
2026-03-28 22:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994827/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG13FKD/42810885?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=Pgf4CbZ3Xrn2VVPEUN28cWI9Q7Qnnc%2B7z4mHlgVw6As%3D)
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549ac090>
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_927dcf7c-8068-5099-8312-bf23933749d3/927dcf7c-8068-5099-8312-bf23933749d3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK12LUP%252F699011619%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011619/600 saved to cache
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 927dcf7c-8068-5099-8312-bf23933749d3
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54722e090>
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43f7303a-a2f6-5f86-b81e-26af26f2b888/43f7303a-a2f6-5f86-b81e-26af26f2b888_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG13FKD%252F698994874%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994874/600 saved to cache
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 43f7303a-a2f6-5f86-b81e-26af26f2b888
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b5af50>
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c9a210-8239-5652-942c-af89b324b768/02c9a210-8239-5652-942c-af89b324b768_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ21YWB%252F699074198%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074198/600 saved to cache
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 02c9a210-8239-5652-942c-af89b324b768
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473b7190>
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f8a9fc-307f-5fd9-9f57-53be64230a5a/a7f8a9fc-307f-5fd9-9f57-53be64230a5a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO22KPT%252F699060108%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699060108/600 saved to cache
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a7f8a9fc-307f-5fd9-9f57-53be64230a5a
2026-03-28 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994781/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994781>
2026-03-28 22:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074192/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ21YWB/42811229?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=CRadIFOsUYF5mJfLgLZRcdi8AXzc77Zr1rzpVvc8LYI%3D)
2026-03-28 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074171/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074171>
2026-03-28 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176611/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176611>
2026-03-28 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011602/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011602>
2026-03-28 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699060052/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699060052>
2026-03-28 22:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011612/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK12LUP/42810942?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=CJGWCFvotVIxFu5vsyjuS7m3KqOjHqCp9HQAw7ZqR%2BE%3D)
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55480a450>
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c9a210-8239-5652-942c-af89b324b768/02c9a210-8239-5652-942c-af89b324b768_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ21YWB%252F699074211%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074211/600 saved to cache
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 02c9a210-8239-5652-942c-af89b324b768
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477ed150>
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e897ee42-3f14-5f4f-8d1c-2a827ef07283/e897ee42-3f14-5f4f-8d1c-2a827ef07283_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG19DRZ%252F699176631%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176631/600 saved to cache
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e897ee42-3f14-5f4f-8d1c-2a827ef07283
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556f74490>
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e897ee42-3f14-5f4f-8d1c-2a827ef07283/e897ee42-3f14-5f4f-8d1c-2a827ef07283_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG19DRZ%252F699176621%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176621/600 saved to cache
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e897ee42-3f14-5f4f-8d1c-2a827ef07283
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54776e250>
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f8a9fc-307f-5fd9-9f57-53be64230a5a/a7f8a9fc-307f-5fd9-9f57-53be64230a5a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO22KPT%252F699060085%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699060085/600 saved to cache
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a7f8a9fc-307f-5fd9-9f57-53be64230a5a
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54722f150>
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40869bfc-8bb4-569d-b730-83efe1f5fcf1/40869bfc-8bb4-569d-b730-83efe1f5fcf1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE20NXF%252F699074182%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074182/600 saved to cache
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40869bfc-8bb4-569d-b730-83efe1f5fcf1
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547136fd0>
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c9a210-8239-5652-942c-af89b324b768/02c9a210-8239-5652-942c-af89b324b768_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ21YWB%252F699074196%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074196/600 saved to cache
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 02c9a210-8239-5652-942c-af89b324b768
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477ee290>
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43f7303a-a2f6-5f86-b81e-26af26f2b888/43f7303a-a2f6-5f86-b81e-26af26f2b888_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG13FKD%252F698994827%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994827/600 saved to cache
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 43f7303a-a2f6-5f86-b81e-26af26f2b888
2026-03-28 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074180/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074180>
2026-03-28 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059978/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059978>
2026-03-28 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011597/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YK12LUP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074166/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AE20NXF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059987/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059987>
2026-03-28 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176607/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YG19DRZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074174/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GJ21YWB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699060070/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO22KPT/42811142?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=1%2BEjPFbwTiiWyiyCZVlnljJUhR2oYtbJyuHwOJgIeoM%3D)
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547306c50>
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c9a210-8239-5652-942c-af89b324b768/02c9a210-8239-5652-942c-af89b324b768_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ21YWB%252F699074192%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074192/600 saved to cache
2026-03-28 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 02c9a210-8239-5652-942c-af89b324b768
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477ce2d0>
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_927dcf7c-8068-5099-8312-bf23933749d3/927dcf7c-8068-5099-8312-bf23933749d3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK12LUP%252F699011612%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011612/600 saved to cache
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 927dcf7c-8068-5099-8312-bf23933749d3
2026-03-28 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011602/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK12LUP/42810942?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=CJGWCFvotVIxFu5vsyjuS7m3KqOjHqCp9HQAw7ZqR%2BE%3D)
2026-03-28 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176611/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG19DRZ/42810262?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=r5DoT3V6pkDiNlGEETNxtyjahcekFrVAyf%2Fq0%2Ff6cS8%3D)
2026-03-28 22:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059966/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059966>
2026-03-28 22:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994745/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994745>
2026-03-28 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699060052/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO22KPT/42811142?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=1%2BEjPFbwTiiWyiyCZVlnljJUhR2oYtbJyuHwOJgIeoM%3D)
2026-03-28 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5572a1b90>
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f8a9fc-307f-5fd9-9f57-53be64230a5a/a7f8a9fc-307f-5fd9-9f57-53be64230a5a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO22KPT%252F699060070%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699060070/600 saved to cache
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7f8a9fc-307f-5fd9-9f57-53be64230a5a
2026-03-28 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994781/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG13FKD/42810885?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=Pgf4CbZ3Xrn2VVPEUN28cWI9Q7Qnnc%2B7z4mHlgVw6As%3D)
2026-03-28 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074171/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE20NXF/42811204?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=8guyqRkCVpBOXe0dgepjNvrccjw3jG3HSH7VEUA89kk%3D)
2026-03-28 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011597/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK12LUP/42810942?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=CJGWCFvotVIxFu5vsyjuS7m3KqOjHqCp9HQAw7ZqR%2BE%3D)
2026-03-28 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074166/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE20NXF/42811204?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=8guyqRkCVpBOXe0dgepjNvrccjw3jG3HSH7VEUA89kk%3D)
2026-03-28 22:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994727/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994727>
2026-03-28 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074174/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ21YWB/42811229?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=CRadIFOsUYF5mJfLgLZRcdi8AXzc77Zr1rzpVvc8LYI%3D)
2026-03-28 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059987/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO22KPT/42811142?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=1%2BEjPFbwTiiWyiyCZVlnljJUhR2oYtbJyuHwOJgIeoM%3D)
2026-03-28 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176607/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG19DRZ/42810262?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=r5DoT3V6pkDiNlGEETNxtyjahcekFrVAyf%2Fq0%2Ff6cS8%3D)
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477d9190>
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_927dcf7c-8068-5099-8312-bf23933749d3/927dcf7c-8068-5099-8312-bf23933749d3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK12LUP%252F699011602%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011602/600 saved to cache
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 927dcf7c-8068-5099-8312-bf23933749d3
2026-03-28 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059978/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO22KPT/42811142?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=1%2BEjPFbwTiiWyiyCZVlnljJUhR2oYtbJyuHwOJgIeoM%3D)
2026-03-28 22:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059958/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059958>
2026-03-28 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074180/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ21YWB/42811229?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=CRadIFOsUYF5mJfLgLZRcdi8AXzc77Zr1rzpVvc8LYI%3D)
2026-03-28 22:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093900/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093900>
2026-03-28 22:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110886/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110886>
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543e8dd0>
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e897ee42-3f14-5f4f-8d1c-2a827ef07283/e897ee42-3f14-5f4f-8d1c-2a827ef07283_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG19DRZ%252F699176611%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176611/600 saved to cache
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e897ee42-3f14-5f4f-8d1c-2a827ef07283
2026-03-28 22:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126590/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126590>
2026-03-28 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994745/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG13FKD/42810885?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=Pgf4CbZ3Xrn2VVPEUN28cWI9Q7Qnnc%2B7z4mHlgVw6As%3D)
2026-03-28 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059966/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO22KPT/42811142?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=1%2BEjPFbwTiiWyiyCZVlnljJUhR2oYtbJyuHwOJgIeoM%3D)
2026-03-28 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542e8050>
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f8a9fc-307f-5fd9-9f57-53be64230a5a/a7f8a9fc-307f-5fd9-9f57-53be64230a5a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO22KPT%252F699060052%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699060052/600 saved to cache
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7f8a9fc-307f-5fd9-9f57-53be64230a5a
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe564c1ca10>
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43f7303a-a2f6-5f86-b81e-26af26f2b888/43f7303a-a2f6-5f86-b81e-26af26f2b888_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG13FKD%252F698994781%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994781/600 saved to cache
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43f7303a-a2f6-5f86-b81e-26af26f2b888
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543e9a10>
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40869bfc-8bb4-569d-b730-83efe1f5fcf1/40869bfc-8bb4-569d-b730-83efe1f5fcf1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE20NXF%252F699074171%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074171/600 saved to cache
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 40869bfc-8bb4-569d-b730-83efe1f5fcf1
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5572a21d0>
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_927dcf7c-8068-5099-8312-bf23933749d3/927dcf7c-8068-5099-8312-bf23933749d3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK12LUP%252F699011597%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011597/600 saved to cache
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 927dcf7c-8068-5099-8312-bf23933749d3
2026-03-28 22:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 927dcf7c-8068-5099-8312-bf23933749d3, skipping ID generation
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 927dcf7c-8068-5099-8312-bf23933749d3 sending to next pipeline
2026-03-28 22:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 927dcf7c-8068-5099-8312-bf23933749d3, identifier: YK12%20LUP
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473ead50>
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40869bfc-8bb4-569d-b730-83efe1f5fcf1/40869bfc-8bb4-569d-b730-83efe1f5fcf1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE20NXF%252F699074166%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074166/600 saved to cache
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40869bfc-8bb4-569d-b730-83efe1f5fcf1
2026-03-28 22:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40869bfc-8bb4-569d-b730-83efe1f5fcf1, skipping ID generation
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40869bfc-8bb4-569d-b730-83efe1f5fcf1 sending to next pipeline
2026-03-28 22:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 40869bfc-8bb4-569d-b730-83efe1f5fcf1, identifier: AE20%20NXF
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474aaa10>
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c9a210-8239-5652-942c-af89b324b768/02c9a210-8239-5652-942c-af89b324b768_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ21YWB%252F699074174%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074174/600 saved to cache
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02c9a210-8239-5652-942c-af89b324b768
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54733ed10>
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f8a9fc-307f-5fd9-9f57-53be64230a5a/a7f8a9fc-307f-5fd9-9f57-53be64230a5a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO22KPT%252F699059987%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059987/600 saved to cache
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7f8a9fc-307f-5fd9-9f57-53be64230a5a
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54778cf90>
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e897ee42-3f14-5f4f-8d1c-2a827ef07283/e897ee42-3f14-5f4f-8d1c-2a827ef07283_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG19DRZ%252F699176607%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176607/600 saved to cache
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e897ee42-3f14-5f4f-8d1c-2a827ef07283
2026-03-28 22:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e897ee42-3f14-5f4f-8d1c-2a827ef07283, skipping ID generation
2026-03-28 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e897ee42-3f14-5f4f-8d1c-2a827ef07283 sending to next pipeline
2026-03-28 22:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e897ee42-3f14-5f4f-8d1c-2a827ef07283, identifier: YG19%20DRZ
2026-03-28 22:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 927dcf7c-8068-5099-8312-bf23933749d3 with identifier: YK12%20LUP
2026-03-28 22:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 927dcf7c-8068-5099-8312-bf23933749d3 with identifier: YK12%20LUP
2026-03-28 22:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 927dcf7c-8068-5099-8312-bf23933749d3 with identifier: YK12%20LUP to the API
2026-03-28 22:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011597/600>
{'auction_title': '',
'c_o_2_emission_value': 122,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_927dcf7c-8068-5099-8312-bf23933749d3/927dcf7c-8068-5099-8312-bf23933749d3_expert_report_file_c804860e-b86c-423f-a811-b5ddd66faaef.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YK12%20LUP-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '927dcf7c-8068-5099-8312-bf23933749d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YK12 LUP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YK12%20LUP&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'BMW',
'model': '120D',
'odometer': 106828,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_927dcf7c-8068-5099-8312-bf23933749d3/927dcf7c-8068-5099-8312-bf23933749d3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41924,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011597/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_927dcf7c-8068-5099-8312-bf23933749d3/927dcf7c-8068-5099-8312-bf23933749d3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40098,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011602/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_927dcf7c-8068-5099-8312-bf23933749d3/927dcf7c-8068-5099-8312-bf23933749d3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37572,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011607/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_927dcf7c-8068-5099-8312-bf23933749d3/927dcf7c-8068-5099-8312-bf23933749d3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38315,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011612/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_927dcf7c-8068-5099-8312-bf23933749d3/927dcf7c-8068-5099-8312-bf23933749d3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36487,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011615/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_927dcf7c-8068-5099-8312-bf23933749d3/927dcf7c-8068-5099-8312-bf23933749d3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34973,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011619/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_927dcf7c-8068-5099-8312-bf23933749d3/927dcf7c-8068-5099-8312-bf23933749d3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76998,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011623/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_927dcf7c-8068-5099-8312-bf23933749d3/927dcf7c-8068-5099-8312-bf23933749d3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69949,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011627/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_927dcf7c-8068-5099-8312-bf23933749d3/927dcf7c-8068-5099-8312-bf23933749d3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84190,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011629/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_927dcf7c-8068-5099-8312-bf23933749d3/927dcf7c-8068-5099-8312-bf23933749d3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73723,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK12LUP/699011632/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'BMW 120D 2.0 URBAN Hatchback',
'transmission': 'manual',
'trim': 'URBAN',
'vin': 'WBA1C32000E643880',
'year': 2012}
2026-03-28 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK12%2520LUP%27 HTTP/1.1" 200 None
2026-03-28 22:02:30 [bca.uk] INFO: Saving data for YK12%20LUP: {'created_time': 1774735350.413073, 'last_price_update_time': 1774735350.413084, 'auction_closing_time': 1774864800.0}
2026-03-28 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YK12%2520LUP') HTTP/1.1" 204 0
2026-03-28 22:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 40869bfc-8bb4-569d-b730-83efe1f5fcf1 with identifier: AE20%20NXF
2026-03-28 22:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 40869bfc-8bb4-569d-b730-83efe1f5fcf1 with identifier: AE20%20NXF
2026-03-28 22:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 40869bfc-8bb4-569d-b730-83efe1f5fcf1 with identifier: AE20%20NXF to the API
2026-03-28 22:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074166/600>
{'auction_title': '',
'c_o_2_emission_value': 182,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40869bfc-8bb4-569d-b730-83efe1f5fcf1/40869bfc-8bb4-569d-b730-83efe1f5fcf1_expert_report_file_95aaed23-debd-4611-8206-47c54ec44312.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AE20%20NXF-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '40869bfc-8bb4-569d-b730-83efe1f5fcf1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AE20 NXF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AE20%20NXF&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'JAGUAR',
'model': 'F-PACE',
'odometer': 50746,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40869bfc-8bb4-569d-b730-83efe1f5fcf1/40869bfc-8bb4-569d-b730-83efe1f5fcf1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45520,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074166/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40869bfc-8bb4-569d-b730-83efe1f5fcf1/40869bfc-8bb4-569d-b730-83efe1f5fcf1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44549,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074171/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40869bfc-8bb4-569d-b730-83efe1f5fcf1/40869bfc-8bb4-569d-b730-83efe1f5fcf1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42732,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074177/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40869bfc-8bb4-569d-b730-83efe1f5fcf1/40869bfc-8bb4-569d-b730-83efe1f5fcf1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41085,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074182/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40869bfc-8bb4-569d-b730-83efe1f5fcf1/40869bfc-8bb4-569d-b730-83efe1f5fcf1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39031,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074189/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40869bfc-8bb4-569d-b730-83efe1f5fcf1/40869bfc-8bb4-569d-b730-83efe1f5fcf1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38015,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074194/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40869bfc-8bb4-569d-b730-83efe1f5fcf1/40869bfc-8bb4-569d-b730-83efe1f5fcf1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85294,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074202/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40869bfc-8bb4-569d-b730-83efe1f5fcf1/40869bfc-8bb4-569d-b730-83efe1f5fcf1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80194,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074208/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40869bfc-8bb4-569d-b730-83efe1f5fcf1/40869bfc-8bb4-569d-b730-83efe1f5fcf1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83897,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074216/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40869bfc-8bb4-569d-b730-83efe1f5fcf1/40869bfc-8bb4-569d-b730-83efe1f5fcf1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78872,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE20NXF/699074224/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'JAGUAR F-PACE 2.0 D 180 AWD R SPORT StationWagon',
'transmission': 'automatic',
'trim': 'D 180 AWD R SPORT',
'vin': 'SADCA2AN2LA654520',
'year': 2020}
2026-03-28 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE20%2520NXF%27 HTTP/1.1" 200 None
2026-03-28 22:02:30 [bca.uk] INFO: Saving data for AE20%20NXF: {'created_time': 1774735350.788818, 'last_price_update_time': 1774735350.788829, 'auction_closing_time': 1774951200.0}
2026-03-28 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AE20%2520NXF') HTTP/1.1" 204 0
2026-03-28 22:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e897ee42-3f14-5f4f-8d1c-2a827ef07283 with identifier: YG19%20DRZ
2026-03-28 22:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e897ee42-3f14-5f4f-8d1c-2a827ef07283 with identifier: YG19%20DRZ
2026-03-28 22:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e897ee42-3f14-5f4f-8d1c-2a827ef07283 with identifier: YG19%20DRZ to the API
2026-03-28 22:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176607/600>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e897ee42-3f14-5f4f-8d1c-2a827ef07283/e897ee42-3f14-5f4f-8d1c-2a827ef07283_expert_report_file_77c91bd7-b7cd-4684-bbfc-4b929957e2f8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YG19%20DRZ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e897ee42-3f14-5f4f-8d1c-2a827ef07283',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YG19 DRZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YG19%20DRZ&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 44345,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e897ee42-3f14-5f4f-8d1c-2a827ef07283/e897ee42-3f14-5f4f-8d1c-2a827ef07283_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45179,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176607/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e897ee42-3f14-5f4f-8d1c-2a827ef07283/e897ee42-3f14-5f4f-8d1c-2a827ef07283_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42783,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176611/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e897ee42-3f14-5f4f-8d1c-2a827ef07283/e897ee42-3f14-5f4f-8d1c-2a827ef07283_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39606,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176616/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e897ee42-3f14-5f4f-8d1c-2a827ef07283/e897ee42-3f14-5f4f-8d1c-2a827ef07283_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39637,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176621/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e897ee42-3f14-5f4f-8d1c-2a827ef07283/e897ee42-3f14-5f4f-8d1c-2a827ef07283_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38406,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176626/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e897ee42-3f14-5f4f-8d1c-2a827ef07283/e897ee42-3f14-5f4f-8d1c-2a827ef07283_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37810,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176631/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e897ee42-3f14-5f4f-8d1c-2a827ef07283/e897ee42-3f14-5f4f-8d1c-2a827ef07283_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81791,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176640/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e897ee42-3f14-5f4f-8d1c-2a827ef07283/e897ee42-3f14-5f4f-8d1c-2a827ef07283_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69592,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176651/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e897ee42-3f14-5f4f-8d1c-2a827ef07283/e897ee42-3f14-5f4f-8d1c-2a827ef07283_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82189,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176660/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e897ee42-3f14-5f4f-8d1c-2a827ef07283/e897ee42-3f14-5f4f-8d1c-2a827ef07283_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66417,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG19DRZ/699176669/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.4 T 16V 150 SRI Hatchback',
'transmission': 'manual',
'trim': 'T 16V 150 SRI',
'vin': 'W0VBF6EC7KG341747',
'year': 2019}
2026-03-28 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG19%2520DRZ%27 HTTP/1.1" 200 None
2026-03-28 22:02:31 [bca.uk] INFO: Saving data for YG19%20DRZ: {'created_time': 1774735351.399548, 'last_price_update_time': 1774735351.399558, 'auction_closing_time': 1774951200.0}
2026-03-28 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YG19%2520DRZ') HTTP/1.1" 204 0
2026-03-28 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093866/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093866>
2026-03-28 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110845/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110845>
2026-03-28 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031575/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031575>
2026-03-28 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RJ71WJK/42811152?sv=2020-08-04&st=2026-03-28T22%3A02%3A29Z&se=2026-03-28T22%3A27%3A29Z&sr=b&sp=r&sig=7Naoe6Q8stIqSw2XvQNIn8leLBwgQ9qeE6qRwPmkHyQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RJ71%20WJK-GB>
2026-03-28 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110869/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110869>
2026-03-28 22:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994727/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG13FKD/42810885?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=Pgf4CbZ3Xrn2VVPEUN28cWI9Q7Qnnc%2B7z4mHlgVw6As%3D)
2026-03-28 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093876/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093876>
2026-03-28 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126568/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126568>
2026-03-28 22:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547342490>
2026-03-28 22:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f8a9fc-307f-5fd9-9f57-53be64230a5a/a7f8a9fc-307f-5fd9-9f57-53be64230a5a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO22KPT%252F699059978%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059978/600 saved to cache
2026-03-28 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7f8a9fc-307f-5fd9-9f57-53be64230a5a
2026-03-28 22:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554279010>
2026-03-28 22:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c9a210-8239-5652-942c-af89b324b768/02c9a210-8239-5652-942c-af89b324b768_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ21YWB%252F699074180%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074180/600 saved to cache
2026-03-28 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 02c9a210-8239-5652-942c-af89b324b768
2026-03-28 22:02:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02c9a210-8239-5652-942c-af89b324b768, skipping ID generation
2026-03-28 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02c9a210-8239-5652-942c-af89b324b768 sending to next pipeline
2026-03-28 22:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 02c9a210-8239-5652-942c-af89b324b768, identifier: GJ21%20YWB
2026-03-28 22:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54728c750>
2026-03-28 22:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43f7303a-a2f6-5f86-b81e-26af26f2b888/43f7303a-a2f6-5f86-b81e-26af26f2b888_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG13FKD%252F698994745%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994745/600 saved to cache
2026-03-28 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43f7303a-a2f6-5f86-b81e-26af26f2b888
2026-03-28 22:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54776efd0>
2026-03-28 22:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f8a9fc-307f-5fd9-9f57-53be64230a5a/a7f8a9fc-307f-5fd9-9f57-53be64230a5a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO22KPT%252F699059966%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059966/600 saved to cache
2026-03-28 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7f8a9fc-307f-5fd9-9f57-53be64230a5a
2026-03-28 22:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 02c9a210-8239-5652-942c-af89b324b768 with identifier: GJ21%20YWB
2026-03-28 22:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 02c9a210-8239-5652-942c-af89b324b768 with identifier: GJ21%20YWB
2026-03-28 22:02:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 02c9a210-8239-5652-942c-af89b324b768 with identifier: GJ21%20YWB to the API
2026-03-28 22:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074180/600>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c9a210-8239-5652-942c-af89b324b768/02c9a210-8239-5652-942c-af89b324b768_expert_report_file_117aebb7-3483-416c-be24-1575cabfff36.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ21%20YWB-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '02c9a210-8239-5652-942c-af89b324b768',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ21 YWB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ21%20YWB&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'AUDI',
'model': 'A3 SPORTBACK',
'odometer': 44935,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c9a210-8239-5652-942c-af89b324b768/02c9a210-8239-5652-942c-af89b324b768_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48931,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074174/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c9a210-8239-5652-942c-af89b324b768/02c9a210-8239-5652-942c-af89b324b768_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47706,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074180/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c9a210-8239-5652-942c-af89b324b768/02c9a210-8239-5652-942c-af89b324b768_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45975,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074186/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c9a210-8239-5652-942c-af89b324b768/02c9a210-8239-5652-942c-af89b324b768_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43589,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074192/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c9a210-8239-5652-942c-af89b324b768/02c9a210-8239-5652-942c-af89b324b768_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38704,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074196/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c9a210-8239-5652-942c-af89b324b768/02c9a210-8239-5652-942c-af89b324b768_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37838,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074198/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c9a210-8239-5652-942c-af89b324b768/02c9a210-8239-5652-942c-af89b324b768_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103975,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074205/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c9a210-8239-5652-942c-af89b324b768/02c9a210-8239-5652-942c-af89b324b768_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79747,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074211/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c9a210-8239-5652-942c-af89b324b768/02c9a210-8239-5652-942c-af89b324b768_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85274,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074218/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c9a210-8239-5652-942c-af89b324b768/02c9a210-8239-5652-942c-af89b324b768_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50741,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21YWB/699074226/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'AUDI A3 SPORTBACK 1.5 35 TFSI S LINE S-T Hatchback',
'transmission': 'automatic',
'trim': '35 TFSI S LINE S-T',
'vin': 'WAUZZZGY0MA077493',
'year': 2021}
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ21%2520YWB%27 HTTP/1.1" 200 None
2026-03-28 22:02:32 [bca.uk] INFO: Saving data for GJ21%20YWB: {'created_time': 1774735352.104015, 'last_price_update_time': 1774735352.104033, 'auction_closing_time': 1774951200.0}
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ21%2520YWB') HTTP/1.1" 204 0
2026-03-28 22:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126590/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT19CVS/42811387?sv=2020-08-04&st=2026-03-28T22%3A01%3A08Z&se=2026-03-28T22%3A26%3A08Z&sr=b&sp=r&sig=Xezo2YoS0t9x6abxzIwcxCNA1wXAbFztVA4zM%2F%2Bntk8%3D)
2026-03-28 22:02:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093849/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093849>
2026-03-28 22:02:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031550/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031550>
2026-03-28 22:02:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX18RKK/42810832?sv=2020-08-04&st=2026-03-28T22%3A02%3A31Z&se=2026-03-28T22%3A27%3A31Z&sr=b&sp=r&sig=TzeWjarkyBoi7CjFvdJ7u8x%2B6uRd4ug%2FK1JF1aSzusY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WX18%20RKK-GB>
2026-03-28 22:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059958/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO22KPT/42811142?sv=2020-08-04&st=2026-03-28T22%3A02%3A13Z&se=2026-03-28T22%3A27%3A13Z&sr=b&sp=r&sig=1%2BEjPFbwTiiWyiyCZVlnljJUhR2oYtbJyuHwOJgIeoM%3D)
2026-03-28 22:02:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994240/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994240>
2026-03-28 22:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110886/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ70EHU/42811341?sv=2020-08-04&st=2026-03-28T22%3A01%3A12Z&se=2026-03-28T22%3A26%3A12Z&sr=b&sp=r&sig=jIMEwQ1nhHjk3xUWtYxp4DaMU%2Fd7rUcdJRYrXhJEbps%3D)
2026-03-28 22:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093900/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP15GZB/42811287?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=7tUa0hwrEujFHU3KRxrEE1EA%2FQ%2B2aDgCCCKK2Q5cFLc%3D)
2026-03-28 22:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547701510>
2026-03-28 22:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43f7303a-a2f6-5f86-b81e-26af26f2b888/43f7303a-a2f6-5f86-b81e-26af26f2b888_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG13FKD%252F698994727%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994727/600 saved to cache
2026-03-28 22:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43f7303a-a2f6-5f86-b81e-26af26f2b888
2026-03-28 22:02:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43f7303a-a2f6-5f86-b81e-26af26f2b888, skipping ID generation
2026-03-28 22:02:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43f7303a-a2f6-5f86-b81e-26af26f2b888 sending to next pipeline
2026-03-28 22:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 43f7303a-a2f6-5f86-b81e-26af26f2b888, identifier: BG13%20FKD
2026-03-28 22:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 43f7303a-a2f6-5f86-b81e-26af26f2b888 with identifier: BG13%20FKD
2026-03-28 22:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 43f7303a-a2f6-5f86-b81e-26af26f2b888 with identifier: BG13%20FKD
2026-03-28 22:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 43f7303a-a2f6-5f86-b81e-26af26f2b888 with identifier: BG13%20FKD to the API
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994727/600>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f7303a-a2f6-5f86-b81e-26af26f2b888/43f7303a-a2f6-5f86-b81e-26af26f2b888_expert_report_file_be1cdd4a-6c5a-4c13-8cad-418d456aa10f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BG13%20FKD-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '43f7303a-a2f6-5f86-b81e-26af26f2b888',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BG13 FKD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BG13%20FKD&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 57560,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f7303a-a2f6-5f86-b81e-26af26f2b888/43f7303a-a2f6-5f86-b81e-26af26f2b888_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42152,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994711/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f7303a-a2f6-5f86-b81e-26af26f2b888/43f7303a-a2f6-5f86-b81e-26af26f2b888_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40464,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994727/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f7303a-a2f6-5f86-b81e-26af26f2b888/43f7303a-a2f6-5f86-b81e-26af26f2b888_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38527,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994745/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f7303a-a2f6-5f86-b81e-26af26f2b888/43f7303a-a2f6-5f86-b81e-26af26f2b888_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38676,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994764/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f7303a-a2f6-5f86-b81e-26af26f2b888/43f7303a-a2f6-5f86-b81e-26af26f2b888_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39181,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994781/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f7303a-a2f6-5f86-b81e-26af26f2b888/43f7303a-a2f6-5f86-b81e-26af26f2b888_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38509,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994803/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f7303a-a2f6-5f86-b81e-26af26f2b888/43f7303a-a2f6-5f86-b81e-26af26f2b888_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77003,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994827/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f7303a-a2f6-5f86-b81e-26af26f2b888/43f7303a-a2f6-5f86-b81e-26af26f2b888_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60444,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994849/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f7303a-a2f6-5f86-b81e-26af26f2b888/43f7303a-a2f6-5f86-b81e-26af26f2b888_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73921,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994874/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f7303a-a2f6-5f86-b81e-26af26f2b888/43f7303a-a2f6-5f86-b81e-26af26f2b888_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70556,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13FKD/698994898/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.4 16V SXI Hatchback',
'transmission': 'manual',
'trim': '16V SXI',
'vin': 'W0L0SDL68D4215875',
'year': 2013}
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG13%2520FKD%27 HTTP/1.1" 200 None
2026-03-28 22:02:32 [bca.uk] INFO: Saving data for BG13%20FKD: {'created_time': 1774735352.68995, 'last_price_update_time': 1774735352.68996, 'auction_closing_time': 1774864800.0}
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BG13%2520FKD') HTTP/1.1" 204 0
2026-03-28 22:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110845/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ73EOT/42811363?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=Z275yW1rsbj3FapfEeIfN9OJqcCvXddViu6M84JP7AA%3D)
2026-03-28 22:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093876/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP15GZB/42811287?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=7tUa0hwrEujFHU3KRxrEE1EA%2FQ%2B2aDgCCCKK2Q5cFLc%3D)
2026-03-28 22:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093866/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VX52YYH/42811323?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=sBcdU%2Bi00fGyPAIkGghzLoIMWb9WJk%2B0Sty%2BOKRiKzA%3D)
2026-03-28 22:02:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110839/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110839>
2026-03-28 22:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126568/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT19CVS/42811387?sv=2020-08-04&st=2026-03-28T22%3A01%3A08Z&se=2026-03-28T22%3A26%3A08Z&sr=b&sp=r&sig=Xezo2YoS0t9x6abxzIwcxCNA1wXAbFztVA4zM%2F%2Bntk8%3D)
2026-03-28 22:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031575/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ68UWN/42811039?sv=2020-08-04&st=2026-03-28T22%3A01%3A10Z&se=2026-03-28T22%3A26%3A10Z&sr=b&sp=r&sig=1ZiFBHKVUwguyFOSNXk0RG8MN%2BDlXzRukHPnqyWqOFk%3D)
2026-03-28 22:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110869/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ70EHU/42811341?sv=2020-08-04&st=2026-03-28T22%3A01%3A12Z&se=2026-03-28T22%3A26%3A12Z&sr=b&sp=r&sig=jIMEwQ1nhHjk3xUWtYxp4DaMU%2Fd7rUcdJRYrXhJEbps%3D)
2026-03-28 22:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RJ71WJK/42811152?sv=2020-08-04&st=2026-03-28T22%3A02%3A29Z&se=2026-03-28T22%3A27%3A29Z&sr=b&sp=r&sig=7Naoe6Q8stIqSw2XvQNIn8leLBwgQ9qeE6qRwPmkHyQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547279750>
2026-03-28 22:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b3f5c4-70ca-530a-a56a-701b7ee98ebe/d2b3f5c4-70ca-530a-a56a-701b7ee98ebe_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT19CVS%252F699126590%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126590/600 saved to cache
2026-03-28 22:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d2b3f5c4-70ca-530a-a56a-701b7ee98ebe
2026-03-28 22:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547254a90>
2026-03-28 22:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7f8a9fc-307f-5fd9-9f57-53be64230a5a/a7f8a9fc-307f-5fd9-9f57-53be64230a5a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO22KPT%252F699059958%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059958/600 saved to cache
2026-03-28 22:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7f8a9fc-307f-5fd9-9f57-53be64230a5a
2026-03-28 22:02:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7f8a9fc-307f-5fd9-9f57-53be64230a5a, skipping ID generation
2026-03-28 22:02:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7f8a9fc-307f-5fd9-9f57-53be64230a5a sending to next pipeline
2026-03-28 22:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a7f8a9fc-307f-5fd9-9f57-53be64230a5a, identifier: RO22%20KPT
2026-03-28 22:02:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547255990>
2026-03-28 22:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf35b337-845e-537f-a976-08188cca66f3/cf35b337-845e-537f-a976-08188cca66f3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ70EHU%252F699110886%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110886/600 saved to cache
2026-03-28 22:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf35b337-845e-537f-a976-08188cca66f3
2026-03-28 22:02:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471585d0>
2026-03-28 22:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283b6c92-cce2-544a-9b3b-da049a06ca33/283b6c92-cce2-544a-9b3b-da049a06ca33_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP15GZB%252F699093900%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093900/600 saved to cache
2026-03-28 22:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 283b6c92-cce2-544a-9b3b-da049a06ca33
2026-03-28 22:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a7f8a9fc-307f-5fd9-9f57-53be64230a5a with identifier: RO22%20KPT
2026-03-28 22:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a7f8a9fc-307f-5fd9-9f57-53be64230a5a with identifier: RO22%20KPT
2026-03-28 22:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a7f8a9fc-307f-5fd9-9f57-53be64230a5a with identifier: RO22%20KPT to the API
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059958/600>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f8a9fc-307f-5fd9-9f57-53be64230a5a/a7f8a9fc-307f-5fd9-9f57-53be64230a5a_expert_report_file_7d59f5e9-e682-4ca0-8448-667be9f6ce79.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RO22%20KPT-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a7f8a9fc-307f-5fd9-9f57-53be64230a5a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RO22 KPT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RO22%20KPT&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'CITROEN',
'model': 'C3',
'odometer': 29444,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f8a9fc-307f-5fd9-9f57-53be64230a5a/a7f8a9fc-307f-5fd9-9f57-53be64230a5a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47153,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059939/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f8a9fc-307f-5fd9-9f57-53be64230a5a/a7f8a9fc-307f-5fd9-9f57-53be64230a5a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46880,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059947/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f8a9fc-307f-5fd9-9f57-53be64230a5a/a7f8a9fc-307f-5fd9-9f57-53be64230a5a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44103,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059958/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f8a9fc-307f-5fd9-9f57-53be64230a5a/a7f8a9fc-307f-5fd9-9f57-53be64230a5a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42137,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059966/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f8a9fc-307f-5fd9-9f57-53be64230a5a/a7f8a9fc-307f-5fd9-9f57-53be64230a5a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39480,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059978/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f8a9fc-307f-5fd9-9f57-53be64230a5a/a7f8a9fc-307f-5fd9-9f57-53be64230a5a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39652,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699059987/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f8a9fc-307f-5fd9-9f57-53be64230a5a/a7f8a9fc-307f-5fd9-9f57-53be64230a5a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98132,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699060052/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f8a9fc-307f-5fd9-9f57-53be64230a5a/a7f8a9fc-307f-5fd9-9f57-53be64230a5a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79325,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699060070/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f8a9fc-307f-5fd9-9f57-53be64230a5a/a7f8a9fc-307f-5fd9-9f57-53be64230a5a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94467,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699060085/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7f8a9fc-307f-5fd9-9f57-53be64230a5a/a7f8a9fc-307f-5fd9-9f57-53be64230a5a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74685,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO22KPT/699060108/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'CITROEN C3 1.2 P/T 83 C-SERIES Hatchback',
'transmission': 'manual',
'trim': 'P/T 83 C-SERIES',
'vin': 'VF7SXHMRVNT542533',
'year': 2022}
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO22%2520KPT%27 HTTP/1.1" 200 None
2026-03-28 22:02:33 [bca.uk] INFO: Saving data for RO22%20KPT: {'created_time': 1774735353.359843, 'last_price_update_time': 1774735353.359854, 'auction_closing_time': 1774951200.0}
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RO22%2520KPT') HTTP/1.1" 204 0
2026-03-28 22:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994240/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN63OLH/42810834?sv=2020-08-04&st=2026-03-28T22%3A01%3A09Z&se=2026-03-28T22%3A26%3A09Z&sr=b&sp=r&sig=NMpNDT8TSdoKfgfMWv1wobNIeXn3SgscjQpSI5aPQXk%3D)
2026-03-28 22:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093849/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VX52YYH/42811323?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=sBcdU%2Bi00fGyPAIkGghzLoIMWb9WJk%2B0Sty%2BOKRiKzA%3D)
2026-03-28 22:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110850/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110850>
2026-03-28 22:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126547/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126547>
2026-03-28 22:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093861/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093861>
2026-03-28 22:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031527/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031527>
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b58f10>
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2f45d0-e564-5ded-8cb4-0288835f055c/ab2f45d0-e564-5ded-8cb4-0288835f055c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ73EOT%252F699110845%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110845/600 saved to cache
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab2f45d0-e564-5ded-8cb4-0288835f055c
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474ed890>
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283b6c92-cce2-544a-9b3b-da049a06ca33/283b6c92-cce2-544a-9b3b-da049a06ca33_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP15GZB%252F699093876%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093876/600 saved to cache
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 283b6c92-cce2-544a-9b3b-da049a06ca33
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55456e490>
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d9ff90-12a7-5f3d-86ac-c640dc2351b5/08d9ff90-12a7-5f3d-86ac-c640dc2351b5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVX52YYH%252F699093866%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093866/600 saved to cache
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08d9ff90-12a7-5f3d-86ac-c640dc2351b5
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472aed10>
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b3f5c4-70ca-530a-a56a-701b7ee98ebe/d2b3f5c4-70ca-530a-a56a-701b7ee98ebe_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT19CVS%252F699126568%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126568/600 saved to cache
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d2b3f5c4-70ca-530a-a56a-701b7ee98ebe
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477af510>
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f05d113-747f-52ed-a1ad-9799bad35377/7f05d113-747f-52ed-a1ad-9799bad35377_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ68UWN%252F699031575%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031575/600 saved to cache
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f05d113-747f-52ed-a1ad-9799bad35377
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473b8e90>
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf35b337-845e-537f-a976-08188cca66f3/cf35b337-845e-537f-a976-08188cca66f3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ70EHU%252F699110869%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110869/600 saved to cache
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf35b337-845e-537f-a976-08188cca66f3
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474edd10>
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e8e181-dc16-5b78-833d-28f874a8334d/45e8e181-dc16-5b78-833d-28f874a8334d_expert_report_file_5353a6af-1e6e-4de1-b386-285eb17d8ca9.pdf HTTP/1.1" 201 0
2026-03-28 22:02:33 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 45e8e181-dc16-5b78-833d-28f874a8334d
2026-03-28 22:02:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45e8e181-dc16-5b78-833d-28f874a8334d, skipping ID generation
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 45e8e181-dc16-5b78-833d-28f874a8334d
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRJ71WJK-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RJ71WJK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031550/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ68UWN/42811039?sv=2020-08-04&st=2026-03-28T22%3A01%3A10Z&se=2026-03-28T22%3A26%3A10Z&sr=b&sp=r&sig=1ZiFBHKVUwguyFOSNXk0RG8MN%2BDlXzRukHPnqyWqOFk%3D)
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058648%27 HTTP/1.1" 200 None
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058648 not downloaded yet
2026-03-28 22:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX18RKK/42810832?sv=2020-08-04&st=2026-03-28T22%3A02%3A31Z&se=2026-03-28T22%3A27%3A31Z&sr=b&sp=r&sig=TzeWjarkyBoi7CjFvdJ7u8x%2B6uRd4ug%2FK1JF1aSzusY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058656%27 HTTP/1.1" 200 None
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058656 not downloaded yet
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b62210>
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39f18d5c-38c9-5802-bc90-29e03976b40f/39f18d5c-38c9-5802-bc90-29e03976b40f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN63OLH%252F698994240%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994240/600 saved to cache
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 39f18d5c-38c9-5802-bc90-29e03976b40f
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554936a90>
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d9ff90-12a7-5f3d-86ac-c640dc2351b5/08d9ff90-12a7-5f3d-86ac-c640dc2351b5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVX52YYH%252F699093849%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093849/600 saved to cache
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08d9ff90-12a7-5f3d-86ac-c640dc2351b5
2026-03-28 22:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110839/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ73EOT/42811363?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=Z275yW1rsbj3FapfEeIfN9OJqcCvXddViu6M84JP7AA%3D)
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058662%27 HTTP/1.1" 200 None
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058662 not downloaded yet
2026-03-28 22:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093838/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093838>
2026-03-28 22:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994217/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994217>
2026-03-28 22:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074227/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074227>
2026-03-28 22:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD70LYC/42810765?sv=2020-08-04&st=2026-03-28T22%3A02%3A33Z&se=2026-03-28T22%3A27%3A33Z&sr=b&sp=r&sig=p7zo9yHW7El16wY6YXfUe9uNKREDCLATYag5372BsKw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FD70%20LYC-GB>
2026-03-28 22:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126571/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126571>
2026-03-28 22:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110825/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110825>
2026-03-28 22:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093851/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093851>
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058672%27 HTTP/1.1" 200 None
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058672 not downloaded yet
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058682%27 HTTP/1.1" 200 None
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058682 not downloaded yet
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473b7510>
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f05d113-747f-52ed-a1ad-9799bad35377/7f05d113-747f-52ed-a1ad-9799bad35377_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ68UWN%252F699031550%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031550/600 saved to cache
2026-03-28 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f05d113-747f-52ed-a1ad-9799bad35377
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473c9510>
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ec4e6f-59e8-58bb-b6e7-08502c0644b2/a4ec4e6f-59e8-58bb-b6e7-08502c0644b2_expert_report_file_f669e661-a597-4dd1-9794-6f590d1d260d.pdf HTTP/1.1" 201 0
2026-03-28 22:02:34 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a4ec4e6f-59e8-58bb-b6e7-08502c0644b2
2026-03-28 22:02:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a4ec4e6f-59e8-58bb-b6e7-08502c0644b2, skipping ID generation
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a4ec4e6f-59e8-58bb-b6e7-08502c0644b2
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWX18RKK-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WX18RKK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093861/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP15GZB/42811287?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=7tUa0hwrEujFHU3KRxrEE1EA%2FQ%2B2aDgCCCKK2Q5cFLc%3D)
2026-03-28 22:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110837/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110837>
2026-03-28 22:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126531/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126531>
2026-03-28 22:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058642/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RJ71WJK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031495/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031495>
2026-03-28 22:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031527/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ68UWN/42811039?sv=2020-08-04&st=2026-03-28T22%3A01%3A10Z&se=2026-03-28T22%3A26%3A10Z&sr=b&sp=r&sig=1ZiFBHKVUwguyFOSNXk0RG8MN%2BDlXzRukHPnqyWqOFk%3D)
2026-03-28 22:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110850/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ70EHU/42811341?sv=2020-08-04&st=2026-03-28T22%3A01%3A12Z&se=2026-03-28T22%3A26%3A12Z&sr=b&sp=r&sig=jIMEwQ1nhHjk3xUWtYxp4DaMU%2Fd7rUcdJRYrXhJEbps%3D)
2026-03-28 22:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126547/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT19CVS/42811387?sv=2020-08-04&st=2026-03-28T22%3A01%3A08Z&se=2026-03-28T22%3A26%3A08Z&sr=b&sp=r&sig=Xezo2YoS0t9x6abxzIwcxCNA1wXAbFztVA4zM%2F%2Bntk8%3D)
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058714%27 HTTP/1.1" 200 None
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058714 not downloaded yet
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994316%27 HTTP/1.1" 200 None
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994316 not downloaded yet
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058737%27 HTTP/1.1" 200 None
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058737 not downloaded yet
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994328%27 HTTP/1.1" 200 None
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994328 not downloaded yet
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543de3d0>
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2f45d0-e564-5ded-8cb4-0288835f055c/ab2f45d0-e564-5ded-8cb4-0288835f055c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ73EOT%252F699110839%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110839/600 saved to cache
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab2f45d0-e564-5ded-8cb4-0288835f055c
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058773%27 HTTP/1.1" 200 None
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058773 not downloaded yet
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994351%27 HTTP/1.1" 200 None
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994351 not downloaded yet
2026-03-28 22:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093838/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VX52YYH/42811323?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=sBcdU%2Bi00fGyPAIkGghzLoIMWb9WJk%2B0Sty%2BOKRiKzA%3D)
2026-03-28 22:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110825/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ73EOT/42811363?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=Z275yW1rsbj3FapfEeIfN9OJqcCvXddViu6M84JP7AA%3D)
2026-03-28 22:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093851/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP15GZB/42811287?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=7tUa0hwrEujFHU3KRxrEE1EA%2FQ%2B2aDgCCCKK2Q5cFLc%3D)
2026-03-28 22:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994217/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN63OLH/42810834?sv=2020-08-04&st=2026-03-28T22%3A01%3A09Z&se=2026-03-28T22%3A26%3A09Z&sr=b&sp=r&sig=NMpNDT8TSdoKfgfMWv1wobNIeXn3SgscjQpSI5aPQXk%3D)
2026-03-28 22:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058656/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058656>
2026-03-28 22:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074227/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV03RSZ/42811210?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=XPdxTou37%2FSrb2139PEgleDE82DPAqY3LhSbwh%2FScoQ%3D)
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699058803%27 HTTP/1.1" 200 None
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058803 not downloaded yet
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994359%27 HTTP/1.1" 200 None
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994359 not downloaded yet
2026-03-28 22:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126571/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT70TDO/42811400?sv=2020-08-04&st=2026-03-28T22%3A01%3A09Z&se=2026-03-28T22%3A26%3A09Z&sr=b&sp=r&sig=sz4G2m%2Bww1tbH3aSNvJ2DJLyecaaL3NNq%2FlejxEYTpI%3D)
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994382%27 HTTP/1.1" 200 None
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994382 not downloaded yet
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547ed490>
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283b6c92-cce2-544a-9b3b-da049a06ca33/283b6c92-cce2-544a-9b3b-da049a06ca33_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP15GZB%252F699093861%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093861/600 saved to cache
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 283b6c92-cce2-544a-9b3b-da049a06ca33
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474f7c90>
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f05d113-747f-52ed-a1ad-9799bad35377/7f05d113-747f-52ed-a1ad-9799bad35377_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ68UWN%252F699031527%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031527/600 saved to cache
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f05d113-747f-52ed-a1ad-9799bad35377
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55495ea50>
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf35b337-845e-537f-a976-08188cca66f3/cf35b337-845e-537f-a976-08188cca66f3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ70EHU%252F699110850%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110850/600 saved to cache
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf35b337-845e-537f-a976-08188cca66f3
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547278cd0>
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b3f5c4-70ca-530a-a56a-701b7ee98ebe/d2b3f5c4-70ca-530a-a56a-701b7ee98ebe_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT19CVS%252F699126547%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126547/600 saved to cache
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2b3f5c4-70ca-530a-a56a-701b7ee98ebe
2026-03-28 22:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058642/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RJ71WJK/42811152?sv=2020-08-04&st=2026-03-28T22%3A02%3A29Z&se=2026-03-28T22%3A27%3A29Z&sr=b&sp=r&sig=7Naoe6Q8stIqSw2XvQNIn8leLBwgQ9qeE6qRwPmkHyQ%3D)
2026-03-28 22:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126531/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT19CVS/42811387?sv=2020-08-04&st=2026-03-28T22%3A01%3A08Z&se=2026-03-28T22%3A26%3A08Z&sr=b&sp=r&sig=Xezo2YoS0t9x6abxzIwcxCNA1wXAbFztVA4zM%2F%2Bntk8%3D)
2026-03-28 22:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110837/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ70EHU/42811341?sv=2020-08-04&st=2026-03-28T22%3A01%3A12Z&se=2026-03-28T22%3A26%3A12Z&sr=b&sp=r&sig=jIMEwQ1nhHjk3xUWtYxp4DaMU%2Fd7rUcdJRYrXhJEbps%3D)
2026-03-28 22:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058682/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058682>
2026-03-28 22:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994306/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WX18RKK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994409%27 HTTP/1.1" 200 None
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994409 not downloaded yet
2026-03-28 22:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031495/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ68UWN/42811039?sv=2020-08-04&st=2026-03-28T22%3A01%3A10Z&se=2026-03-28T22%3A26%3A10Z&sr=b&sp=r&sig=1ZiFBHKVUwguyFOSNXk0RG8MN%2BDlXzRukHPnqyWqOFk%3D)
2026-03-28 22:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD70LYC/42810765?sv=2020-08-04&st=2026-03-28T22%3A02%3A33Z&se=2026-03-28T22%3A27%3A33Z&sr=b&sp=r&sig=p7zo9yHW7El16wY6YXfUe9uNKREDCLATYag5372BsKw%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994449%27 HTTP/1.1" 200 None
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994449 not downloaded yet
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55495e3d0>
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d9ff90-12a7-5f3d-86ac-c640dc2351b5/08d9ff90-12a7-5f3d-86ac-c640dc2351b5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVX52YYH%252F699093838%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093838/600 saved to cache
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08d9ff90-12a7-5f3d-86ac-c640dc2351b5
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5573dea90>
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2f45d0-e564-5ded-8cb4-0288835f055c/ab2f45d0-e564-5ded-8cb4-0288835f055c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ73EOT%252F699110825%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110825/600 saved to cache
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab2f45d0-e564-5ded-8cb4-0288835f055c
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554232990>
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283b6c92-cce2-544a-9b3b-da049a06ca33/283b6c92-cce2-544a-9b3b-da049a06ca33_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP15GZB%252F699093851%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093851/600 saved to cache
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 283b6c92-cce2-544a-9b3b-da049a06ca33
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554278c90>
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39f18d5c-38c9-5802-bc90-29e03976b40f/39f18d5c-38c9-5802-bc90-29e03976b40f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN63OLH%252F698994217%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994217/600 saved to cache
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 39f18d5c-38c9-5802-bc90-29e03976b40f
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54726a5d0>
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8076e5d-cb8b-5578-9e3b-020e67e6d8b5/d8076e5d-cb8b-5578-9e3b-020e67e6d8b5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV03RSZ%252F699074227%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074227/600 saved to cache
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d8076e5d-cb8b-5578-9e3b-020e67e6d8b5
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547774c90>
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d540cd8f-d715-5405-a8d5-11721b31b439/d540cd8f-d715-5405-a8d5-11721b31b439_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT70TDO%252F699126571%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126571/600 saved to cache
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d540cd8f-d715-5405-a8d5-11721b31b439
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994483%27 HTTP/1.1" 200 None
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994483 not downloaded yet
2026-03-28 22:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058672/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058672>
2026-03-28 22:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058656/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RJ71WJK/42811152?sv=2020-08-04&st=2026-03-28T22%3A02%3A29Z&se=2026-03-28T22%3A27%3A29Z&sr=b&sp=r&sig=7Naoe6Q8stIqSw2XvQNIn8leLBwgQ9qeE6qRwPmkHyQ%3D)
2026-03-28 22:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994328/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994328>
2026-03-28 22:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994316/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994316>
2026-03-28 22:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058737/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058737>
2026-03-28 22:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058714/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058714>
2026-03-28 22:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058662/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058662>
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994513%27 HTTP/1.1" 200 None
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994513 not downloaded yet
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542a5b90>
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e8e181-dc16-5b78-833d-28f874a8334d/45e8e181-dc16-5b78-833d-28f874a8334d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRJ71WJK%252F699058642%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058642/600 saved to cache
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45e8e181-dc16-5b78-833d-28f874a8334d
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542d8750>
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b3f5c4-70ca-530a-a56a-701b7ee98ebe/d2b3f5c4-70ca-530a-a56a-701b7ee98ebe_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT19CVS%252F699126531%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126531/600 saved to cache
2026-03-28 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2b3f5c4-70ca-530a-a56a-701b7ee98ebe
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471371d0>
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf35b337-845e-537f-a976-08188cca66f3/cf35b337-845e-537f-a976-08188cca66f3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ70EHU%252F699110837%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110837/600 saved to cache
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf35b337-845e-537f-a976-08188cca66f3
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54728d310>
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f05d113-747f-52ed-a1ad-9799bad35377/7f05d113-747f-52ed-a1ad-9799bad35377_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ68UWN%252F699031495%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031495/600 saved to cache
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f05d113-747f-52ed-a1ad-9799bad35377
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471342d0>
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5dbf164-beca-542e-a8d7-8ec419cfcb14/c5dbf164-beca-542e-a8d7-8ec419cfcb14_expert_report_file_5f5c6138-c6c1-4d9e-9790-732b8112194a.pdf HTTP/1.1" 201 0
2026-03-28 22:02:35 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c5dbf164-beca-542e-a8d7-8ec419cfcb14
2026-03-28 22:02:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5dbf164-beca-542e-a8d7-8ec419cfcb14, skipping ID generation
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5dbf164-beca-542e-a8d7-8ec419cfcb14
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFD70LYC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FD70LYC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994351/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994351>
2026-03-28 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994306/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX18RKK/42810832?sv=2020-08-04&st=2026-03-28T22%3A02%3A31Z&se=2026-03-28T22%3A27%3A31Z&sr=b&sp=r&sig=TzeWjarkyBoi7CjFvdJ7u8x%2B6uRd4ug%2FK1JF1aSzusY%3D)
2026-03-28 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058682/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RJ71WJK/42811152?sv=2020-08-04&st=2026-03-28T22%3A02%3A29Z&se=2026-03-28T22%3A27%3A29Z&sr=b&sp=r&sig=7Naoe6Q8stIqSw2XvQNIn8leLBwgQ9qeE6qRwPmkHyQ%3D)
2026-03-28 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058773/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058773>
2026-03-28 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994359/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994359>
2026-03-28 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058803/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058803>
2026-03-28 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994382/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994382>
2026-03-28 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058648/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058648>
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976033%27 HTTP/1.1" 200 None
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976033 not downloaded yet
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976039%27 HTTP/1.1" 200 None
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976039 not downloaded yet
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542d5510>
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e8e181-dc16-5b78-833d-28f874a8334d/45e8e181-dc16-5b78-833d-28f874a8334d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRJ71WJK%252F699058656%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058656/600 saved to cache
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 45e8e181-dc16-5b78-833d-28f874a8334d
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976051%27 HTTP/1.1" 200 None
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976051 not downloaded yet
2026-03-28 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994409/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994409>
2026-03-28 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994449/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994449>
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976064%27 HTTP/1.1" 200 None
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976064 not downloaded yet
2026-03-28 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058672/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RJ71WJK/42811152?sv=2020-08-04&st=2026-03-28T22%3A02%3A29Z&se=2026-03-28T22%3A27%3A29Z&sr=b&sp=r&sig=7Naoe6Q8stIqSw2XvQNIn8leLBwgQ9qeE6qRwPmkHyQ%3D)
2026-03-28 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058662/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RJ71WJK/42811152?sv=2020-08-04&st=2026-03-28T22%3A02%3A29Z&se=2026-03-28T22%3A27%3A29Z&sr=b&sp=r&sig=7Naoe6Q8stIqSw2XvQNIn8leLBwgQ9qeE6qRwPmkHyQ%3D)
2026-03-28 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994328/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX18RKK/42810832?sv=2020-08-04&st=2026-03-28T22%3A02%3A31Z&se=2026-03-28T22%3A27%3A31Z&sr=b&sp=r&sig=TzeWjarkyBoi7CjFvdJ7u8x%2B6uRd4ug%2FK1JF1aSzusY%3D)
2026-03-28 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994316/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX18RKK/42810832?sv=2020-08-04&st=2026-03-28T22%3A02%3A31Z&se=2026-03-28T22%3A27%3A31Z&sr=b&sp=r&sig=TzeWjarkyBoi7CjFvdJ7u8x%2B6uRd4ug%2FK1JF1aSzusY%3D)
2026-03-28 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058714/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RJ71WJK/42811152?sv=2020-08-04&st=2026-03-28T22%3A02%3A29Z&se=2026-03-28T22%3A27%3A29Z&sr=b&sp=r&sig=7Naoe6Q8stIqSw2XvQNIn8leLBwgQ9qeE6qRwPmkHyQ%3D)
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976081%27 HTTP/1.1" 200 None
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976081 not downloaded yet
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fbc0d0>
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ec4e6f-59e8-58bb-b6e7-08502c0644b2/a4ec4e6f-59e8-58bb-b6e7-08502c0644b2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX18RKK%252F698994306%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994306/600 saved to cache
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a4ec4e6f-59e8-58bb-b6e7-08502c0644b2
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54748d9d0>
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e8e181-dc16-5b78-833d-28f874a8334d/45e8e181-dc16-5b78-833d-28f874a8334d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRJ71WJK%252F699058682%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058682/600 saved to cache
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 45e8e181-dc16-5b78-833d-28f874a8334d
2026-03-28 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058737/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RJ71WJK/42811152?sv=2020-08-04&st=2026-03-28T22%3A02%3A29Z&se=2026-03-28T22%3A27%3A29Z&sr=b&sp=r&sig=7Naoe6Q8stIqSw2XvQNIn8leLBwgQ9qeE6qRwPmkHyQ%3D)
2026-03-28 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994382/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX18RKK/42810832?sv=2020-08-04&st=2026-03-28T22%3A02%3A31Z&se=2026-03-28T22%3A27%3A31Z&sr=b&sp=r&sig=TzeWjarkyBoi7CjFvdJ7u8x%2B6uRd4ug%2FK1JF1aSzusY%3D)
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976119%27 HTTP/1.1" 200 None
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976119 not downloaded yet
2026-03-28 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058648/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RJ71WJK/42811152?sv=2020-08-04&st=2026-03-28T22%3A02%3A29Z&se=2026-03-28T22%3A27%3A29Z&sr=b&sp=r&sig=7Naoe6Q8stIqSw2XvQNIn8leLBwgQ9qeE6qRwPmkHyQ%3D)
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976146%27 HTTP/1.1" 200 None
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976146 not downloaded yet
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477637d0>
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e8e181-dc16-5b78-833d-28f874a8334d/45e8e181-dc16-5b78-833d-28f874a8334d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRJ71WJK%252F699058672%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058672/600 saved to cache
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 45e8e181-dc16-5b78-833d-28f874a8334d
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542818d0>
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e8e181-dc16-5b78-833d-28f874a8334d/45e8e181-dc16-5b78-833d-28f874a8334d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRJ71WJK%252F699058662%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058662/600 saved to cache
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 45e8e181-dc16-5b78-833d-28f874a8334d
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54747bd90>
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ec4e6f-59e8-58bb-b6e7-08502c0644b2/a4ec4e6f-59e8-58bb-b6e7-08502c0644b2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX18RKK%252F698994328%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994328/600 saved to cache
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a4ec4e6f-59e8-58bb-b6e7-08502c0644b2
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542eb590>
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ec4e6f-59e8-58bb-b6e7-08502c0644b2/a4ec4e6f-59e8-58bb-b6e7-08502c0644b2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX18RKK%252F698994316%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994316/600 saved to cache
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a4ec4e6f-59e8-58bb-b6e7-08502c0644b2
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554282d10>
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e8e181-dc16-5b78-833d-28f874a8334d/45e8e181-dc16-5b78-833d-28f874a8334d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRJ71WJK%252F699058714%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058714/600 saved to cache
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 45e8e181-dc16-5b78-833d-28f874a8334d
2026-03-28 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994351/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX18RKK/42810832?sv=2020-08-04&st=2026-03-28T22%3A02%3A31Z&se=2026-03-28T22%3A27%3A31Z&sr=b&sp=r&sig=TzeWjarkyBoi7CjFvdJ7u8x%2B6uRd4ug%2FK1JF1aSzusY%3D)
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976178%27 HTTP/1.1" 200 None
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976178 not downloaded yet
2026-03-28 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976023/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FD70LYC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994513/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994513>
2026-03-28 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994359/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX18RKK/42810832?sv=2020-08-04&st=2026-03-28T22%3A02%3A31Z&se=2026-03-28T22%3A27%3A31Z&sr=b&sp=r&sig=TzeWjarkyBoi7CjFvdJ7u8x%2B6uRd4ug%2FK1JF1aSzusY%3D)
2026-03-28 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058773/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RJ71WJK/42811152?sv=2020-08-04&st=2026-03-28T22%3A02%3A29Z&se=2026-03-28T22%3A27%3A29Z&sr=b&sp=r&sig=7Naoe6Q8stIqSw2XvQNIn8leLBwgQ9qeE6qRwPmkHyQ%3D)
2026-03-28 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058803/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RJ71WJK/42811152?sv=2020-08-04&st=2026-03-28T22%3A02%3A29Z&se=2026-03-28T22%3A27%3A29Z&sr=b&sp=r&sig=7Naoe6Q8stIqSw2XvQNIn8leLBwgQ9qeE6qRwPmkHyQ%3D)
2026-03-28 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994449/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX18RKK/42810832?sv=2020-08-04&st=2026-03-28T22%3A02%3A31Z&se=2026-03-28T22%3A27%3A31Z&sr=b&sp=r&sig=TzeWjarkyBoi7CjFvdJ7u8x%2B6uRd4ug%2FK1JF1aSzusY%3D)
2026-03-28 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994409/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX18RKK/42810832?sv=2020-08-04&st=2026-03-28T22%3A02%3A31Z&se=2026-03-28T22%3A27%3A31Z&sr=b&sp=r&sig=TzeWjarkyBoi7CjFvdJ7u8x%2B6uRd4ug%2FK1JF1aSzusY%3D)
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976207%27 HTTP/1.1" 200 None
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976207 not downloaded yet
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554ab9690>
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e8e181-dc16-5b78-833d-28f874a8334d/45e8e181-dc16-5b78-833d-28f874a8334d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRJ71WJK%252F699058737%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058737/600 saved to cache
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 45e8e181-dc16-5b78-833d-28f874a8334d
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554abb9d0>
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ec4e6f-59e8-58bb-b6e7-08502c0644b2/a4ec4e6f-59e8-58bb-b6e7-08502c0644b2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX18RKK%252F698994382%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994382/600 saved to cache
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a4ec4e6f-59e8-58bb-b6e7-08502c0644b2
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547da350>
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e8e181-dc16-5b78-833d-28f874a8334d/45e8e181-dc16-5b78-833d-28f874a8334d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRJ71WJK%252F699058648%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058648/600 saved to cache
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 45e8e181-dc16-5b78-833d-28f874a8334d
2026-03-28 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976051/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976051>
2026-03-28 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994483/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994483>
2026-03-28 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976033/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976033>
2026-03-28 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976039/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976039>
2026-03-28 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976081/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976081>
2026-03-28 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976064/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976064>
2026-03-28 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994196/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994196>
2026-03-28 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126555/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126555>
2026-03-28 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074220/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074220>
2026-03-28 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN12FKU/42809435?sv=2020-08-04&st=2026-03-28T22%3A02%3A35Z&se=2026-03-28T22%3A27%3A35Z&sr=b&sp=r&sig=KURQ7%2BDcQieniADy6RBY8RB62E6DkA7BIBHi9pIH93M%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WN12%20FKU-GB>
2026-03-28 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081138/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081138>
2026-03-28 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976146/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976146>
2026-03-28 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976178/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976178>
2026-03-28 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976119/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976119>
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554ae1450>
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ec4e6f-59e8-58bb-b6e7-08502c0644b2/a4ec4e6f-59e8-58bb-b6e7-08502c0644b2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX18RKK%252F698994351%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994351/600 saved to cache
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a4ec4e6f-59e8-58bb-b6e7-08502c0644b2
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542e3490>
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ec4e6f-59e8-58bb-b6e7-08502c0644b2/a4ec4e6f-59e8-58bb-b6e7-08502c0644b2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX18RKK%252F698994359%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994359/600 saved to cache
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a4ec4e6f-59e8-58bb-b6e7-08502c0644b2
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473b4e50>
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e8e181-dc16-5b78-833d-28f874a8334d/45e8e181-dc16-5b78-833d-28f874a8334d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRJ71WJK%252F699058773%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058773/600 saved to cache
2026-03-28 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 45e8e181-dc16-5b78-833d-28f874a8334d
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54778d610>
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e8e181-dc16-5b78-833d-28f874a8334d/45e8e181-dc16-5b78-833d-28f874a8334d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRJ71WJK%252F699058803%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058803/600 saved to cache
2026-03-28 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 45e8e181-dc16-5b78-833d-28f874a8334d
2026-03-28 22:02:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45e8e181-dc16-5b78-833d-28f874a8334d, skipping ID generation
2026-03-28 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45e8e181-dc16-5b78-833d-28f874a8334d sending to next pipeline
2026-03-28 22:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 45e8e181-dc16-5b78-833d-28f874a8334d, identifier: RJ71%20WJK
2026-03-28 22:02:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542ea510>
2026-03-28 22:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ec4e6f-59e8-58bb-b6e7-08502c0644b2/a4ec4e6f-59e8-58bb-b6e7-08502c0644b2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX18RKK%252F698994449%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994449/600 saved to cache
2026-03-28 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a4ec4e6f-59e8-58bb-b6e7-08502c0644b2
2026-03-28 22:02:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542a48d0>
2026-03-28 22:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ec4e6f-59e8-58bb-b6e7-08502c0644b2/a4ec4e6f-59e8-58bb-b6e7-08502c0644b2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX18RKK%252F698994409%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994409/600 saved to cache
2026-03-28 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a4ec4e6f-59e8-58bb-b6e7-08502c0644b2
2026-03-28 22:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994513/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX18RKK/42810832?sv=2020-08-04&st=2026-03-28T22%3A02%3A31Z&se=2026-03-28T22%3A27%3A31Z&sr=b&sp=r&sig=TzeWjarkyBoi7CjFvdJ7u8x%2B6uRd4ug%2FK1JF1aSzusY%3D)
2026-03-28 22:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976023/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD70LYC/42810765?sv=2020-08-04&st=2026-03-28T22%3A02%3A33Z&se=2026-03-28T22%3A27%3A33Z&sr=b&sp=r&sig=p7zo9yHW7El16wY6YXfUe9uNKREDCLATYag5372BsKw%3D)
2026-03-28 22:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 45e8e181-dc16-5b78-833d-28f874a8334d with identifier: RJ71%20WJK
2026-03-28 22:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 45e8e181-dc16-5b78-833d-28f874a8334d with identifier: RJ71%20WJK
2026-03-28 22:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 45e8e181-dc16-5b78-833d-28f874a8334d with identifier: RJ71%20WJK to the API
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058803/600>
{'auction_title': '',
'c_o_2_emission_value': 155,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e8e181-dc16-5b78-833d-28f874a8334d/45e8e181-dc16-5b78-833d-28f874a8334d_expert_report_file_5353a6af-1e6e-4de1-b386-285eb17d8ca9.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RJ71%20WJK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '45e8e181-dc16-5b78-833d-28f874a8334d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RJ71 WJK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RJ71%20WJK&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'ABARTH',
'model': '595',
'odometer': 64598,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e8e181-dc16-5b78-833d-28f874a8334d/45e8e181-dc16-5b78-833d-28f874a8334d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48345,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058642/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e8e181-dc16-5b78-833d-28f874a8334d/45e8e181-dc16-5b78-833d-28f874a8334d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48263,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058648/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e8e181-dc16-5b78-833d-28f874a8334d/45e8e181-dc16-5b78-833d-28f874a8334d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46107,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058656/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e8e181-dc16-5b78-833d-28f874a8334d/45e8e181-dc16-5b78-833d-28f874a8334d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46920,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058662/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e8e181-dc16-5b78-833d-28f874a8334d/45e8e181-dc16-5b78-833d-28f874a8334d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39534,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058672/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e8e181-dc16-5b78-833d-28f874a8334d/45e8e181-dc16-5b78-833d-28f874a8334d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39298,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058682/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e8e181-dc16-5b78-833d-28f874a8334d/45e8e181-dc16-5b78-833d-28f874a8334d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102500,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058714/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e8e181-dc16-5b78-833d-28f874a8334d/45e8e181-dc16-5b78-833d-28f874a8334d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73146,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058737/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e8e181-dc16-5b78-833d-28f874a8334d/45e8e181-dc16-5b78-833d-28f874a8334d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93968,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058773/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e8e181-dc16-5b78-833d-28f874a8334d/45e8e181-dc16-5b78-833d-28f874a8334d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79747,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RJ71WJK/699058803/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'ABARTH 595 1.4 T-JET 165 F595 Hatchback',
'transmission': 'automatic',
'trim': 'T-JET 165 F595',
'vin': 'ZFABF11H0NJF87300',
'year': 2021}
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ71%2520WJK%27 HTTP/1.1" 200 None
2026-03-28 22:02:36 [bca.uk] INFO: Saving data for RJ71%20WJK: {'created_time': 1774735356.838422, 'last_price_update_time': 1774735356.838432, 'auction_closing_time': 1774951200.0}
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RJ71%2520WJK') HTTP/1.1" 204 0
2026-03-28 22:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976039/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD70LYC/42810765?sv=2020-08-04&st=2026-03-28T22%3A02%3A33Z&se=2026-03-28T22%3A27%3A33Z&sr=b&sp=r&sig=p7zo9yHW7El16wY6YXfUe9uNKREDCLATYag5372BsKw%3D)
2026-03-28 22:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976033/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD70LYC/42810765?sv=2020-08-04&st=2026-03-28T22%3A02%3A33Z&se=2026-03-28T22%3A27%3A33Z&sr=b&sp=r&sig=p7zo9yHW7El16wY6YXfUe9uNKREDCLATYag5372BsKw%3D)
2026-03-28 22:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976081/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD70LYC/42810765?sv=2020-08-04&st=2026-03-28T22%3A02%3A33Z&se=2026-03-28T22%3A27%3A33Z&sr=b&sp=r&sig=p7zo9yHW7El16wY6YXfUe9uNKREDCLATYag5372BsKw%3D)
2026-03-28 22:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976064/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD70LYC/42810765?sv=2020-08-04&st=2026-03-28T22%3A02%3A33Z&se=2026-03-28T22%3A27%3A33Z&sr=b&sp=r&sig=p7zo9yHW7El16wY6YXfUe9uNKREDCLATYag5372BsKw%3D)
2026-03-28 22:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126555/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT70TDO/42811400?sv=2020-08-04&st=2026-03-28T22%3A01%3A09Z&se=2026-03-28T22%3A26%3A09Z&sr=b&sp=r&sig=sz4G2m%2Bww1tbH3aSNvJ2DJLyecaaL3NNq%2FlejxEYTpI%3D)
2026-03-28 22:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994196/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN63OLH/42810834?sv=2020-08-04&st=2026-03-28T22%3A01%3A09Z&se=2026-03-28T22%3A26%3A09Z&sr=b&sp=r&sig=NMpNDT8TSdoKfgfMWv1wobNIeXn3SgscjQpSI5aPQXk%3D)
2026-03-28 22:02:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542ffed0>
2026-03-28 22:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ec4e6f-59e8-58bb-b6e7-08502c0644b2/a4ec4e6f-59e8-58bb-b6e7-08502c0644b2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX18RKK%252F698994513%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994513/600 saved to cache
2026-03-28 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a4ec4e6f-59e8-58bb-b6e7-08502c0644b2
2026-03-28 22:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557618a10>
2026-03-28 22:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5dbf164-beca-542e-a8d7-8ec419cfcb14/c5dbf164-beca-542e-a8d7-8ec419cfcb14_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD70LYC%252F698976023%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976023/600 saved to cache
2026-03-28 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5dbf164-beca-542e-a8d7-8ec419cfcb14
2026-03-28 22:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081138/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX68XHM/42809660?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=LehtVWZLTGCUq%2FHVaWaxVcM6eZjoYBHWl7BsrTTno54%3D)
2026-03-28 22:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976178/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD70LYC/42810765?sv=2020-08-04&st=2026-03-28T22%3A02%3A33Z&se=2026-03-28T22%3A27%3A33Z&sr=b&sp=r&sig=p7zo9yHW7El16wY6YXfUe9uNKREDCLATYag5372BsKw%3D)
2026-03-28 22:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976051/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD70LYC/42810765?sv=2020-08-04&st=2026-03-28T22%3A02%3A33Z&se=2026-03-28T22%3A27%3A33Z&sr=b&sp=r&sig=p7zo9yHW7El16wY6YXfUe9uNKREDCLATYag5372BsKw%3D)
2026-03-28 22:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fd5ed0>
2026-03-28 22:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5dbf164-beca-542e-a8d7-8ec419cfcb14/c5dbf164-beca-542e-a8d7-8ec419cfcb14_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD70LYC%252F698976039%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976039/600 saved to cache
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5dbf164-beca-542e-a8d7-8ec419cfcb14
2026-03-28 22:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976119/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD70LYC/42810765?sv=2020-08-04&st=2026-03-28T22%3A02%3A33Z&se=2026-03-28T22%3A27%3A33Z&sr=b&sp=r&sig=p7zo9yHW7El16wY6YXfUe9uNKREDCLATYag5372BsKw%3D)
2026-03-28 22:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994483/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WX18RKK/42810832?sv=2020-08-04&st=2026-03-28T22%3A02%3A31Z&se=2026-03-28T22%3A27%3A31Z&sr=b&sp=r&sig=TzeWjarkyBoi7CjFvdJ7u8x%2B6uRd4ug%2FK1JF1aSzusY%3D)
2026-03-28 22:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976146/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD70LYC/42810765?sv=2020-08-04&st=2026-03-28T22%3A02%3A33Z&se=2026-03-28T22%3A27%3A33Z&sr=b&sp=r&sig=p7zo9yHW7El16wY6YXfUe9uNKREDCLATYag5372BsKw%3D)
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55491c310>
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5dbf164-beca-542e-a8d7-8ec419cfcb14/c5dbf164-beca-542e-a8d7-8ec419cfcb14_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD70LYC%252F698976033%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976033/600 saved to cache
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5dbf164-beca-542e-a8d7-8ec419cfcb14
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477ef4d0>
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5dbf164-beca-542e-a8d7-8ec419cfcb14/c5dbf164-beca-542e-a8d7-8ec419cfcb14_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD70LYC%252F698976081%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976081/600 saved to cache
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5dbf164-beca-542e-a8d7-8ec419cfcb14
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473d1b50>
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5dbf164-beca-542e-a8d7-8ec419cfcb14/c5dbf164-beca-542e-a8d7-8ec419cfcb14_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD70LYC%252F698976064%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976064/600 saved to cache
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5dbf164-beca-542e-a8d7-8ec419cfcb14
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542494d0>
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d540cd8f-d715-5405-a8d5-11721b31b439/d540cd8f-d715-5405-a8d5-11721b31b439_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT70TDO%252F699126555%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126555/600 saved to cache
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d540cd8f-d715-5405-a8d5-11721b31b439
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542e03d0>
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39f18d5c-38c9-5802-bc90-29e03976b40f/39f18d5c-38c9-5802-bc90-29e03976b40f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN63OLH%252F698994196%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994196/600 saved to cache
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 39f18d5c-38c9-5802-bc90-29e03976b40f
2026-03-28 22:02:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074212/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074212>
2026-03-28 22:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074220/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV03RSZ/42811210?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=XPdxTou37%2FSrb2139PEgleDE82DPAqY3LhSbwh%2FScoQ%3D)
2026-03-28 22:02:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976207/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976207>
2026-03-28 22:02:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FT61VUR/42811133?sv=2020-08-04&st=2026-03-28T22%3A02%3A36Z&se=2026-03-28T22%3A27%3A36Z&sr=b&sp=r&sig=9EPcV3ym6qVnTW2kEyVvxbtoQKt2ehb%2B25xAT3tRiJ0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FT61%20VUR-GB>
2026-03-28 22:02:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081101/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081101>
2026-03-28 22:02:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO61OVX/42811349?sv=2020-08-04&st=2026-03-28T22%3A02%3A37Z&se=2026-03-28T22%3A27%3A37Z&sr=b&sp=r&sig=nKiFh%2BghLTUQtSr4%2F%2FN4LMcEMrRkLUwJz3jI%2BH%2BqAp4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EO61%20OVX-GB>
2026-03-28 22:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN12FKU/42809435?sv=2020-08-04&st=2026-03-28T22%3A02%3A35Z&se=2026-03-28T22%3A27%3A35Z&sr=b&sp=r&sig=KURQ7%2BDcQieniADy6RBY8RB62E6DkA7BIBHi9pIH93M%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554ae5e50>
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502dec79-4436-5ea8-b8a4-1afd151a13a2/502dec79-4436-5ea8-b8a4-1afd151a13a2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX68XHM%252F699081138%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081138/600 saved to cache
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 502dec79-4436-5ea8-b8a4-1afd151a13a2
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547226750>
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5dbf164-beca-542e-a8d7-8ec419cfcb14/c5dbf164-beca-542e-a8d7-8ec419cfcb14_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD70LYC%252F698976178%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976178/600 saved to cache
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5dbf164-beca-542e-a8d7-8ec419cfcb14
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547170250>
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5dbf164-beca-542e-a8d7-8ec419cfcb14/c5dbf164-beca-542e-a8d7-8ec419cfcb14_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD70LYC%252F698976051%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976051/600 saved to cache
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5dbf164-beca-542e-a8d7-8ec419cfcb14
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55495d450>
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5dbf164-beca-542e-a8d7-8ec419cfcb14/c5dbf164-beca-542e-a8d7-8ec419cfcb14_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD70LYC%252F698976119%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976119/600 saved to cache
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5dbf164-beca-542e-a8d7-8ec419cfcb14
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473b7990>
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ec4e6f-59e8-58bb-b6e7-08502c0644b2/a4ec4e6f-59e8-58bb-b6e7-08502c0644b2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWX18RKK%252F698994483%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994483/600 saved to cache
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a4ec4e6f-59e8-58bb-b6e7-08502c0644b2
2026-03-28 22:02:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a4ec4e6f-59e8-58bb-b6e7-08502c0644b2, skipping ID generation
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a4ec4e6f-59e8-58bb-b6e7-08502c0644b2 sending to next pipeline
2026-03-28 22:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a4ec4e6f-59e8-58bb-b6e7-08502c0644b2, identifier: WX18%20RKK
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542e8050>
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5dbf164-beca-542e-a8d7-8ec419cfcb14/c5dbf164-beca-542e-a8d7-8ec419cfcb14_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD70LYC%252F698976146%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976146/600 saved to cache
2026-03-28 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5dbf164-beca-542e-a8d7-8ec419cfcb14
2026-03-28 22:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a4ec4e6f-59e8-58bb-b6e7-08502c0644b2 with identifier: WX18%20RKK
2026-03-28 22:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a4ec4e6f-59e8-58bb-b6e7-08502c0644b2 with identifier: WX18%20RKK
2026-03-28 22:02:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a4ec4e6f-59e8-58bb-b6e7-08502c0644b2 with identifier: WX18%20RKK to the API
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994483/600>
{'auction_title': '',
'c_o_2_emission_value': 103,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ec4e6f-59e8-58bb-b6e7-08502c0644b2/a4ec4e6f-59e8-58bb-b6e7-08502c0644b2_expert_report_file_f669e661-a597-4dd1-9794-6f590d1d260d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WX18%20RKK-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a4ec4e6f-59e8-58bb-b6e7-08502c0644b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WX18 RKK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WX18%20RKK&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'MERCEDES-BENZ',
'model': 'A200 D',
'odometer': 63076,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ec4e6f-59e8-58bb-b6e7-08502c0644b2/a4ec4e6f-59e8-58bb-b6e7-08502c0644b2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50579,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994306/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ec4e6f-59e8-58bb-b6e7-08502c0644b2/a4ec4e6f-59e8-58bb-b6e7-08502c0644b2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50982,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994316/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ec4e6f-59e8-58bb-b6e7-08502c0644b2/a4ec4e6f-59e8-58bb-b6e7-08502c0644b2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47979,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994328/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ec4e6f-59e8-58bb-b6e7-08502c0644b2/a4ec4e6f-59e8-58bb-b6e7-08502c0644b2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48183,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994351/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ec4e6f-59e8-58bb-b6e7-08502c0644b2/a4ec4e6f-59e8-58bb-b6e7-08502c0644b2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38836,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994359/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ec4e6f-59e8-58bb-b6e7-08502c0644b2/a4ec4e6f-59e8-58bb-b6e7-08502c0644b2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38841,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994382/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ec4e6f-59e8-58bb-b6e7-08502c0644b2/a4ec4e6f-59e8-58bb-b6e7-08502c0644b2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93628,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994409/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ec4e6f-59e8-58bb-b6e7-08502c0644b2/a4ec4e6f-59e8-58bb-b6e7-08502c0644b2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91440,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994449/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ec4e6f-59e8-58bb-b6e7-08502c0644b2/a4ec4e6f-59e8-58bb-b6e7-08502c0644b2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106579,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994483/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ec4e6f-59e8-58bb-b6e7-08502c0644b2/a4ec4e6f-59e8-58bb-b6e7-08502c0644b2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91535,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WX18RKK/698994513/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A200 D 2.1 AMG LINE EXECUTIVE DCT Hatchback',
'transmission': 'automatic',
'trim': 'AMG LINE EXECUTIVE DCT',
'vin': 'WDD1760082J757673',
'year': 2018}
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX18%2520RKK%27 HTTP/1.1" 200 None
2026-03-28 22:02:38 [bca.uk] INFO: Saving data for WX18%20RKK: {'created_time': 1774735358.060703, 'last_price_update_time': 1774735358.060716, 'auction_closing_time': 1774951200.0}
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WX18%2520RKK') HTTP/1.1" 204 0
2026-03-28 22:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK63FTA/42810748?sv=2020-08-04&st=2026-03-28T22%3A02%3A37Z&se=2026-03-28T22%3A27%3A37Z&sr=b&sp=r&sig=8idsaRiqkBW%2F4yV9GfTbfGTdARozLnFNkkZDloB%2BwtQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EK63%20FTA-GB>
2026-03-28 22:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110815/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110815>
2026-03-28 22:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126485/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126485>
2026-03-28 22:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031439/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031439>
2026-03-28 22:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110802/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110802>
2026-03-28 22:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093818/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093818>
2026-03-28 22:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093801/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VX52YYH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994151/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994151>
2026-03-28 22:02:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54776e910>
2026-03-28 22:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8076e5d-cb8b-5578-9e3b-020e67e6d8b5/d8076e5d-cb8b-5578-9e3b-020e67e6d8b5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV03RSZ%252F699074220%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074220/600 saved to cache
2026-03-28 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d8076e5d-cb8b-5578-9e3b-020e67e6d8b5
2026-03-28 22:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554569190>
2026-03-28 22:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30726c84-9b6d-55d7-85ab-840199d36e87/30726c84-9b6d-55d7-85ab-840199d36e87_expert_report_file_e6a583f4-6871-4080-84f5-8e7c4aa604c4.pdf HTTP/1.1" 201 0
2026-03-28 22:02:38 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 30726c84-9b6d-55d7-85ab-840199d36e87
2026-03-28 22:02:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30726c84-9b6d-55d7-85ab-840199d36e87, skipping ID generation
2026-03-28 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 30726c84-9b6d-55d7-85ab-840199d36e87
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWN12FKU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WN12FKU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081101/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX68XHM/42809660?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=LehtVWZLTGCUq%2FHVaWaxVcM6eZjoYBHWl7BsrTTno54%3D)
2026-03-28 22:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126495/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126495>
2026-03-28 22:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074206/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074206>
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189598%27 HTTP/1.1" 200 None
2026-03-28 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189598 not downloaded yet
2026-03-28 22:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074212/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV03RSZ/42811210?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=XPdxTou37%2FSrb2139PEgleDE82DPAqY3LhSbwh%2FScoQ%3D)
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189607%27 HTTP/1.1" 200 None
2026-03-28 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189607 not downloaded yet
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189614%27 HTTP/1.1" 200 None
2026-03-28 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189614 not downloaded yet
2026-03-28 22:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976207/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD70LYC/42810765?sv=2020-08-04&st=2026-03-28T22%3A02%3A33Z&se=2026-03-28T22%3A27%3A33Z&sr=b&sp=r&sig=p7zo9yHW7El16wY6YXfUe9uNKREDCLATYag5372BsKw%3D)
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189618%27 HTTP/1.1" 200 None
2026-03-28 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189618 not downloaded yet
2026-03-28 22:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081079/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081079>
2026-03-28 22:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110802/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ73EOT/42811363?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=Z275yW1rsbj3FapfEeIfN9OJqcCvXddViu6M84JP7AA%3D)
2026-03-28 22:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093818/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP15GZB/42811287?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=7tUa0hwrEujFHU3KRxrEE1EA%2FQ%2B2aDgCCCKK2Q5cFLc%3D)
2026-03-28 22:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093801/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VX52YYH/42811323?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=sBcdU%2Bi00fGyPAIkGghzLoIMWb9WJk%2B0Sty%2BOKRiKzA%3D)
2026-03-28 22:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031439/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ68UWN/42811039?sv=2020-08-04&st=2026-03-28T22%3A01%3A10Z&se=2026-03-28T22%3A26%3A10Z&sr=b&sp=r&sig=1ZiFBHKVUwguyFOSNXk0RG8MN%2BDlXzRukHPnqyWqOFk%3D)
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189622%27 HTTP/1.1" 200 None
2026-03-28 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189622 not downloaded yet
2026-03-28 22:02:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472f7710>
2026-03-28 22:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502dec79-4436-5ea8-b8a4-1afd151a13a2/502dec79-4436-5ea8-b8a4-1afd151a13a2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX68XHM%252F699081101%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081101/600 saved to cache
2026-03-28 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 502dec79-4436-5ea8-b8a4-1afd151a13a2
2026-03-28 22:02:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54739db10>
2026-03-28 22:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8076e5d-cb8b-5578-9e3b-020e67e6d8b5/d8076e5d-cb8b-5578-9e3b-020e67e6d8b5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV03RSZ%252F699074212%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074212/600 saved to cache
2026-03-28 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d8076e5d-cb8b-5578-9e3b-020e67e6d8b5
2026-03-28 22:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FT61VUR/42811133?sv=2020-08-04&st=2026-03-28T22%3A02%3A36Z&se=2026-03-28T22%3A27%3A36Z&sr=b&sp=r&sig=9EPcV3ym6qVnTW2kEyVvxbtoQKt2ehb%2B25xAT3tRiJ0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189637%27 HTTP/1.1" 200 None
2026-03-28 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189637 not downloaded yet
2026-03-28 22:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO61OVX/42811349?sv=2020-08-04&st=2026-03-28T22%3A02%3A37Z&se=2026-03-28T22%3A27%3A37Z&sr=b&sp=r&sig=nKiFh%2BghLTUQtSr4%2F%2FN4LMcEMrRkLUwJz3jI%2BH%2BqAp4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110815/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ70EHU/42811341?sv=2020-08-04&st=2026-03-28T22%3A01%3A12Z&se=2026-03-28T22%3A26%3A12Z&sr=b&sp=r&sig=jIMEwQ1nhHjk3xUWtYxp4DaMU%2Fd7rUcdJRYrXhJEbps%3D)
2026-03-28 22:02:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477a6cd0>
2026-03-28 22:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5dbf164-beca-542e-a8d7-8ec419cfcb14/c5dbf164-beca-542e-a8d7-8ec419cfcb14_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD70LYC%252F698976207%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976207/600 saved to cache
2026-03-28 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5dbf164-beca-542e-a8d7-8ec419cfcb14
2026-03-28 22:02:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5dbf164-beca-542e-a8d7-8ec419cfcb14, skipping ID generation
2026-03-28 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5dbf164-beca-542e-a8d7-8ec419cfcb14 sending to next pipeline
2026-03-28 22:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c5dbf164-beca-542e-a8d7-8ec419cfcb14, identifier: FD70%20LYC
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189659%27 HTTP/1.1" 200 None
2026-03-28 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189659 not downloaded yet
2026-03-28 22:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c5dbf164-beca-542e-a8d7-8ec419cfcb14 with identifier: FD70%20LYC
2026-03-28 22:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c5dbf164-beca-542e-a8d7-8ec419cfcb14 with identifier: FD70%20LYC
2026-03-28 22:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c5dbf164-beca-542e-a8d7-8ec419cfcb14 with identifier: FD70%20LYC to the API
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976207/600>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5dbf164-beca-542e-a8d7-8ec419cfcb14/c5dbf164-beca-542e-a8d7-8ec419cfcb14_expert_report_file_5f5c6138-c6c1-4d9e-9790-732b8112194a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FD70%20LYC-GB',
'category': 'Car',
'color': 'orange',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c5dbf164-beca-542e-a8d7-8ec419cfcb14',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FD70 LYC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FD70%20LYC&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 81045,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5dbf164-beca-542e-a8d7-8ec419cfcb14/c5dbf164-beca-542e-a8d7-8ec419cfcb14_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50696,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976023/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5dbf164-beca-542e-a8d7-8ec419cfcb14/c5dbf164-beca-542e-a8d7-8ec419cfcb14_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50113,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976033/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5dbf164-beca-542e-a8d7-8ec419cfcb14/c5dbf164-beca-542e-a8d7-8ec419cfcb14_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48418,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976039/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5dbf164-beca-542e-a8d7-8ec419cfcb14/c5dbf164-beca-542e-a8d7-8ec419cfcb14_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47866,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976051/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5dbf164-beca-542e-a8d7-8ec419cfcb14/c5dbf164-beca-542e-a8d7-8ec419cfcb14_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41572,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976064/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5dbf164-beca-542e-a8d7-8ec419cfcb14/c5dbf164-beca-542e-a8d7-8ec419cfcb14_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41991,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976081/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5dbf164-beca-542e-a8d7-8ec419cfcb14/c5dbf164-beca-542e-a8d7-8ec419cfcb14_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92352,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976119/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5dbf164-beca-542e-a8d7-8ec419cfcb14/c5dbf164-beca-542e-a8d7-8ec419cfcb14_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77110,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976146/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5dbf164-beca-542e-a8d7-8ec419cfcb14/c5dbf164-beca-542e-a8d7-8ec419cfcb14_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98316,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976178/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5dbf164-beca-542e-a8d7-8ec419cfcb14/c5dbf164-beca-542e-a8d7-8ec419cfcb14_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63532,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD70LYC/698976207/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 TURBO 100 SRI Hatchback',
'transmission': 'manual',
'trim': 'TURBO 100 SRI',
'vin': 'VXKUPHNKKL4447164',
'year': 2020}
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD70%2520LYC%27 HTTP/1.1" 200 None
2026-03-28 22:02:38 [bca.uk] INFO: Saving data for FD70%20LYC: {'created_time': 1774735358.957511, 'last_price_update_time': 1774735358.957522, 'auction_closing_time': 1774951200.0}
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FD70%2520LYC') HTTP/1.1" 204 0
2026-03-28 22:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126485/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT19CVS/42811387?sv=2020-08-04&st=2026-03-28T22%3A01%3A08Z&se=2026-03-28T22%3A26%3A08Z&sr=b&sp=r&sig=Xezo2YoS0t9x6abxzIwcxCNA1wXAbFztVA4zM%2F%2Bntk8%3D)
2026-03-28 22:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994151/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN63OLH/42810834?sv=2020-08-04&st=2026-03-28T22%3A01%3A09Z&se=2026-03-28T22%3A26%3A09Z&sr=b&sp=r&sig=NMpNDT8TSdoKfgfMWv1wobNIeXn3SgscjQpSI5aPQXk%3D)
2026-03-28 22:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081079/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX68XHM/42809660?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=LehtVWZLTGCUq%2FHVaWaxVcM6eZjoYBHWl7BsrTTno54%3D)
2026-03-28 22:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285845/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285845>
2026-03-28 22:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189593/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WN12FKU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074206/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV03RSZ/42811210?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=XPdxTou37%2FSrb2139PEgleDE82DPAqY3LhSbwh%2FScoQ%3D)
2026-03-28 22:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126495/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT70TDO/42811400?sv=2020-08-04&st=2026-03-28T22%3A01%3A09Z&se=2026-03-28T22%3A26%3A09Z&sr=b&sp=r&sig=sz4G2m%2Bww1tbH3aSNvJ2DJLyecaaL3NNq%2FlejxEYTpI%3D)
2026-03-28 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189674%27 HTTP/1.1" 200 None
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189674 not downloaded yet
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474e6410>
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2f45d0-e564-5ded-8cb4-0288835f055c/ab2f45d0-e564-5ded-8cb4-0288835f055c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ73EOT%252F699110802%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110802/600 saved to cache
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab2f45d0-e564-5ded-8cb4-0288835f055c
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554557850>
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283b6c92-cce2-544a-9b3b-da049a06ca33/283b6c92-cce2-544a-9b3b-da049a06ca33_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP15GZB%252F699093818%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093818/600 saved to cache
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 283b6c92-cce2-544a-9b3b-da049a06ca33
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474edad0>
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d9ff90-12a7-5f3d-86ac-c640dc2351b5/08d9ff90-12a7-5f3d-86ac-c640dc2351b5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVX52YYH%252F699093801%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093801/600 saved to cache
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08d9ff90-12a7-5f3d-86ac-c640dc2351b5
2026-03-28 22:02:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08d9ff90-12a7-5f3d-86ac-c640dc2351b5, skipping ID generation
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08d9ff90-12a7-5f3d-86ac-c640dc2351b5 sending to next pipeline
2026-03-28 22:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 08d9ff90-12a7-5f3d-86ac-c640dc2351b5, identifier: VX52%20YYH
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555c50650>
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f05d113-747f-52ed-a1ad-9799bad35377/7f05d113-747f-52ed-a1ad-9799bad35377_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ68UWN%252F699031439%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031439/600 saved to cache
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f05d113-747f-52ed-a1ad-9799bad35377
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55490a310>
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45df846-9de9-5dca-bfcb-dcf57dc2b59b/a45df846-9de9-5dca-bfcb-dcf57dc2b59b_expert_report_file_d62c1a3e-6cb3-4879-8ac2-c93f5785b654.pdf HTTP/1.1" 201 0
2026-03-28 22:02:39 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a45df846-9de9-5dca-bfcb-dcf57dc2b59b
2026-03-28 22:02:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a45df846-9de9-5dca-bfcb-dcf57dc2b59b, skipping ID generation
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a45df846-9de9-5dca-bfcb-dcf57dc2b59b
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFT61VUR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FT61VUR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55490ab50>
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2337f209-45ff-57b7-b370-ccb04b4d58bb/2337f209-45ff-57b7-b370-ccb04b4d58bb_expert_report_file_68bcd446-dde9-4332-8063-3a5b0a9f763b.pdf HTTP/1.1" 201 0
2026-03-28 22:02:39 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2337f209-45ff-57b7-b370-ccb04b4d58bb
2026-03-28 22:02:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2337f209-45ff-57b7-b370-ccb04b4d58bb, skipping ID generation
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2337f209-45ff-57b7-b370-ccb04b4d58bb
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEO61OVX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EO61OVX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554809c50>
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf35b337-845e-537f-a976-08188cca66f3/cf35b337-845e-537f-a976-08188cca66f3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ70EHU%252F699110815%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110815/600 saved to cache
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf35b337-845e-537f-a976-08188cca66f3
2026-03-28 22:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 08d9ff90-12a7-5f3d-86ac-c640dc2351b5 with identifier: VX52%20YYH
2026-03-28 22:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 08d9ff90-12a7-5f3d-86ac-c640dc2351b5 with identifier: VX52%20YYH
2026-03-28 22:02:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 08d9ff90-12a7-5f3d-86ac-c640dc2351b5 with identifier: VX52%20YYH to the API
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093801/600>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d9ff90-12a7-5f3d-86ac-c640dc2351b5/08d9ff90-12a7-5f3d-86ac-c640dc2351b5_expert_report_file_7389229f-bcf3-4801-a073-b37eac82683f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VX52%20YYH-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '08d9ff90-12a7-5f3d-86ac-c640dc2351b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VX52 YYH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VX52%20YYH&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'HONDA',
'model': 'JAZZ',
'odometer': 30831,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d9ff90-12a7-5f3d-86ac-c640dc2351b5/08d9ff90-12a7-5f3d-86ac-c640dc2351b5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37441,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093801/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d9ff90-12a7-5f3d-86ac-c640dc2351b5/08d9ff90-12a7-5f3d-86ac-c640dc2351b5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37117,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093820/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d9ff90-12a7-5f3d-86ac-c640dc2351b5/08d9ff90-12a7-5f3d-86ac-c640dc2351b5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37055,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093838/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d9ff90-12a7-5f3d-86ac-c640dc2351b5/08d9ff90-12a7-5f3d-86ac-c640dc2351b5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36318,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093849/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d9ff90-12a7-5f3d-86ac-c640dc2351b5/08d9ff90-12a7-5f3d-86ac-c640dc2351b5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34013,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093866/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d9ff90-12a7-5f3d-86ac-c640dc2351b5/08d9ff90-12a7-5f3d-86ac-c640dc2351b5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34497,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093882/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d9ff90-12a7-5f3d-86ac-c640dc2351b5/08d9ff90-12a7-5f3d-86ac-c640dc2351b5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69114,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093905/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d9ff90-12a7-5f3d-86ac-c640dc2351b5/08d9ff90-12a7-5f3d-86ac-c640dc2351b5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49280,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093934/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d9ff90-12a7-5f3d-86ac-c640dc2351b5/08d9ff90-12a7-5f3d-86ac-c640dc2351b5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69271,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093969/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d9ff90-12a7-5f3d-86ac-c640dc2351b5/08d9ff90-12a7-5f3d-86ac-c640dc2351b5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60894,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VX52YYH/699093999/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-01-01',
'seller_name': None,
'title': 'HONDA JAZZ 1.4 I-DSI SE Hatchback',
'transmission': 'manual',
'trim': 'I-DSI SE',
'vin': 'JHMGD17502S241222',
'year': 2002}
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX52%2520YYH%27 HTTP/1.1" 200 None
2026-03-28 22:02:39 [bca.uk] INFO: Saving data for VX52%20YYH: {'created_time': 1774735359.767617, 'last_price_update_time': 1774735359.767627, 'auction_closing_time': 1774951200.0}
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VX52%2520YYH') HTTP/1.1" 204 0
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189685%27 HTTP/1.1" 200 None
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189685 not downloaded yet
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699059451%27 HTTP/1.1" 200 None
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059451 not downloaded yet
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188720%27 HTTP/1.1" 200 None
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188720 not downloaded yet
2026-03-28 22:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK63FTA/42810748?sv=2020-08-04&st=2026-03-28T22%3A02%3A37Z&se=2026-03-28T22%3A27%3A37Z&sr=b&sp=r&sig=8idsaRiqkBW%2F4yV9GfTbfGTdARozLnFNkkZDloB%2BwtQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189622/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189622>
2026-03-28 22:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189618/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189618>
2026-03-28 22:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189607/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189607>
2026-03-28 22:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966066/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966066>
2026-03-28 22:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189598/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189598>
2026-03-28 22:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981217/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981217>
2026-03-28 22:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189614/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189614>
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699059463%27 HTTP/1.1" 200 None
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059463 not downloaded yet
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188728%27 HTTP/1.1" 200 None
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188728 not downloaded yet
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554909a50>
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b3f5c4-70ca-530a-a56a-701b7ee98ebe/d2b3f5c4-70ca-530a-a56a-701b7ee98ebe_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT19CVS%252F699126485%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126485/600 saved to cache
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2b3f5c4-70ca-530a-a56a-701b7ee98ebe
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547278990>
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39f18d5c-38c9-5802-bc90-29e03976b40f/39f18d5c-38c9-5802-bc90-29e03976b40f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN63OLH%252F698994151%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994151/600 saved to cache
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 39f18d5c-38c9-5802-bc90-29e03976b40f
2026-03-28 22:02:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe56373a050>
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502dec79-4436-5ea8-b8a4-1afd151a13a2/502dec79-4436-5ea8-b8a4-1afd151a13a2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX68XHM%252F699081079%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081079/600 saved to cache
2026-03-28 22:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 502dec79-4436-5ea8-b8a4-1afd151a13a2
2026-03-28 22:02:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472851d0>
2026-03-28 22:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8076e5d-cb8b-5578-9e3b-020e67e6d8b5/d8076e5d-cb8b-5578-9e3b-020e67e6d8b5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV03RSZ%252F699074206%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074206/600 saved to cache
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d8076e5d-cb8b-5578-9e3b-020e67e6d8b5
2026-03-28 22:02:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556f7fa50>
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d540cd8f-d715-5405-a8d5-11721b31b439/d540cd8f-d715-5405-a8d5-11721b31b439_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT70TDO%252F699126495%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126495/600 saved to cache
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d540cd8f-d715-5405-a8d5-11721b31b439
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699059473%27 HTTP/1.1" 200 None
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059473 not downloaded yet
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188735%27 HTTP/1.1" 200 None
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188735 not downloaded yet
2026-03-28 22:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189593/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN12FKU/42809435?sv=2020-08-04&st=2026-03-28T22%3A02%3A35Z&se=2026-03-28T22%3A27%3A35Z&sr=b&sp=r&sig=KURQ7%2BDcQieniADy6RBY8RB62E6DkA7BIBHi9pIH93M%3D)
2026-03-28 22:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058638/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058638>
2026-03-28 22:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189659/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189659>
2026-03-28 22:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189637/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189637>
2026-03-28 22:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AY07YBB/42808352?sv=2020-08-04&st=2026-03-28T22%3A02%3A39Z&se=2026-03-28T22%3A27%3A39Z&sr=b&sp=r&sig=Dfk%2FNspBeNvt2pzTxiDfwj74xvwCYMq4zUUm1N9YYwk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AY07%20YBB-GB>
2026-03-28 22:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110793/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KJ73EOT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093803/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BP15GZB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285845/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV69BJO/42810768?sv=2020-08-04&st=2026-03-28T22%3A01%3A08Z&se=2026-03-28T22%3A26%3A08Z&sr=b&sp=r&sig=RhBgWIDbmwF%2F8XqW9pjzomUmOVaJM8ThWq2ap8w7j1M%3D)
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699059482%27 HTTP/1.1" 200 None
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059482 not downloaded yet
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188743%27 HTTP/1.1" 200 None
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188743 not downloaded yet
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543002d0>
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f3242ee-badd-5243-9618-1a2a403b68bc/0f3242ee-badd-5243-9618-1a2a403b68bc_expert_report_file_83070fc3-3599-4774-8db8-16b2f2ccbee1.pdf HTTP/1.1" 201 0
2026-03-28 22:02:40 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0f3242ee-badd-5243-9618-1a2a403b68bc
2026-03-28 22:02:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f3242ee-badd-5243-9618-1a2a403b68bc, skipping ID generation
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f3242ee-badd-5243-9618-1a2a403b68bc
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEK63FTA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EK63FTA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189607/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN12FKU/42809435?sv=2020-08-04&st=2026-03-28T22%3A02%3A35Z&se=2026-03-28T22%3A27%3A35Z&sr=b&sp=r&sig=KURQ7%2BDcQieniADy6RBY8RB62E6DkA7BIBHi9pIH93M%3D)
2026-03-28 22:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189598/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN12FKU/42809435?sv=2020-08-04&st=2026-03-28T22%3A02%3A35Z&se=2026-03-28T22%3A27%3A35Z&sr=b&sp=r&sig=KURQ7%2BDcQieniADy6RBY8RB62E6DkA7BIBHi9pIH93M%3D)
2026-03-28 22:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189614/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN12FKU/42809435?sv=2020-08-04&st=2026-03-28T22%3A02%3A35Z&se=2026-03-28T22%3A27%3A35Z&sr=b&sp=r&sig=KURQ7%2BDcQieniADy6RBY8RB62E6DkA7BIBHi9pIH93M%3D)
2026-03-28 22:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189618/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN12FKU/42809435?sv=2020-08-04&st=2026-03-28T22%3A02%3A35Z&se=2026-03-28T22%3A27%3A35Z&sr=b&sp=r&sig=KURQ7%2BDcQieniADy6RBY8RB62E6DkA7BIBHi9pIH93M%3D)
2026-03-28 22:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189622/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN12FKU/42809435?sv=2020-08-04&st=2026-03-28T22%3A02%3A35Z&se=2026-03-28T22%3A27%3A35Z&sr=b&sp=r&sig=KURQ7%2BDcQieniADy6RBY8RB62E6DkA7BIBHi9pIH93M%3D)
2026-03-28 22:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981217/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND62EWM/42810799?sv=2020-08-04&st=2026-03-28T22%3A01%3A06Z&se=2026-03-28T22%3A26%3A06Z&sr=b&sp=r&sig=KD3C6SJzwrdEgIjlL7QRYHJfSgh8rbJ%2FPC%2F%2BEfVah7k%3D)
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699059493%27 HTTP/1.1" 200 None
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059493 not downloaded yet
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188747%27 HTTP/1.1" 200 None
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188747 not downloaded yet
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970546%27 HTTP/1.1" 200 None
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970546 not downloaded yet
2026-03-28 22:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966066/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD57OLK/42810740?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=6hm7fODnR3wBKimIVKSkEorWvM8%2B5kHNq4nMJt6A%2BvY%3D)
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699059517%27 HTTP/1.1" 200 None
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059517 not downloaded yet
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188758%27 HTTP/1.1" 200 None
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188758 not downloaded yet
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970558%27 HTTP/1.1" 200 None
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970558 not downloaded yet
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554ae6ed0>
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30726c84-9b6d-55d7-85ab-840199d36e87/30726c84-9b6d-55d7-85ab-840199d36e87_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN12FKU%252F699189593%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189593/600 saved to cache
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30726c84-9b6d-55d7-85ab-840199d36e87
2026-03-28 22:02:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547203890>
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbce9e71-f6f9-5b70-87a1-2cf7e0368db6/fbce9e71-f6f9-5b70-87a1-2cf7e0368db6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV69BJO%252F699285845%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285845/600 saved to cache
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fbce9e71-f6f9-5b70-87a1-2cf7e0368db6
2026-03-28 22:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188715/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EO61OVX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110793/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ73EOT/42811363?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=Z275yW1rsbj3FapfEeIfN9OJqcCvXddViu6M84JP7AA%3D)
2026-03-28 22:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093803/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP15GZB/42811287?sv=2020-08-04&st=2026-03-28T22%3A01%3A14Z&se=2026-03-28T22%3A26%3A14Z&sr=b&sp=r&sig=7tUa0hwrEujFHU3KRxrEE1EA%2FQ%2B2aDgCCCKK2Q5cFLc%3D)
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699059540%27 HTTP/1.1" 200 None
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059540 not downloaded yet
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188772%27 HTTP/1.1" 200 None
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188772 not downloaded yet
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970570%27 HTTP/1.1" 200 None
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970570 not downloaded yet
2026-03-28 22:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189637/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN12FKU/42809435?sv=2020-08-04&st=2026-03-28T22%3A02%3A35Z&se=2026-03-28T22%3A27%3A35Z&sr=b&sp=r&sig=KURQ7%2BDcQieniADy6RBY8RB62E6DkA7BIBHi9pIH93M%3D)
2026-03-28 22:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058638/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ12NEO/42811151?sv=2020-08-04&st=2026-03-28T22%3A01%3A05Z&se=2026-03-28T22%3A26%3A05Z&sr=b&sp=r&sig=62h1oUPBDkzrRTgiSRZPyg2OGFZw9gvgjM6%2Bng4Eeco%3D)
2026-03-28 22:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189659/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN12FKU/42809435?sv=2020-08-04&st=2026-03-28T22%3A02%3A35Z&se=2026-03-28T22%3A27%3A35Z&sr=b&sp=r&sig=KURQ7%2BDcQieniADy6RBY8RB62E6DkA7BIBHi9pIH93M%3D)
2026-03-28 22:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188728/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188728>
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699059557%27 HTTP/1.1" 200 None
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059557 not downloaded yet
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188784%27 HTTP/1.1" 200 None
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188784 not downloaded yet
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970584%27 HTTP/1.1" 200 None
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970584 not downloaded yet
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547203510>
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30726c84-9b6d-55d7-85ab-840199d36e87/30726c84-9b6d-55d7-85ab-840199d36e87_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN12FKU%252F699189607%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189607/600 saved to cache
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30726c84-9b6d-55d7-85ab-840199d36e87
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472b1850>
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30726c84-9b6d-55d7-85ab-840199d36e87/30726c84-9b6d-55d7-85ab-840199d36e87_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN12FKU%252F699189598%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189598/600 saved to cache
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30726c84-9b6d-55d7-85ab-840199d36e87
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54713ca10>
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30726c84-9b6d-55d7-85ab-840199d36e87/30726c84-9b6d-55d7-85ab-840199d36e87_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN12FKU%252F699189614%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189614/600 saved to cache
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30726c84-9b6d-55d7-85ab-840199d36e87
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472b1750>
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30726c84-9b6d-55d7-85ab-840199d36e87/30726c84-9b6d-55d7-85ab-840199d36e87_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN12FKU%252F699189618%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189618/600 saved to cache
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30726c84-9b6d-55d7-85ab-840199d36e87
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473ad510>
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30726c84-9b6d-55d7-85ab-840199d36e87/30726c84-9b6d-55d7-85ab-840199d36e87_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN12FKU%252F699189622%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189622/600 saved to cache
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30726c84-9b6d-55d7-85ab-840199d36e87
2026-03-28 22:02:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547130750>
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc2a305-976b-5d20-86ca-43ed711c23db/1fc2a305-976b-5d20-86ca-43ed711c23db_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND62EWM%252F698981217%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981217/600 saved to cache
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1fc2a305-976b-5d20-86ca-43ed711c23db
2026-03-28 22:02:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547133650>
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f1a744f-dcf7-513c-adf2-49d9ca828470/8f1a744f-dcf7-513c-adf2-49d9ca828470_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD57OLK%252F698966066%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966066/600 saved to cache
2026-03-28 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8f1a744f-dcf7-513c-adf2-49d9ca828470
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472b0ad0>
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2f45d0-e564-5ded-8cb4-0288835f055c/ab2f45d0-e564-5ded-8cb4-0288835f055c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ73EOT%252F699110793%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110793/600 saved to cache
2026-03-28 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab2f45d0-e564-5ded-8cb4-0288835f055c
2026-03-28 22:02:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab2f45d0-e564-5ded-8cb4-0288835f055c, skipping ID generation
2026-03-28 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab2f45d0-e564-5ded-8cb4-0288835f055c sending to next pipeline
2026-03-28 22:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ab2f45d0-e564-5ded-8cb4-0288835f055c, identifier: KJ73%20EOT
2026-03-28 22:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54724a710>
2026-03-28 22:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283b6c92-cce2-544a-9b3b-da049a06ca33/283b6c92-cce2-544a-9b3b-da049a06ca33_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP15GZB%252F699093803%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093803/600 saved to cache
2026-03-28 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 283b6c92-cce2-544a-9b3b-da049a06ca33
2026-03-28 22:02:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 283b6c92-cce2-544a-9b3b-da049a06ca33, skipping ID generation
2026-03-28 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 283b6c92-cce2-544a-9b3b-da049a06ca33 sending to next pipeline
2026-03-28 22:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 283b6c92-cce2-544a-9b3b-da049a06ca33, identifier: BP15%20GZB
2026-03-28 22:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AY07YBB/42808352?sv=2020-08-04&st=2026-03-28T22%3A02%3A39Z&se=2026-03-28T22%3A27%3A39Z&sr=b&sp=r&sig=Dfk%2FNspBeNvt2pzTxiDfwj74xvwCYMq4zUUm1N9YYwk%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970534/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EK63FTA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188735/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188735>
2026-03-28 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699059572%27 HTTP/1.1" 200 None
2026-03-28 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059572 not downloaded yet
2026-03-28 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188797%27 HTTP/1.1" 200 None
2026-03-28 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188797 not downloaded yet
2026-03-28 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970591%27 HTTP/1.1" 200 None
2026-03-28 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970591 not downloaded yet
2026-03-28 22:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ab2f45d0-e564-5ded-8cb4-0288835f055c with identifier: KJ73%20EOT
2026-03-28 22:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ab2f45d0-e564-5ded-8cb4-0288835f055c with identifier: KJ73%20EOT
2026-03-28 22:02:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ab2f45d0-e564-5ded-8cb4-0288835f055c with identifier: KJ73%20EOT to the API
2026-03-28 22:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110793/600>
{'auction_title': '',
'c_o_2_emission_value': 138,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2f45d0-e564-5ded-8cb4-0288835f055c/ab2f45d0-e564-5ded-8cb4-0288835f055c_expert_report_file_a5e0810c-07de-4d58-897f-a1c928e91275.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KJ73%20EOT-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ab2f45d0-e564-5ded-8cb4-0288835f055c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KJ73 EOT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KJ73%20EOT&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'MERCEDES-BENZ',
'model': 'CLA 180 S/B',
'odometer': 11034,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2f45d0-e564-5ded-8cb4-0288835f055c/ab2f45d0-e564-5ded-8cb4-0288835f055c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39946,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110793/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2f45d0-e564-5ded-8cb4-0288835f055c/ab2f45d0-e564-5ded-8cb4-0288835f055c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39242,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110802/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2f45d0-e564-5ded-8cb4-0288835f055c/ab2f45d0-e564-5ded-8cb4-0288835f055c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38727,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110816/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2f45d0-e564-5ded-8cb4-0288835f055c/ab2f45d0-e564-5ded-8cb4-0288835f055c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37462,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110825/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2f45d0-e564-5ded-8cb4-0288835f055c/ab2f45d0-e564-5ded-8cb4-0288835f055c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32224,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110839/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2f45d0-e564-5ded-8cb4-0288835f055c/ab2f45d0-e564-5ded-8cb4-0288835f055c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31388,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110845/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2f45d0-e564-5ded-8cb4-0288835f055c/ab2f45d0-e564-5ded-8cb4-0288835f055c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66052,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110857/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2f45d0-e564-5ded-8cb4-0288835f055c/ab2f45d0-e564-5ded-8cb4-0288835f055c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75166,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110875/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2f45d0-e564-5ded-8cb4-0288835f055c/ab2f45d0-e564-5ded-8cb4-0288835f055c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74901,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110891/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2f45d0-e564-5ded-8cb4-0288835f055c/ab2f45d0-e564-5ded-8cb4-0288835f055c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71150,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ73EOT/699110911/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLA 180 S/B 1.3 AMG LINE EXECUTIVE DCT Estate',
'transmission': 'automatic',
'trim': 'AMG LINE EXECUTIVE DCT',
'vin': 'W1K5M8EB4RN459525',
'year': 2024}
2026-03-28 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ73%2520EOT%27 HTTP/1.1" 200 None
2026-03-28 22:02:41 [bca.uk] INFO: Saving data for KJ73%20EOT: {'created_time': 1774735361.858642, 'last_price_update_time': 1774735361.858653, 'auction_closing_time': 1774951200.0}
2026-03-28 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KJ73%2520EOT') HTTP/1.1" 204 0
2026-03-28 22:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 283b6c92-cce2-544a-9b3b-da049a06ca33 with identifier: BP15%20GZB
2026-03-28 22:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 283b6c92-cce2-544a-9b3b-da049a06ca33 with identifier: BP15%20GZB
2026-03-28 22:02:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 283b6c92-cce2-544a-9b3b-da049a06ca33 with identifier: BP15%20GZB to the API
2026-03-28 22:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093803/600>
{'auction_title': '',
'c_o_2_emission_value': 292,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283b6c92-cce2-544a-9b3b-da049a06ca33/283b6c92-cce2-544a-9b3b-da049a06ca33_expert_report_file_da7bc0a7-827f-4761-80cb-24414611eaf4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BP15%20GZB-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '5.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '283b6c92-cce2-544a-9b3b-da049a06ca33',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BP15 GZB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BP15%20GZB&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'JAGUAR',
'model': 'XKR',
'odometer': 19925,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283b6c92-cce2-544a-9b3b-da049a06ca33/283b6c92-cce2-544a-9b3b-da049a06ca33_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36883,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093803/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283b6c92-cce2-544a-9b3b-da049a06ca33/283b6c92-cce2-544a-9b3b-da049a06ca33_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36701,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093818/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283b6c92-cce2-544a-9b3b-da049a06ca33/283b6c92-cce2-544a-9b3b-da049a06ca33_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36818,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093835/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283b6c92-cce2-544a-9b3b-da049a06ca33/283b6c92-cce2-544a-9b3b-da049a06ca33_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35910,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093851/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283b6c92-cce2-544a-9b3b-da049a06ca33/283b6c92-cce2-544a-9b3b-da049a06ca33_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29286,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093861/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283b6c92-cce2-544a-9b3b-da049a06ca33/283b6c92-cce2-544a-9b3b-da049a06ca33_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29029,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093876/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283b6c92-cce2-544a-9b3b-da049a06ca33/283b6c92-cce2-544a-9b3b-da049a06ca33_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83051,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093900/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283b6c92-cce2-544a-9b3b-da049a06ca33/283b6c92-cce2-544a-9b3b-da049a06ca33_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59697,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093929/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283b6c92-cce2-544a-9b3b-da049a06ca33/283b6c92-cce2-544a-9b3b-da049a06ca33_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71931,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093945/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283b6c92-cce2-544a-9b3b-da049a06ca33/283b6c92-cce2-544a-9b3b-da049a06ca33_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81338,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP15GZB/699093983/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'JAGUAR XKR 5.0 V8 SUPERCHARGED DYNAMIC Coupe',
'transmission': 'automatic',
'trim': 'V8 SUPERCHARGED DYNAMIC',
'vin': 'SAJAC45R8FMB56318',
'year': 2015}
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP15%2520GZB%27 HTTP/1.1" 200 None
2026-03-28 22:02:42 [bca.uk] INFO: Saving data for BP15%20GZB: {'created_time': 1774735362.263865, 'last_price_update_time': 1774735362.263876, 'auction_closing_time': 1774951200.0}
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BP15%2520GZB') HTTP/1.1" 204 0
2026-03-28 22:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059482/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059482>
2026-03-28 22:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059473/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059473>
2026-03-28 22:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188743/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188743>
2026-03-28 22:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059463/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059463>
2026-03-28 22:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188720/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188720>
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970612%27 HTTP/1.1" 200 None
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970612 not downloaded yet
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970624%27 HTTP/1.1" 200 None
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970624 not downloaded yet
2026-03-28 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547ecbd0>
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30726c84-9b6d-55d7-85ab-840199d36e87/30726c84-9b6d-55d7-85ab-840199d36e87_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN12FKU%252F699189637%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189637/600 saved to cache
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30726c84-9b6d-55d7-85ab-840199d36e87
2026-03-28 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542ffe10>
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf9384a7-c2b5-5829-81c5-0ab07891768a/cf9384a7-c2b5-5829-81c5-0ab07891768a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ12NEO%252F699058638%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058638/600 saved to cache
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf9384a7-c2b5-5829-81c5-0ab07891768a
2026-03-28 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477a6e50>
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30726c84-9b6d-55d7-85ab-840199d36e87/30726c84-9b6d-55d7-85ab-840199d36e87_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN12FKU%252F699189659%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189659/600 saved to cache
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30726c84-9b6d-55d7-85ab-840199d36e87
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542ff150>
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88817b86-325c-592c-b16f-dff4dccb2371/88817b86-325c-592c-b16f-dff4dccb2371_expert_report_file_2786f728-0ab5-4aa3-87a6-721c45a50685.pdf HTTP/1.1" 201 0
2026-03-28 22:02:42 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 88817b86-325c-592c-b16f-dff4dccb2371
2026-03-28 22:02:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88817b86-325c-592c-b16f-dff4dccb2371, skipping ID generation
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 88817b86-325c-592c-b16f-dff4dccb2371
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAY07YBB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AY07YBB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188715/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO61OVX/42811349?sv=2020-08-04&st=2026-03-28T22%3A02%3A37Z&se=2026-03-28T22%3A27%3A37Z&sr=b&sp=r&sig=nKiFh%2BghLTUQtSr4%2F%2FN4LMcEMrRkLUwJz3jI%2BH%2BqAp4%3D)
2026-03-28 22:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059493/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059493>
2026-03-28 22:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059517/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059517>
2026-03-28 22:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970546/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970546>
2026-03-28 22:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188758/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188758>
2026-03-28 22:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188728/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO61OVX/42811349?sv=2020-08-04&st=2026-03-28T22%3A02%3A37Z&se=2026-03-28T22%3A27%3A37Z&sr=b&sp=r&sig=nKiFh%2BghLTUQtSr4%2F%2FN4LMcEMrRkLUwJz3jI%2BH%2BqAp4%3D)
2026-03-28 22:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188747/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188747>
2026-03-28 22:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970558/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970558>
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970642%27 HTTP/1.1" 200 None
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970642 not downloaded yet
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188210%27 HTTP/1.1" 200 None
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188210 not downloaded yet
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970663%27 HTTP/1.1" 200 None
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970663 not downloaded yet
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188214%27 HTTP/1.1" 200 None
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188214 not downloaded yet
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188220%27 HTTP/1.1" 200 None
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188220 not downloaded yet
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188226%27 HTTP/1.1" 200 None
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188226 not downloaded yet
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188230%27 HTTP/1.1" 200 None
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188230 not downloaded yet
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547111310>
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2337f209-45ff-57b7-b370-ccb04b4d58bb/2337f209-45ff-57b7-b370-ccb04b4d58bb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO61OVX%252F699188715%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188715/600 saved to cache
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2337f209-45ff-57b7-b370-ccb04b4d58bb
2026-03-28 22:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059473/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FT61VUR/42811133?sv=2020-08-04&st=2026-03-28T22%3A02%3A36Z&se=2026-03-28T22%3A27%3A36Z&sr=b&sp=r&sig=9EPcV3ym6qVnTW2kEyVvxbtoQKt2ehb%2B25xAT3tRiJ0%3D)
2026-03-28 22:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059482/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FT61VUR/42811133?sv=2020-08-04&st=2026-03-28T22%3A02%3A36Z&se=2026-03-28T22%3A27%3A36Z&sr=b&sp=r&sig=9EPcV3ym6qVnTW2kEyVvxbtoQKt2ehb%2B25xAT3tRiJ0%3D)
2026-03-28 22:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188735/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO61OVX/42811349?sv=2020-08-04&st=2026-03-28T22%3A02%3A37Z&se=2026-03-28T22%3A27%3A37Z&sr=b&sp=r&sig=nKiFh%2BghLTUQtSr4%2F%2FN4LMcEMrRkLUwJz3jI%2BH%2BqAp4%3D)
2026-03-28 22:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188720/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO61OVX/42811349?sv=2020-08-04&st=2026-03-28T22%3A02%3A37Z&se=2026-03-28T22%3A27%3A37Z&sr=b&sp=r&sig=nKiFh%2BghLTUQtSr4%2F%2FN4LMcEMrRkLUwJz3jI%2BH%2BqAp4%3D)
2026-03-28 22:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059463/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FT61VUR/42811133?sv=2020-08-04&st=2026-03-28T22%3A02%3A36Z&se=2026-03-28T22%3A27%3A36Z&sr=b&sp=r&sig=9EPcV3ym6qVnTW2kEyVvxbtoQKt2ehb%2B25xAT3tRiJ0%3D)
2026-03-28 22:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970584/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970584>
2026-03-28 22:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188743/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO61OVX/42811349?sv=2020-08-04&st=2026-03-28T22%3A02%3A37Z&se=2026-03-28T22%3A27%3A37Z&sr=b&sp=r&sig=nKiFh%2BghLTUQtSr4%2F%2FN4LMcEMrRkLUwJz3jI%2BH%2BqAp4%3D)
2026-03-28 22:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970534/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK63FTA/42810748?sv=2020-08-04&st=2026-03-28T22%3A02%3A37Z&se=2026-03-28T22%3A27%3A37Z&sr=b&sp=r&sig=8idsaRiqkBW%2F4yV9GfTbfGTdARozLnFNkkZDloB%2BwtQ%3D)
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188241%27 HTTP/1.1" 200 None
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188241 not downloaded yet
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471166d0>
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2337f209-45ff-57b7-b370-ccb04b4d58bb/2337f209-45ff-57b7-b370-ccb04b4d58bb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO61OVX%252F699188728%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188728/600 saved to cache
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2337f209-45ff-57b7-b370-ccb04b4d58bb
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188252%27 HTTP/1.1" 200 None
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188252 not downloaded yet
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188267%27 HTTP/1.1" 200 None
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188267 not downloaded yet
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557644ed0>
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45df846-9de9-5dca-bfcb-dcf57dc2b59b/a45df846-9de9-5dca-bfcb-dcf57dc2b59b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFT61VUR%252F699059473%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059473/600 saved to cache
2026-03-28 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a45df846-9de9-5dca-bfcb-dcf57dc2b59b
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547342850>
2026-03-28 22:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45df846-9de9-5dca-bfcb-dcf57dc2b59b/a45df846-9de9-5dca-bfcb-dcf57dc2b59b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFT61VUR%252F699059482%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059482/600 saved to cache
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a45df846-9de9-5dca-bfcb-dcf57dc2b59b
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474ee350>
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2337f209-45ff-57b7-b370-ccb04b4d58bb/2337f209-45ff-57b7-b370-ccb04b4d58bb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO61OVX%252F699188735%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188735/600 saved to cache
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2337f209-45ff-57b7-b370-ccb04b4d58bb
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477ed610>
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2337f209-45ff-57b7-b370-ccb04b4d58bb/2337f209-45ff-57b7-b370-ccb04b4d58bb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO61OVX%252F699188720%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188720/600 saved to cache
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2337f209-45ff-57b7-b370-ccb04b4d58bb
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554280210>
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45df846-9de9-5dca-bfcb-dcf57dc2b59b/a45df846-9de9-5dca-bfcb-dcf57dc2b59b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFT61VUR%252F699059463%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059463/600 saved to cache
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a45df846-9de9-5dca-bfcb-dcf57dc2b59b
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557352050>
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2337f209-45ff-57b7-b370-ccb04b4d58bb/2337f209-45ff-57b7-b370-ccb04b4d58bb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO61OVX%252F699188743%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188743/600 saved to cache
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2337f209-45ff-57b7-b370-ccb04b4d58bb
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474aae90>
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f3242ee-badd-5243-9618-1a2a403b68bc/0f3242ee-badd-5243-9618-1a2a403b68bc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK63FTA%252F698970534%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970534/600 saved to cache
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f3242ee-badd-5243-9618-1a2a403b68bc
2026-03-28 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188747/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO61OVX/42811349?sv=2020-08-04&st=2026-03-28T22%3A02%3A37Z&se=2026-03-28T22%3A27%3A37Z&sr=b&sp=r&sig=nKiFh%2BghLTUQtSr4%2F%2FN4LMcEMrRkLUwJz3jI%2BH%2BqAp4%3D)
2026-03-28 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970558/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK63FTA/42810748?sv=2020-08-04&st=2026-03-28T22%3A02%3A37Z&se=2026-03-28T22%3A27%3A37Z&sr=b&sp=r&sig=8idsaRiqkBW%2F4yV9GfTbfGTdARozLnFNkkZDloB%2BwtQ%3D)
2026-03-28 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970546/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK63FTA/42810748?sv=2020-08-04&st=2026-03-28T22%3A02%3A37Z&se=2026-03-28T22%3A27%3A37Z&sr=b&sp=r&sig=8idsaRiqkBW%2F4yV9GfTbfGTdARozLnFNkkZDloB%2BwtQ%3D)
2026-03-28 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059493/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FT61VUR/42811133?sv=2020-08-04&st=2026-03-28T22%3A02%3A36Z&se=2026-03-28T22%3A27%3A36Z&sr=b&sp=r&sig=9EPcV3ym6qVnTW2kEyVvxbtoQKt2ehb%2B25xAT3tRiJ0%3D)
2026-03-28 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970624/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970624>
2026-03-28 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188206/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AY07YBB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188281%27 HTTP/1.1" 200 None
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188281 not downloaded yet
2026-03-28 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059517/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FT61VUR/42811133?sv=2020-08-04&st=2026-03-28T22%3A02%3A36Z&se=2026-03-28T22%3A27%3A36Z&sr=b&sp=r&sig=9EPcV3ym6qVnTW2kEyVvxbtoQKt2ehb%2B25xAT3tRiJ0%3D)
2026-03-28 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188758/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO61OVX/42811349?sv=2020-08-04&st=2026-03-28T22%3A02%3A37Z&se=2026-03-28T22%3A27%3A37Z&sr=b&sp=r&sig=nKiFh%2BghLTUQtSr4%2F%2FN4LMcEMrRkLUwJz3jI%2BH%2BqAp4%3D)
2026-03-28 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970642/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970642>
2026-03-28 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970584/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK63FTA/42810748?sv=2020-08-04&st=2026-03-28T22%3A02%3A37Z&se=2026-03-28T22%3A27%3A37Z&sr=b&sp=r&sig=8idsaRiqkBW%2F4yV9GfTbfGTdARozLnFNkkZDloB%2BwtQ%3D)
2026-03-28 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970663/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970663>
2026-03-28 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188230/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188230>
2026-03-28 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188226/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188226>
2026-03-28 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188214/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188214>
2026-03-28 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188220/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188220>
2026-03-28 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188210/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188210>
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547206690>
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2337f209-45ff-57b7-b370-ccb04b4d58bb/2337f209-45ff-57b7-b370-ccb04b4d58bb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO61OVX%252F699188747%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188747/600 saved to cache
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2337f209-45ff-57b7-b370-ccb04b4d58bb
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54748e050>
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f3242ee-badd-5243-9618-1a2a403b68bc/0f3242ee-badd-5243-9618-1a2a403b68bc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK63FTA%252F698970558%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970558/600 saved to cache
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f3242ee-badd-5243-9618-1a2a403b68bc
2026-03-28 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188206/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AY07YBB/42808352?sv=2020-08-04&st=2026-03-28T22%3A02%3A39Z&se=2026-03-28T22%3A27%3A39Z&sr=b&sp=r&sig=Dfk%2FNspBeNvt2pzTxiDfwj74xvwCYMq4zUUm1N9YYwk%3D)
2026-03-28 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188252/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188252>
2026-03-28 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970591/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970591>
2026-03-28 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188267/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188267>
2026-03-28 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188241/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188241>
2026-03-28 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970612/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970612>
2026-03-28 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188797/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188797>
2026-03-28 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970624/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK63FTA/42810748?sv=2020-08-04&st=2026-03-28T22%3A02%3A37Z&se=2026-03-28T22%3A27%3A37Z&sr=b&sp=r&sig=8idsaRiqkBW%2F4yV9GfTbfGTdARozLnFNkkZDloB%2BwtQ%3D)
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556fbfe10>
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f3242ee-badd-5243-9618-1a2a403b68bc/0f3242ee-badd-5243-9618-1a2a403b68bc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK63FTA%252F698970546%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970546/600 saved to cache
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f3242ee-badd-5243-9618-1a2a403b68bc
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547207110>
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45df846-9de9-5dca-bfcb-dcf57dc2b59b/a45df846-9de9-5dca-bfcb-dcf57dc2b59b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFT61VUR%252F699059493%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059493/600 saved to cache
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a45df846-9de9-5dca-bfcb-dcf57dc2b59b
2026-03-28 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54777d910>
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45df846-9de9-5dca-bfcb-dcf57dc2b59b/a45df846-9de9-5dca-bfcb-dcf57dc2b59b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFT61VUR%252F699059517%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059517/600 saved to cache
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a45df846-9de9-5dca-bfcb-dcf57dc2b59b
2026-03-28 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54777d5d0>
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2337f209-45ff-57b7-b370-ccb04b4d58bb/2337f209-45ff-57b7-b370-ccb04b4d58bb_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO61OVX%252F699188758%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188758/600 saved to cache
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2337f209-45ff-57b7-b370-ccb04b4d58bb
2026-03-28 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970642/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK63FTA/42810748?sv=2020-08-04&st=2026-03-28T22%3A02%3A37Z&se=2026-03-28T22%3A27%3A37Z&sr=b&sp=r&sig=8idsaRiqkBW%2F4yV9GfTbfGTdARozLnFNkkZDloB%2BwtQ%3D)
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472243d0>
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f3242ee-badd-5243-9618-1a2a403b68bc/0f3242ee-badd-5243-9618-1a2a403b68bc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK63FTA%252F698970584%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970584/600 saved to cache
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f3242ee-badd-5243-9618-1a2a403b68bc
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547265490>
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88817b86-325c-592c-b16f-dff4dccb2371/88817b86-325c-592c-b16f-dff4dccb2371_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAY07YBB%252F699188206%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188206/600 saved to cache
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88817b86-325c-592c-b16f-dff4dccb2371
2026-03-28 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b61810>
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f3242ee-badd-5243-9618-1a2a403b68bc/0f3242ee-badd-5243-9618-1a2a403b68bc_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK63FTA%252F698970624%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970624/600 saved to cache
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f3242ee-badd-5243-9618-1a2a403b68bc
2026-03-28 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188230/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AY07YBB/42808352?sv=2020-08-04&st=2026-03-28T22%3A02%3A39Z&se=2026-03-28T22%3A27%3A39Z&sr=b&sp=r&sig=Dfk%2FNspBeNvt2pzTxiDfwj74xvwCYMq4zUUm1N9YYwk%3D)
2026-03-28 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188220/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AY07YBB/42808352?sv=2020-08-04&st=2026-03-28T22%3A02%3A39Z&se=2026-03-28T22%3A27%3A39Z&sr=b&sp=r&sig=Dfk%2FNspBeNvt2pzTxiDfwj74xvwCYMq4zUUm1N9YYwk%3D)
2026-03-28 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188226/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AY07YBB/42808352?sv=2020-08-04&st=2026-03-28T22%3A02%3A39Z&se=2026-03-28T22%3A27%3A39Z&sr=b&sp=r&sig=Dfk%2FNspBeNvt2pzTxiDfwj74xvwCYMq4zUUm1N9YYwk%3D)
2026-03-28 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188214/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AY07YBB/42808352?sv=2020-08-04&st=2026-03-28T22%3A02%3A39Z&se=2026-03-28T22%3A27%3A39Z&sr=b&sp=r&sig=Dfk%2FNspBeNvt2pzTxiDfwj74xvwCYMq4zUUm1N9YYwk%3D)
2026-03-28 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188210/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AY07YBB/42808352?sv=2020-08-04&st=2026-03-28T22%3A02%3A39Z&se=2026-03-28T22%3A27%3A39Z&sr=b&sp=r&sig=Dfk%2FNspBeNvt2pzTxiDfwj74xvwCYMq4zUUm1N9YYwk%3D)
2026-03-28 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188281/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188281>
2026-03-28 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970663/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK63FTA/42810748?sv=2020-08-04&st=2026-03-28T22%3A02%3A37Z&se=2026-03-28T22%3A27%3A37Z&sr=b&sp=r&sig=8idsaRiqkBW%2F4yV9GfTbfGTdARozLnFNkkZDloB%2BwtQ%3D)
2026-03-28 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b61ad0>
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f3242ee-badd-5243-9618-1a2a403b68bc/0f3242ee-badd-5243-9618-1a2a403b68bc_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK63FTA%252F698970642%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970642/600 saved to cache
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f3242ee-badd-5243-9618-1a2a403b68bc
2026-03-28 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059572/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059572>
2026-03-28 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188241/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AY07YBB/42808352?sv=2020-08-04&st=2026-03-28T22%3A02%3A39Z&se=2026-03-28T22%3A27%3A39Z&sr=b&sp=r&sig=Dfk%2FNspBeNvt2pzTxiDfwj74xvwCYMq4zUUm1N9YYwk%3D)
2026-03-28 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188267/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AY07YBB/42808352?sv=2020-08-04&st=2026-03-28T22%3A02%3A39Z&se=2026-03-28T22%3A27%3A39Z&sr=b&sp=r&sig=Dfk%2FNspBeNvt2pzTxiDfwj74xvwCYMq4zUUm1N9YYwk%3D)
2026-03-28 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970591/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK63FTA/42810748?sv=2020-08-04&st=2026-03-28T22%3A02%3A37Z&se=2026-03-28T22%3A27%3A37Z&sr=b&sp=r&sig=8idsaRiqkBW%2F4yV9GfTbfGTdARozLnFNkkZDloB%2BwtQ%3D)
2026-03-28 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970612/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK63FTA/42810748?sv=2020-08-04&st=2026-03-28T22%3A02%3A37Z&se=2026-03-28T22%3A27%3A37Z&sr=b&sp=r&sig=8idsaRiqkBW%2F4yV9GfTbfGTdARozLnFNkkZDloB%2BwtQ%3D)
2026-03-28 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188252/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AY07YBB/42808352?sv=2020-08-04&st=2026-03-28T22%3A02%3A39Z&se=2026-03-28T22%3A27%3A39Z&sr=b&sp=r&sig=Dfk%2FNspBeNvt2pzTxiDfwj74xvwCYMq4zUUm1N9YYwk%3D)
2026-03-28 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188797/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO61OVX/42811349?sv=2020-08-04&st=2026-03-28T22%3A02%3A37Z&se=2026-03-28T22%3A27%3A37Z&sr=b&sp=r&sig=nKiFh%2BghLTUQtSr4%2F%2FN4LMcEMrRkLUwJz3jI%2BH%2BqAp4%3D)
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473fba10>
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88817b86-325c-592c-b16f-dff4dccb2371/88817b86-325c-592c-b16f-dff4dccb2371_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAY07YBB%252F699188230%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188230/600 saved to cache
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 88817b86-325c-592c-b16f-dff4dccb2371
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471353d0>
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88817b86-325c-592c-b16f-dff4dccb2371/88817b86-325c-592c-b16f-dff4dccb2371_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAY07YBB%252F699188220%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188220/600 saved to cache
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 88817b86-325c-592c-b16f-dff4dccb2371
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555033290>
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88817b86-325c-592c-b16f-dff4dccb2371/88817b86-325c-592c-b16f-dff4dccb2371_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAY07YBB%252F699188226%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188226/600 saved to cache
2026-03-28 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 88817b86-325c-592c-b16f-dff4dccb2371
2026-03-28 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188784/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188784>
2026-03-28 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059557/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059557>
2026-03-28 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188772/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188772>
2026-03-28 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059540/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059540>
2026-03-28 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970570/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970570>
2026-03-28 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189685/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189685>
2026-03-28 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059451/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059451>
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5572a0050>
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88817b86-325c-592c-b16f-dff4dccb2371/88817b86-325c-592c-b16f-dff4dccb2371_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAY07YBB%252F699188214%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188214/600 saved to cache
2026-03-28 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 88817b86-325c-592c-b16f-dff4dccb2371
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54728db50>
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88817b86-325c-592c-b16f-dff4dccb2371/88817b86-325c-592c-b16f-dff4dccb2371_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAY07YBB%252F699188210%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188210/600 saved to cache
2026-03-28 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 88817b86-325c-592c-b16f-dff4dccb2371
2026-03-28 22:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188281/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AY07YBB/42808352?sv=2020-08-04&st=2026-03-28T22%3A02%3A39Z&se=2026-03-28T22%3A27%3A39Z&sr=b&sp=r&sig=Dfk%2FNspBeNvt2pzTxiDfwj74xvwCYMq4zUUm1N9YYwk%3D)
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5572a12d0>
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f3242ee-badd-5243-9618-1a2a403b68bc/0f3242ee-badd-5243-9618-1a2a403b68bc_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK63FTA%252F698970663%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970663/600 saved to cache
2026-03-28 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f3242ee-badd-5243-9618-1a2a403b68bc
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54748cf10>
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88817b86-325c-592c-b16f-dff4dccb2371/88817b86-325c-592c-b16f-dff4dccb2371_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAY07YBB%252F699188241%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188241/600 saved to cache
2026-03-28 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 88817b86-325c-592c-b16f-dff4dccb2371
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477756d0>
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88817b86-325c-592c-b16f-dff4dccb2371/88817b86-325c-592c-b16f-dff4dccb2371_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAY07YBB%252F699188267%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188267/600 saved to cache
2026-03-28 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 88817b86-325c-592c-b16f-dff4dccb2371
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f83450>
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f3242ee-badd-5243-9618-1a2a403b68bc/0f3242ee-badd-5243-9618-1a2a403b68bc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK63FTA%252F698970591%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970591/600 saved to cache
2026-03-28 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f3242ee-badd-5243-9618-1a2a403b68bc
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477cead0>
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f3242ee-badd-5243-9618-1a2a403b68bc/0f3242ee-badd-5243-9618-1a2a403b68bc_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK63FTA%252F698970612%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970612/600 saved to cache
2026-03-28 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f3242ee-badd-5243-9618-1a2a403b68bc
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5572a12d0>
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88817b86-325c-592c-b16f-dff4dccb2371/88817b86-325c-592c-b16f-dff4dccb2371_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAY07YBB%252F699188252%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188252/600 saved to cache
2026-03-28 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 88817b86-325c-592c-b16f-dff4dccb2371
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547294750>
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2337f209-45ff-57b7-b370-ccb04b4d58bb/2337f209-45ff-57b7-b370-ccb04b4d58bb_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO61OVX%252F699188797%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188797/600 saved to cache
2026-03-28 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2337f209-45ff-57b7-b370-ccb04b4d58bb
2026-03-28 22:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189674/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189674>
2026-03-28 22:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126460/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126460>
2026-03-28 22:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994141/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994141>
2026-03-28 22:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110805/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110805>
2026-03-28 22:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031421/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031421>
2026-03-28 22:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059443/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FT61VUR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059572/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FT61VUR/42811133?sv=2020-08-04&st=2026-03-28T22%3A02%3A36Z&se=2026-03-28T22%3A27%3A36Z&sr=b&sp=r&sig=9EPcV3ym6qVnTW2kEyVvxbtoQKt2ehb%2B25xAT3tRiJ0%3D)
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f95350>
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88817b86-325c-592c-b16f-dff4dccb2371/88817b86-325c-592c-b16f-dff4dccb2371_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAY07YBB%252F699188281%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188281/600 saved to cache
2026-03-28 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 88817b86-325c-592c-b16f-dff4dccb2371
2026-03-28 22:02:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88817b86-325c-592c-b16f-dff4dccb2371, skipping ID generation
2026-03-28 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88817b86-325c-592c-b16f-dff4dccb2371 sending to next pipeline
2026-03-28 22:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 88817b86-325c-592c-b16f-dff4dccb2371, identifier: AY07%20YBB
2026-03-28 22:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 88817b86-325c-592c-b16f-dff4dccb2371 with identifier: AY07%20YBB
2026-03-28 22:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 88817b86-325c-592c-b16f-dff4dccb2371 with identifier: AY07%20YBB
2026-03-28 22:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 88817b86-325c-592c-b16f-dff4dccb2371 with identifier: AY07%20YBB to the API
2026-03-28 22:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188281/600>
{'auction_title': '',
'c_o_2_emission_value': 152,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88817b86-325c-592c-b16f-dff4dccb2371/88817b86-325c-592c-b16f-dff4dccb2371_expert_report_file_2786f728-0ab5-4aa3-87a6-721c45a50685.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AY07%20YBB-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '88817b86-325c-592c-b16f-dff4dccb2371',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AY07 YBB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AY07%20YBB&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 85179,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88817b86-325c-592c-b16f-dff4dccb2371/88817b86-325c-592c-b16f-dff4dccb2371_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40321,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188206/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88817b86-325c-592c-b16f-dff4dccb2371/88817b86-325c-592c-b16f-dff4dccb2371_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40074,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188210/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88817b86-325c-592c-b16f-dff4dccb2371/88817b86-325c-592c-b16f-dff4dccb2371_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37051,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188214/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88817b86-325c-592c-b16f-dff4dccb2371/88817b86-325c-592c-b16f-dff4dccb2371_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37544,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188220/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88817b86-325c-592c-b16f-dff4dccb2371/88817b86-325c-592c-b16f-dff4dccb2371_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35269,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188226/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88817b86-325c-592c-b16f-dff4dccb2371/88817b86-325c-592c-b16f-dff4dccb2371_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35289,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188230/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88817b86-325c-592c-b16f-dff4dccb2371/88817b86-325c-592c-b16f-dff4dccb2371_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73798,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188241/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88817b86-325c-592c-b16f-dff4dccb2371/88817b86-325c-592c-b16f-dff4dccb2371_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80320,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188252/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88817b86-325c-592c-b16f-dff4dccb2371/88817b86-325c-592c-b16f-dff4dccb2371_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78308,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188267/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88817b86-325c-592c-b16f-dff4dccb2371/88817b86-325c-592c-b16f-dff4dccb2371_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67952,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AY07YBB/699188281/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.4 S 80 Hatchback',
'transmission': 'manual',
'trim': 'S 80',
'vin': 'WVWZZZ9NZ7Y133445',
'year': 2007}
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY07%2520YBB%27 HTTP/1.1" 200 None
2026-03-28 22:02:45 [bca.uk] INFO: Saving data for AY07%20YBB: {'created_time': 1774735365.17831, 'last_price_update_time': 1774735365.178321, 'auction_closing_time': 1774864800.0}
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AY07%2520YBB') HTTP/1.1" 204 0
2026-03-28 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059451/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FT61VUR/42811133?sv=2020-08-04&st=2026-03-28T22%3A02%3A36Z&se=2026-03-28T22%3A27%3A36Z&sr=b&sp=r&sig=9EPcV3ym6qVnTW2kEyVvxbtoQKt2ehb%2B25xAT3tRiJ0%3D)
2026-03-28 22:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126462/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126462>
2026-03-28 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970570/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK63FTA/42810748?sv=2020-08-04&st=2026-03-28T22%3A02%3A37Z&se=2026-03-28T22%3A27%3A37Z&sr=b&sp=r&sig=8idsaRiqkBW%2F4yV9GfTbfGTdARozLnFNkkZDloB%2BwtQ%3D)
2026-03-28 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059557/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FT61VUR/42811133?sv=2020-08-04&st=2026-03-28T22%3A02%3A36Z&se=2026-03-28T22%3A27%3A36Z&sr=b&sp=r&sig=9EPcV3ym6qVnTW2kEyVvxbtoQKt2ehb%2B25xAT3tRiJ0%3D)
2026-03-28 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188772/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO61OVX/42811349?sv=2020-08-04&st=2026-03-28T22%3A02%3A37Z&se=2026-03-28T22%3A27%3A37Z&sr=b&sp=r&sig=nKiFh%2BghLTUQtSr4%2F%2FN4LMcEMrRkLUwJz3jI%2BH%2BqAp4%3D)
2026-03-28 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059540/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FT61VUR/42811133?sv=2020-08-04&st=2026-03-28T22%3A02%3A36Z&se=2026-03-28T22%3A27%3A36Z&sr=b&sp=r&sig=9EPcV3ym6qVnTW2kEyVvxbtoQKt2ehb%2B25xAT3tRiJ0%3D)
2026-03-28 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189685/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN12FKU/42809435?sv=2020-08-04&st=2026-03-28T22%3A02%3A35Z&se=2026-03-28T22%3A27%3A35Z&sr=b&sp=r&sig=KURQ7%2BDcQieniADy6RBY8RB62E6DkA7BIBHi9pIH93M%3D)
2026-03-28 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188784/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO61OVX/42811349?sv=2020-08-04&st=2026-03-28T22%3A02%3A37Z&se=2026-03-28T22%3A27%3A37Z&sr=b&sp=r&sig=nKiFh%2BghLTUQtSr4%2F%2FN4LMcEMrRkLUwJz3jI%2BH%2BqAp4%3D)
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554808690>
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45df846-9de9-5dca-bfcb-dcf57dc2b59b/a45df846-9de9-5dca-bfcb-dcf57dc2b59b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFT61VUR%252F699059572%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059572/600 saved to cache
2026-03-28 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a45df846-9de9-5dca-bfcb-dcf57dc2b59b
2026-03-28 22:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074200/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074200>
2026-03-28 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031421/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ68UWN/42811039?sv=2020-08-04&st=2026-03-28T22%3A01%3A10Z&se=2026-03-28T22%3A26%3A10Z&sr=b&sp=r&sig=1ZiFBHKVUwguyFOSNXk0RG8MN%2BDlXzRukHPnqyWqOFk%3D)
2026-03-28 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059443/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FT61VUR/42811133?sv=2020-08-04&st=2026-03-28T22%3A02%3A36Z&se=2026-03-28T22%3A27%3A36Z&sr=b&sp=r&sig=9EPcV3ym6qVnTW2kEyVvxbtoQKt2ehb%2B25xAT3tRiJ0%3D)
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473048d0>
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45df846-9de9-5dca-bfcb-dcf57dc2b59b/a45df846-9de9-5dca-bfcb-dcf57dc2b59b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFT61VUR%252F699059451%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059451/600 saved to cache
2026-03-28 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a45df846-9de9-5dca-bfcb-dcf57dc2b59b
2026-03-28 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110805/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ70EHU/42811341?sv=2020-08-04&st=2026-03-28T22%3A01%3A12Z&se=2026-03-28T22%3A26%3A12Z&sr=b&sp=r&sig=jIMEwQ1nhHjk3xUWtYxp4DaMU%2Fd7rUcdJRYrXhJEbps%3D)
2026-03-28 22:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081056/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081056>
2026-03-28 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189674/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN12FKU/42809435?sv=2020-08-04&st=2026-03-28T22%3A02%3A35Z&se=2026-03-28T22%3A27%3A35Z&sr=b&sp=r&sig=KURQ7%2BDcQieniADy6RBY8RB62E6DkA7BIBHi9pIH93M%3D)
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547116b10>
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f3242ee-badd-5243-9618-1a2a403b68bc/0f3242ee-badd-5243-9618-1a2a403b68bc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK63FTA%252F698970570%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970570/600 saved to cache
2026-03-28 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f3242ee-badd-5243-9618-1a2a403b68bc
2026-03-28 22:02:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f3242ee-badd-5243-9618-1a2a403b68bc, skipping ID generation
2026-03-28 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f3242ee-badd-5243-9618-1a2a403b68bc sending to next pipeline
2026-03-28 22:02:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0f3242ee-badd-5243-9618-1a2a403b68bc, identifier: EK63%20FTA
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554557210>
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45df846-9de9-5dca-bfcb-dcf57dc2b59b/a45df846-9de9-5dca-bfcb-dcf57dc2b59b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFT61VUR%252F699059557%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059557/600 saved to cache
2026-03-28 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a45df846-9de9-5dca-bfcb-dcf57dc2b59b
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b5650>
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2337f209-45ff-57b7-b370-ccb04b4d58bb/2337f209-45ff-57b7-b370-ccb04b4d58bb_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO61OVX%252F699188772%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188772/600 saved to cache
2026-03-28 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2337f209-45ff-57b7-b370-ccb04b4d58bb
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473d9a10>
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45df846-9de9-5dca-bfcb-dcf57dc2b59b/a45df846-9de9-5dca-bfcb-dcf57dc2b59b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFT61VUR%252F699059540%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059540/600 saved to cache
2026-03-28 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a45df846-9de9-5dca-bfcb-dcf57dc2b59b
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b4610>
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30726c84-9b6d-55d7-85ab-840199d36e87/30726c84-9b6d-55d7-85ab-840199d36e87_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN12FKU%252F699189685%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189685/600 saved to cache
2026-03-28 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 30726c84-9b6d-55d7-85ab-840199d36e87
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543ddc90>
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2337f209-45ff-57b7-b370-ccb04b4d58bb/2337f209-45ff-57b7-b370-ccb04b4d58bb_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO61OVX%252F699188784%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188784/600 saved to cache
2026-03-28 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2337f209-45ff-57b7-b370-ccb04b4d58bb
2026-03-28 22:02:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2337f209-45ff-57b7-b370-ccb04b4d58bb, skipping ID generation
2026-03-28 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2337f209-45ff-57b7-b370-ccb04b4d58bb sending to next pipeline
2026-03-28 22:02:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2337f209-45ff-57b7-b370-ccb04b4d58bb, identifier: EO61%20OVX
2026-03-28 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126462/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT70TDO/42811400?sv=2020-08-04&st=2026-03-28T22%3A01%3A09Z&se=2026-03-28T22%3A26%3A09Z&sr=b&sp=r&sig=sz4G2m%2Bww1tbH3aSNvJ2DJLyecaaL3NNq%2FlejxEYTpI%3D)
2026-03-28 22:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285828/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285828>
2026-03-28 22:02:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0f3242ee-badd-5243-9618-1a2a403b68bc with identifier: EK63%20FTA
2026-03-28 22:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0f3242ee-badd-5243-9618-1a2a403b68bc with identifier: EK63%20FTA
2026-03-28 22:02:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0f3242ee-badd-5243-9618-1a2a403b68bc with identifier: EK63%20FTA to the API
2026-03-28 22:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970570/600>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f3242ee-badd-5243-9618-1a2a403b68bc/0f3242ee-badd-5243-9618-1a2a403b68bc_expert_report_file_83070fc3-3599-4774-8db8-16b2f2ccbee1.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EK63%20FTA-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0f3242ee-badd-5243-9618-1a2a403b68bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EK63 FTA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EK63%20FTA&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'HONDA',
'model': 'CIVIC',
'odometer': 101706,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f3242ee-badd-5243-9618-1a2a403b68bc/0f3242ee-badd-5243-9618-1a2a403b68bc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46095,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970534/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f3242ee-badd-5243-9618-1a2a403b68bc/0f3242ee-badd-5243-9618-1a2a403b68bc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45277,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970546/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f3242ee-badd-5243-9618-1a2a403b68bc/0f3242ee-badd-5243-9618-1a2a403b68bc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44508,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970558/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f3242ee-badd-5243-9618-1a2a403b68bc/0f3242ee-badd-5243-9618-1a2a403b68bc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42131,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970570/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f3242ee-badd-5243-9618-1a2a403b68bc/0f3242ee-badd-5243-9618-1a2a403b68bc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37170,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970584/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f3242ee-badd-5243-9618-1a2a403b68bc/0f3242ee-badd-5243-9618-1a2a403b68bc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37424,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970591/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f3242ee-badd-5243-9618-1a2a403b68bc/0f3242ee-badd-5243-9618-1a2a403b68bc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91764,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970612/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f3242ee-badd-5243-9618-1a2a403b68bc/0f3242ee-badd-5243-9618-1a2a403b68bc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69112,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970624/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f3242ee-badd-5243-9618-1a2a403b68bc/0f3242ee-badd-5243-9618-1a2a403b68bc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86293,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970642/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f3242ee-badd-5243-9618-1a2a403b68bc/0f3242ee-badd-5243-9618-1a2a403b68bc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70841,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK63FTA/698970663/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'HONDA CIVIC 1.4 I-VTEC SE Hatchback',
'transmission': 'manual',
'trim': 'I-VTEC SE',
'vin': 'SHHFK1740DU005427',
'year': 2013}
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK63%2520FTA%27 HTTP/1.1" 200 None
2026-03-28 22:02:46 [bca.uk] INFO: Saving data for EK63%20FTA: {'created_time': 1774735366.182169, 'last_price_update_time': 1774735366.182178, 'auction_closing_time': 1774864800.0}
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EK63%2520FTA') HTTP/1.1" 204 0
2026-03-28 22:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2337f209-45ff-57b7-b370-ccb04b4d58bb with identifier: EO61%20OVX
2026-03-28 22:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2337f209-45ff-57b7-b370-ccb04b4d58bb with identifier: EO61%20OVX
2026-03-28 22:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2337f209-45ff-57b7-b370-ccb04b4d58bb with identifier: EO61%20OVX to the API
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188784/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2337f209-45ff-57b7-b370-ccb04b4d58bb/2337f209-45ff-57b7-b370-ccb04b4d58bb_expert_report_file_68bcd446-dde9-4332-8063-3a5b0a9f763b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EO61%20OVX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2337f209-45ff-57b7-b370-ccb04b4d58bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EO61 OVX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EO61%20OVX&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'MINI',
'model': 'COOPER',
'odometer': 79851,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2337f209-45ff-57b7-b370-ccb04b4d58bb/2337f209-45ff-57b7-b370-ccb04b4d58bb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40643,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188715/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2337f209-45ff-57b7-b370-ccb04b4d58bb/2337f209-45ff-57b7-b370-ccb04b4d58bb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40435,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188720/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2337f209-45ff-57b7-b370-ccb04b4d58bb/2337f209-45ff-57b7-b370-ccb04b4d58bb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38224,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188728/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2337f209-45ff-57b7-b370-ccb04b4d58bb/2337f209-45ff-57b7-b370-ccb04b4d58bb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38834,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188735/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2337f209-45ff-57b7-b370-ccb04b4d58bb/2337f209-45ff-57b7-b370-ccb04b4d58bb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35124,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188743/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2337f209-45ff-57b7-b370-ccb04b4d58bb/2337f209-45ff-57b7-b370-ccb04b4d58bb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35940,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188747/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2337f209-45ff-57b7-b370-ccb04b4d58bb/2337f209-45ff-57b7-b370-ccb04b4d58bb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85805,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188758/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2337f209-45ff-57b7-b370-ccb04b4d58bb/2337f209-45ff-57b7-b370-ccb04b4d58bb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73886,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188772/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2337f209-45ff-57b7-b370-ccb04b4d58bb/2337f209-45ff-57b7-b370-ccb04b4d58bb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95063,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188784/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2337f209-45ff-57b7-b370-ccb04b4d58bb/2337f209-45ff-57b7-b370-ccb04b4d58bb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94509,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO61OVX/699188797/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'MINI COOPER 1.6 S Convertible',
'transmission': 'manual',
'trim': 'S',
'vin': 'WMWZP32050TY87687',
'year': 2011}
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO61%2520OVX%27 HTTP/1.1" 200 None
2026-03-28 22:02:46 [bca.uk] INFO: Saving data for EO61%20OVX: {'created_time': 1774735366.573635, 'last_price_update_time': 1774735366.573647, 'auction_closing_time': 1774864800.0}
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EO61%2520OVX') HTTP/1.1" 204 0
2026-03-28 22:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126460/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT19CVS/42811387?sv=2020-08-04&st=2026-03-28T22%3A01%3A08Z&se=2026-03-28T22%3A26%3A08Z&sr=b&sp=r&sig=Xezo2YoS0t9x6abxzIwcxCNA1wXAbFztVA4zM%2F%2Bntk8%3D)
2026-03-28 22:02:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981179/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981179>
2026-03-28 22:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994141/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN63OLH/42810834?sv=2020-08-04&st=2026-03-28T22%3A01%3A09Z&se=2026-03-28T22%3A26%3A09Z&sr=b&sp=r&sig=NMpNDT8TSdoKfgfMWv1wobNIeXn3SgscjQpSI5aPQXk%3D)
2026-03-28 22:02:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058625/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058625>
2026-03-28 22:02:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966059/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966059>
2026-03-28 22:02:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK60YGR/42810557?sv=2020-08-04&st=2026-03-28T22%3A02%3A45Z&se=2026-03-28T22%3A27%3A45Z&sr=b&sp=r&sig=lfQwNL0RjYiP29It%2FA%2FLLtjFCBW9HSDzJKoNh8e2V4U%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AK60%20YGR-GB>
2026-03-28 22:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474b8310>
2026-03-28 22:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f05d113-747f-52ed-a1ad-9799bad35377/7f05d113-747f-52ed-a1ad-9799bad35377_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ68UWN%252F699031421%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031421/600 saved to cache
2026-03-28 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f05d113-747f-52ed-a1ad-9799bad35377
2026-03-28 22:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b51ed0>
2026-03-28 22:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45df846-9de9-5dca-bfcb-dcf57dc2b59b/a45df846-9de9-5dca-bfcb-dcf57dc2b59b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFT61VUR%252F699059443%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059443/600 saved to cache
2026-03-28 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a45df846-9de9-5dca-bfcb-dcf57dc2b59b
2026-03-28 22:02:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a45df846-9de9-5dca-bfcb-dcf57dc2b59b, skipping ID generation
2026-03-28 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a45df846-9de9-5dca-bfcb-dcf57dc2b59b sending to next pipeline
2026-03-28 22:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a45df846-9de9-5dca-bfcb-dcf57dc2b59b, identifier: FT61%20VUR
2026-03-28 22:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474bb450>
2026-03-28 22:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf35b337-845e-537f-a976-08188cca66f3/cf35b337-845e-537f-a976-08188cca66f3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ70EHU%252F699110805%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110805/600 saved to cache
2026-03-28 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf35b337-845e-537f-a976-08188cca66f3
2026-03-28 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547278ed0>
2026-03-28 22:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30726c84-9b6d-55d7-85ab-840199d36e87/30726c84-9b6d-55d7-85ab-840199d36e87_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN12FKU%252F699189674%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189674/600 saved to cache
2026-03-28 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 30726c84-9b6d-55d7-85ab-840199d36e87
2026-03-28 22:02:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30726c84-9b6d-55d7-85ab-840199d36e87, skipping ID generation
2026-03-28 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30726c84-9b6d-55d7-85ab-840199d36e87 sending to next pipeline
2026-03-28 22:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 30726c84-9b6d-55d7-85ab-840199d36e87, identifier: WN12%20FKU
2026-03-28 22:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54747ac50>
2026-03-28 22:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d540cd8f-d715-5405-a8d5-11721b31b439/d540cd8f-d715-5405-a8d5-11721b31b439_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT70TDO%252F699126462%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126462/600 saved to cache
2026-03-28 22:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d540cd8f-d715-5405-a8d5-11721b31b439
2026-03-28 22:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a45df846-9de9-5dca-bfcb-dcf57dc2b59b with identifier: FT61%20VUR
2026-03-28 22:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a45df846-9de9-5dca-bfcb-dcf57dc2b59b with identifier: FT61%20VUR
2026-03-28 22:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a45df846-9de9-5dca-bfcb-dcf57dc2b59b with identifier: FT61%20VUR to the API
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059443/600>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45df846-9de9-5dca-bfcb-dcf57dc2b59b/a45df846-9de9-5dca-bfcb-dcf57dc2b59b_expert_report_file_d62c1a3e-6cb3-4879-8ac2-c93f5785b654.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FT61%20VUR-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a45df846-9de9-5dca-bfcb-dcf57dc2b59b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FT61 VUR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FT61%20VUR&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'AUDI',
'model': 'A4 AVANT',
'odometer': 146097,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45df846-9de9-5dca-bfcb-dcf57dc2b59b/a45df846-9de9-5dca-bfcb-dcf57dc2b59b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48571,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059443/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45df846-9de9-5dca-bfcb-dcf57dc2b59b/a45df846-9de9-5dca-bfcb-dcf57dc2b59b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44065,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059451/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45df846-9de9-5dca-bfcb-dcf57dc2b59b/a45df846-9de9-5dca-bfcb-dcf57dc2b59b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45793,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059463/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45df846-9de9-5dca-bfcb-dcf57dc2b59b/a45df846-9de9-5dca-bfcb-dcf57dc2b59b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43018,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059473/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45df846-9de9-5dca-bfcb-dcf57dc2b59b/a45df846-9de9-5dca-bfcb-dcf57dc2b59b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38308,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059482/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45df846-9de9-5dca-bfcb-dcf57dc2b59b/a45df846-9de9-5dca-bfcb-dcf57dc2b59b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35671,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059493/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45df846-9de9-5dca-bfcb-dcf57dc2b59b/a45df846-9de9-5dca-bfcb-dcf57dc2b59b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90577,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059517/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45df846-9de9-5dca-bfcb-dcf57dc2b59b/a45df846-9de9-5dca-bfcb-dcf57dc2b59b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86578,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059540/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45df846-9de9-5dca-bfcb-dcf57dc2b59b/a45df846-9de9-5dca-bfcb-dcf57dc2b59b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83489,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059557/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45df846-9de9-5dca-bfcb-dcf57dc2b59b/a45df846-9de9-5dca-bfcb-dcf57dc2b59b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78169,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FT61VUR/699059572/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'AUDI A4 AVANT 2.0 TDI 143 SE M-T Estate',
'transmission': 'manual',
'trim': 'TDI 143 SE M-T',
'vin': 'WAUZZZ8K5DA004856',
'year': 2012}
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT61%2520VUR%27 HTTP/1.1" 200 None
2026-03-28 22:02:47 [bca.uk] INFO: Saving data for FT61%20VUR: {'created_time': 1774735367.385299, 'last_price_update_time': 1774735367.38531, 'auction_closing_time': 1774864800.0}
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FT61%2520VUR') HTTP/1.1" 204 0
2026-03-28 22:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 30726c84-9b6d-55d7-85ab-840199d36e87 with identifier: WN12%20FKU
2026-03-28 22:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 30726c84-9b6d-55d7-85ab-840199d36e87 with identifier: WN12%20FKU
2026-03-28 22:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 30726c84-9b6d-55d7-85ab-840199d36e87 with identifier: WN12%20FKU to the API
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189674/600>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30726c84-9b6d-55d7-85ab-840199d36e87/30726c84-9b6d-55d7-85ab-840199d36e87_expert_report_file_e6a583f4-6871-4080-84f5-8e7c4aa604c4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WN12%20FKU-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '30726c84-9b6d-55d7-85ab-840199d36e87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WN12 FKU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WN12%20FKU&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FIAT',
'model': '500',
'odometer': 73606,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30726c84-9b6d-55d7-85ab-840199d36e87/30726c84-9b6d-55d7-85ab-840199d36e87_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40383,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189593/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30726c84-9b6d-55d7-85ab-840199d36e87/30726c84-9b6d-55d7-85ab-840199d36e87_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40983,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189598/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30726c84-9b6d-55d7-85ab-840199d36e87/30726c84-9b6d-55d7-85ab-840199d36e87_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38296,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189607/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30726c84-9b6d-55d7-85ab-840199d36e87/30726c84-9b6d-55d7-85ab-840199d36e87_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39930,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189614/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30726c84-9b6d-55d7-85ab-840199d36e87/30726c84-9b6d-55d7-85ab-840199d36e87_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39559,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189618/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30726c84-9b6d-55d7-85ab-840199d36e87/30726c84-9b6d-55d7-85ab-840199d36e87_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38434,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189622/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30726c84-9b6d-55d7-85ab-840199d36e87/30726c84-9b6d-55d7-85ab-840199d36e87_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95398,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189637/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30726c84-9b6d-55d7-85ab-840199d36e87/30726c84-9b6d-55d7-85ab-840199d36e87_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83289,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189659/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30726c84-9b6d-55d7-85ab-840199d36e87/30726c84-9b6d-55d7-85ab-840199d36e87_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85086,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189674/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30726c84-9b6d-55d7-85ab-840199d36e87/30726c84-9b6d-55d7-85ab-840199d36e87_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90893,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN12FKU/699189685/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FIAT 500 1.2 LOUNGE S/S Hatchback',
'transmission': 'manual',
'trim': 'LOUNGE S/S',
'vin': 'ZFA31200000820523',
'year': 2012}
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN12%2520FKU%27 HTTP/1.1" 200 None
2026-03-28 22:02:47 [bca.uk] INFO: Saving data for WN12%20FKU: {'created_time': 1774735367.79219, 'last_price_update_time': 1774735367.792203, 'auction_closing_time': 1774864800.0}
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WN12%2520FKU') HTTP/1.1" 204 0
2026-03-28 22:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081056/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX68XHM/42809660?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=LehtVWZLTGCUq%2FHVaWaxVcM6eZjoYBHWl7BsrTTno54%3D)
2026-03-28 22:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074200/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV03RSZ/42811210?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=XPdxTou37%2FSrb2139PEgleDE82DPAqY3LhSbwh%2FScoQ%3D)
2026-03-28 22:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994130/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994130>
2026-03-28 22:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126433/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126433>
2026-03-28 22:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110796/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110796>
2026-03-28 22:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126439/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126439>
2026-03-28 22:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031407/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031407>
2026-03-28 22:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT07FBY/42810797?sv=2020-08-04&st=2026-03-28T22%3A02%3A46Z&se=2026-03-28T22%3A27%3A46Z&sr=b&sp=r&sig=Ocei6JJU1dwDaO5Faxnq3iQo5eTP1n10igBRAXI9SK4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT07%20FBY-GB>
2026-03-28 22:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543e9590>
2026-03-28 22:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b3f5c4-70ca-530a-a56a-701b7ee98ebe/d2b3f5c4-70ca-530a-a56a-701b7ee98ebe_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT19CVS%252F699126460%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126460/600 saved to cache
2026-03-28 22:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2b3f5c4-70ca-530a-a56a-701b7ee98ebe
2026-03-28 22:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547158f50>
2026-03-28 22:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39f18d5c-38c9-5802-bc90-29e03976b40f/39f18d5c-38c9-5802-bc90-29e03976b40f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN63OLH%252F698994141%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994141/600 saved to cache
2026-03-28 22:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 39f18d5c-38c9-5802-bc90-29e03976b40f
2026-03-28 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b404d0>
2026-03-28 22:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502dec79-4436-5ea8-b8a4-1afd151a13a2/502dec79-4436-5ea8-b8a4-1afd151a13a2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX68XHM%252F699081056%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081056/600 saved to cache
2026-03-28 22:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 502dec79-4436-5ea8-b8a4-1afd151a13a2
2026-03-28 22:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473d9290>
2026-03-28 22:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8076e5d-cb8b-5578-9e3b-020e67e6d8b5/d8076e5d-cb8b-5578-9e3b-020e67e6d8b5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV03RSZ%252F699074200%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074200/600 saved to cache
2026-03-28 22:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d8076e5d-cb8b-5578-9e3b-020e67e6d8b5
2026-03-28 22:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074195/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074195>
2026-03-28 22:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285814/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285814>
2026-03-28 22:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081034/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081034>
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058625/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ12NEO/42811151?sv=2020-08-04&st=2026-03-28T22%3A01%3A05Z&se=2026-03-28T22%3A26%3A05Z&sr=b&sp=r&sig=62h1oUPBDkzrRTgiSRZPyg2OGFZw9gvgjM6%2Bng4Eeco%3D)
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966059/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD57OLK/42810740?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=6hm7fODnR3wBKimIVKSkEorWvM8%2B5kHNq4nMJt6A%2BvY%3D)
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981179/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND62EWM/42810799?sv=2020-08-04&st=2026-03-28T22%3A01%3A06Z&se=2026-03-28T22%3A26%3A06Z&sr=b&sp=r&sig=KD3C6SJzwrdEgIjlL7QRYHJfSgh8rbJ%2FPC%2F%2BEfVah7k%3D)
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285828/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV69BJO/42810768?sv=2020-08-04&st=2026-03-28T22%3A01%3A08Z&se=2026-03-28T22%3A26%3A08Z&sr=b&sp=r&sig=RhBgWIDbmwF%2F8XqW9pjzomUmOVaJM8ThWq2ap8w7j1M%3D)
2026-03-28 22:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981145/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981145>
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126433/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT19CVS/42811387?sv=2020-08-04&st=2026-03-28T22%3A01%3A08Z&se=2026-03-28T22%3A26%3A08Z&sr=b&sp=r&sig=Xezo2YoS0t9x6abxzIwcxCNA1wXAbFztVA4zM%2F%2Bntk8%3D)
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031407/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ68UWN/42811039?sv=2020-08-04&st=2026-03-28T22%3A01%3A10Z&se=2026-03-28T22%3A26%3A10Z&sr=b&sp=r&sig=1ZiFBHKVUwguyFOSNXk0RG8MN%2BDlXzRukHPnqyWqOFk%3D)
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK60YGR/42810557?sv=2020-08-04&st=2026-03-28T22%3A02%3A45Z&se=2026-03-28T22%3A27%3A45Z&sr=b&sp=r&sig=lfQwNL0RjYiP29It%2FA%2FLLtjFCBW9HSDzJKoNh8e2V4U%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126439/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT70TDO/42811400?sv=2020-08-04&st=2026-03-28T22%3A01%3A09Z&se=2026-03-28T22%3A26%3A09Z&sr=b&sp=r&sig=sz4G2m%2Bww1tbH3aSNvJ2DJLyecaaL3NNq%2FlejxEYTpI%3D)
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477d81d0>
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf9384a7-c2b5-5829-81c5-0ab07891768a/cf9384a7-c2b5-5829-81c5-0ab07891768a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ12NEO%252F699058625%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058625/600 saved to cache
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf9384a7-c2b5-5829-81c5-0ab07891768a
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473fa390>
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f1a744f-dcf7-513c-adf2-49d9ca828470/8f1a744f-dcf7-513c-adf2-49d9ca828470_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD57OLK%252F698966059%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966059/600 saved to cache
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8f1a744f-dcf7-513c-adf2-49d9ca828470
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472e6e90>
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc2a305-976b-5d20-86ca-43ed711c23db/1fc2a305-976b-5d20-86ca-43ed711c23db_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND62EWM%252F698981179%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981179/600 saved to cache
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1fc2a305-976b-5d20-86ca-43ed711c23db
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474b8550>
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbce9e71-f6f9-5b70-87a1-2cf7e0368db6/fbce9e71-f6f9-5b70-87a1-2cf7e0368db6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV69BJO%252F699285828%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285828/600 saved to cache
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fbce9e71-f6f9-5b70-87a1-2cf7e0368db6
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110796/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ70EHU/42811341?sv=2020-08-04&st=2026-03-28T22%3A01%3A12Z&se=2026-03-28T22%3A26%3A12Z&sr=b&sp=r&sig=jIMEwQ1nhHjk3xUWtYxp4DaMU%2Fd7rUcdJRYrXhJEbps%3D)
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994130/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN63OLH/42810834?sv=2020-08-04&st=2026-03-28T22%3A01%3A09Z&se=2026-03-28T22%3A26%3A09Z&sr=b&sp=r&sig=NMpNDT8TSdoKfgfMWv1wobNIeXn3SgscjQpSI5aPQXk%3D)
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081034/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX68XHM/42809660?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=LehtVWZLTGCUq%2FHVaWaxVcM6eZjoYBHWl7BsrTTno54%3D)
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285814/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV69BJO/42810768?sv=2020-08-04&st=2026-03-28T22%3A01%3A08Z&se=2026-03-28T22%3A26%3A08Z&sr=b&sp=r&sig=RhBgWIDbmwF%2F8XqW9pjzomUmOVaJM8ThWq2ap8w7j1M%3D)
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074195/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV03RSZ/42811210?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=XPdxTou37%2FSrb2139PEgleDE82DPAqY3LhSbwh%2FScoQ%3D)
2026-03-28 22:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966045/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966045>
2026-03-28 22:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058600/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058600>
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543dcf50>
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b3f5c4-70ca-530a-a56a-701b7ee98ebe/d2b3f5c4-70ca-530a-a56a-701b7ee98ebe_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT19CVS%252F699126433%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126433/600 saved to cache
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2b3f5c4-70ca-530a-a56a-701b7ee98ebe
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54777f050>
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f05d113-747f-52ed-a1ad-9799bad35377/7f05d113-747f-52ed-a1ad-9799bad35377_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ68UWN%252F699031407%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031407/600 saved to cache
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f05d113-747f-52ed-a1ad-9799bad35377
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fd44d0>
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c199cc4-2b6f-5122-8d05-996d23603f8a/1c199cc4-2b6f-5122-8d05-996d23603f8a_expert_report_file_bfcfc1cf-d6ca-4116-b5f0-a2b13a4801eb.pdf HTTP/1.1" 201 0
2026-03-28 22:02:48 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1c199cc4-2b6f-5122-8d05-996d23603f8a
2026-03-28 22:02:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c199cc4-2b6f-5122-8d05-996d23603f8a, skipping ID generation
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 1c199cc4-2b6f-5122-8d05-996d23603f8a
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAK60YGR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AK60YGR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a6d050>
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d540cd8f-d715-5405-a8d5-11721b31b439/d540cd8f-d715-5405-a8d5-11721b31b439_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT70TDO%252F699126439%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126439/600 saved to cache
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d540cd8f-d715-5405-a8d5-11721b31b439
2026-03-28 22:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031396/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031396>
2026-03-28 22:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY56ODW/42809574?sv=2020-08-04&st=2026-03-28T22%3A02%3A48Z&se=2026-03-28T22%3A27%3A48Z&sr=b&sp=r&sig=8fVzHiWrIaauGS6DCsPlv8wdZIhmrpcIGmHyoExhyuc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YY56%20ODW-GB>
2026-03-28 22:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110789/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BJ70EHU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994106/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994106>
2026-03-28 22:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126416/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126416>
2026-03-28 22:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VKZ2608/42811188?sv=2020-08-04&st=2026-03-28T22%3A02%3A48Z&se=2026-03-28T22%3A27%3A48Z&sr=b&sp=r&sig=YVDhW6ZhxmecwpaZ94EoTimfYWdl6%2B0eIaf2M%2FFyfB8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VKZ%202608-GB>
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981145/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND62EWM/42810799?sv=2020-08-04&st=2026-03-28T22%3A01%3A06Z&se=2026-03-28T22%3A26%3A06Z&sr=b&sp=r&sig=KD3C6SJzwrdEgIjlL7QRYHJfSgh8rbJ%2FPC%2F%2BEfVah7k%3D)
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698944170%27 HTTP/1.1" 200 None
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698944170 not downloaded yet
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698944172%27 HTTP/1.1" 200 None
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698944172 not downloaded yet
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477a4450>
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf35b337-845e-537f-a976-08188cca66f3/cf35b337-845e-537f-a976-08188cca66f3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ70EHU%252F699110796%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110796/600 saved to cache
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf35b337-845e-537f-a976-08188cca66f3
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55491c190>
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39f18d5c-38c9-5802-bc90-29e03976b40f/39f18d5c-38c9-5802-bc90-29e03976b40f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN63OLH%252F698994130%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994130/600 saved to cache
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 39f18d5c-38c9-5802-bc90-29e03976b40f
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554231790>
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502dec79-4436-5ea8-b8a4-1afd151a13a2/502dec79-4436-5ea8-b8a4-1afd151a13a2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX68XHM%252F699081034%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081034/600 saved to cache
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 502dec79-4436-5ea8-b8a4-1afd151a13a2
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54724b5d0>
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbce9e71-f6f9-5b70-87a1-2cf7e0368db6/fbce9e71-f6f9-5b70-87a1-2cf7e0368db6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV69BJO%252F699285814%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285814/600 saved to cache
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fbce9e71-f6f9-5b70-87a1-2cf7e0368db6
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554231590>
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8076e5d-cb8b-5578-9e3b-020e67e6d8b5/d8076e5d-cb8b-5578-9e3b-020e67e6d8b5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV03RSZ%252F699074195%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074195/600 saved to cache
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d8076e5d-cb8b-5578-9e3b-020e67e6d8b5
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT07FBY/42810797?sv=2020-08-04&st=2026-03-28T22%3A02%3A46Z&se=2026-03-28T22%3A27%3A46Z&sr=b&sp=r&sig=Ocei6JJU1dwDaO5Faxnq3iQo5eTP1n10igBRAXI9SK4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698944173%27 HTTP/1.1" 200 None
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698944173 not downloaded yet
2026-03-28 22:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126423/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126423>
2026-03-28 22:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285802/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285802>
2026-03-28 22:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074190/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074190>
2026-03-28 22:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081014/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081014>
2026-03-28 22:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981103/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981103>
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966045/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD57OLK/42810740?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=6hm7fODnR3wBKimIVKSkEorWvM8%2B5kHNq4nMJt6A%2BvY%3D)
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058600/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ12NEO/42811151?sv=2020-08-04&st=2026-03-28T22%3A01%3A05Z&se=2026-03-28T22%3A26%3A05Z&sr=b&sp=r&sig=62h1oUPBDkzrRTgiSRZPyg2OGFZw9gvgjM6%2Bng4Eeco%3D)
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698944174%27 HTTP/1.1" 200 None
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698944174 not downloaded yet
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698944176%27 HTTP/1.1" 200 None
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698944176 not downloaded yet
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55491f410>
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc2a305-976b-5d20-86ca-43ed711c23db/1fc2a305-976b-5d20-86ca-43ed711c23db_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND62EWM%252F698981145%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981145/600 saved to cache
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1fc2a305-976b-5d20-86ca-43ed711c23db
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110789/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ70EHU/42811341?sv=2020-08-04&st=2026-03-28T22%3A01%3A12Z&se=2026-03-28T22%3A26%3A12Z&sr=b&sp=r&sig=jIMEwQ1nhHjk3xUWtYxp4DaMU%2Fd7rUcdJRYrXhJEbps%3D)
2026-03-28 22:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966038/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966038>
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698944177%27 HTTP/1.1" 200 None
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698944177 not downloaded yet
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994106/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN63OLH/42810834?sv=2020-08-04&st=2026-03-28T22%3A01%3A09Z&se=2026-03-28T22%3A26%3A09Z&sr=b&sp=r&sig=NMpNDT8TSdoKfgfMWv1wobNIeXn3SgscjQpSI5aPQXk%3D)
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126416/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT19CVS/42811387?sv=2020-08-04&st=2026-03-28T22%3A01%3A08Z&se=2026-03-28T22%3A26%3A08Z&sr=b&sp=r&sig=Xezo2YoS0t9x6abxzIwcxCNA1wXAbFztVA4zM%2F%2Bntk8%3D)
2026-03-28 22:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944169/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AK60YGR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698944178%27 HTTP/1.1" 200 None
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698944178 not downloaded yet
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031396/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ68UWN/42811039?sv=2020-08-04&st=2026-03-28T22%3A01%3A10Z&se=2026-03-28T22%3A26%3A10Z&sr=b&sp=r&sig=1ZiFBHKVUwguyFOSNXk0RG8MN%2BDlXzRukHPnqyWqOFk%3D)
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698944180%27 HTTP/1.1" 200 None
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698944180 not downloaded yet
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472640d0>
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5efd40b-81d0-5f93-9693-58ba123af3be/b5efd40b-81d0-5f93-9693-58ba123af3be_expert_report_file_0948bcee-d7dc-49cc-af2d-cec07958f669.pdf HTTP/1.1" 201 0
2026-03-28 22:02:48 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b5efd40b-81d0-5f93-9693-58ba123af3be
2026-03-28 22:02:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5efd40b-81d0-5f93-9693-58ba123af3be, skipping ID generation
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b5efd40b-81d0-5f93-9693-58ba123af3be
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMT07FBY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MT07FBY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074190/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV03RSZ/42811210?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=XPdxTou37%2FSrb2139PEgleDE82DPAqY3LhSbwh%2FScoQ%3D)
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081014/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX68XHM/42809660?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=LehtVWZLTGCUq%2FHVaWaxVcM6eZjoYBHWl7BsrTTno54%3D)
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126423/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT70TDO/42811400?sv=2020-08-04&st=2026-03-28T22%3A01%3A09Z&se=2026-03-28T22%3A26%3A09Z&sr=b&sp=r&sig=sz4G2m%2Bww1tbH3aSNvJ2DJLyecaaL3NNq%2FlejxEYTpI%3D)
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000876%27 HTTP/1.1" 200 None
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000876 not downloaded yet
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54727ab10>
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f1a744f-dcf7-513c-adf2-49d9ca828470/8f1a744f-dcf7-513c-adf2-49d9ca828470_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD57OLK%252F698966045%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966045/600 saved to cache
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f1a744f-dcf7-513c-adf2-49d9ca828470
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542d8410>
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf9384a7-c2b5-5829-81c5-0ab07891768a/cf9384a7-c2b5-5829-81c5-0ab07891768a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ12NEO%252F699058600%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058600/600 saved to cache
2026-03-28 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf9384a7-c2b5-5829-81c5-0ab07891768a
2026-03-28 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285802/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV69BJO/42810768?sv=2020-08-04&st=2026-03-28T22%3A01%3A08Z&se=2026-03-28T22%3A26%3A08Z&sr=b&sp=r&sig=RhBgWIDbmwF%2F8XqW9pjzomUmOVaJM8ThWq2ap8w7j1M%3D)
2026-03-28 22:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY56ODW/42809574?sv=2020-08-04&st=2026-03-28T22%3A02%3A48Z&se=2026-03-28T22%3A27%3A48Z&sr=b&sp=r&sig=8fVzHiWrIaauGS6DCsPlv8wdZIhmrpcIGmHyoExhyuc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944172/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698944172>
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000896%27 HTTP/1.1" 200 None
2026-03-28 22:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000896 not downloaded yet
2026-03-28 22:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b22b90>
2026-03-28 22:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf35b337-845e-537f-a976-08188cca66f3/cf35b337-845e-537f-a976-08188cca66f3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ70EHU%252F699110789%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110789/600 saved to cache
2026-03-28 22:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf35b337-845e-537f-a976-08188cca66f3
2026-03-28 22:02:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf35b337-845e-537f-a976-08188cca66f3, skipping ID generation
2026-03-28 22:02:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf35b337-845e-537f-a976-08188cca66f3 sending to next pipeline
2026-03-28 22:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cf35b337-845e-537f-a976-08188cca66f3, identifier: BJ70%20EHU
2026-03-28 22:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474abd50>
2026-03-28 22:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39f18d5c-38c9-5802-bc90-29e03976b40f/39f18d5c-38c9-5802-bc90-29e03976b40f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN63OLH%252F698994106%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994106/600 saved to cache
2026-03-28 22:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 39f18d5c-38c9-5802-bc90-29e03976b40f
2026-03-28 22:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542a6190>
2026-03-28 22:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b3f5c4-70ca-530a-a56a-701b7ee98ebe/d2b3f5c4-70ca-530a-a56a-701b7ee98ebe_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT19CVS%252F699126416%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126416/600 saved to cache
2026-03-28 22:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2b3f5c4-70ca-530a-a56a-701b7ee98ebe
2026-03-28 22:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944170/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698944170>
2026-03-28 22:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944173/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698944173>
2026-03-28 22:02:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cf35b337-845e-537f-a976-08188cca66f3 with identifier: BJ70%20EHU
2026-03-28 22:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cf35b337-845e-537f-a976-08188cca66f3 with identifier: BJ70%20EHU
2026-03-28 22:02:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cf35b337-845e-537f-a976-08188cca66f3 with identifier: BJ70%20EHU to the API
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110789/600>
{'auction_title': '',
'c_o_2_emission_value': 165,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf35b337-845e-537f-a976-08188cca66f3/cf35b337-845e-537f-a976-08188cca66f3_expert_report_file_4962b849-fca7-4552-ae53-4b482cfcc83b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ70%20EHU-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'cf35b337-845e-537f-a976-08188cca66f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BJ70 EHU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BJ70%20EHU&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VOLVO',
'model': 'XC40',
'odometer': 69983,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf35b337-845e-537f-a976-08188cca66f3/cf35b337-845e-537f-a976-08188cca66f3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38544,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110789/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf35b337-845e-537f-a976-08188cca66f3/cf35b337-845e-537f-a976-08188cca66f3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37418,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110796/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf35b337-845e-537f-a976-08188cca66f3/cf35b337-845e-537f-a976-08188cca66f3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36910,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110805/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf35b337-845e-537f-a976-08188cca66f3/cf35b337-845e-537f-a976-08188cca66f3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36997,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110815/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf35b337-845e-537f-a976-08188cca66f3/cf35b337-845e-537f-a976-08188cca66f3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33702,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110824/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf35b337-845e-537f-a976-08188cca66f3/cf35b337-845e-537f-a976-08188cca66f3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33885,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110837/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf35b337-845e-537f-a976-08188cca66f3/cf35b337-845e-537f-a976-08188cca66f3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62251,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110850/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf35b337-845e-537f-a976-08188cca66f3/cf35b337-845e-537f-a976-08188cca66f3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68362,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110869/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf35b337-845e-537f-a976-08188cca66f3/cf35b337-845e-537f-a976-08188cca66f3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70253,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110886/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf35b337-845e-537f-a976-08188cca66f3/cf35b337-845e-537f-a976-08188cca66f3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60159,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ70EHU/699110904/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VOLVO XC40 2.0 B4P R DESIGN PRO G/T StationWagon',
'transmission': 'automatic',
'trim': 'B4P R DESIGN PRO G/T',
'vin': 'YV1XZK9BDM2441360',
'year': 2020}
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ70%2520EHU%27 HTTP/1.1" 200 None
2026-03-28 22:02:49 [bca.uk] INFO: Saving data for BJ70%20EHU: {'created_time': 1774735369.907614, 'last_price_update_time': 1774735369.907626, 'auction_closing_time': 1774951200.0}
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BJ70%2520EHU') HTTP/1.1" 204 0
2026-03-28 22:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966038/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD57OLK/42810740?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=6hm7fODnR3wBKimIVKSkEorWvM8%2B5kHNq4nMJt6A%2BvY%3D)
2026-03-28 22:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981103/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND62EWM/42810799?sv=2020-08-04&st=2026-03-28T22%3A01%3A06Z&se=2026-03-28T22%3A26%3A06Z&sr=b&sp=r&sig=KD3C6SJzwrdEgIjlL7QRYHJfSgh8rbJ%2FPC%2F%2BEfVah7k%3D)
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000910%27 HTTP/1.1" 200 None
2026-03-28 22:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000910 not downloaded yet
2026-03-28 22:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944176/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698944176>
2026-03-28 22:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944174/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698944174>
2026-03-28 22:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54777ff10>
2026-03-28 22:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f05d113-747f-52ed-a1ad-9799bad35377/7f05d113-747f-52ed-a1ad-9799bad35377_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ68UWN%252F699031396%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031396/600 saved to cache
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f05d113-747f-52ed-a1ad-9799bad35377
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556f74290>
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8076e5d-cb8b-5578-9e3b-020e67e6d8b5/d8076e5d-cb8b-5578-9e3b-020e67e6d8b5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV03RSZ%252F699074190%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074190/600 saved to cache
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d8076e5d-cb8b-5578-9e3b-020e67e6d8b5
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54722c290>
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502dec79-4436-5ea8-b8a4-1afd151a13a2/502dec79-4436-5ea8-b8a4-1afd151a13a2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX68XHM%252F699081014%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081014/600 saved to cache
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 502dec79-4436-5ea8-b8a4-1afd151a13a2
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547343850>
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d540cd8f-d715-5405-a8d5-11721b31b439/d540cd8f-d715-5405-a8d5-11721b31b439_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT70TDO%252F699126423%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126423/600 saved to cache
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d540cd8f-d715-5405-a8d5-11721b31b439
2026-03-28 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554301bd0>
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbce9e71-f6f9-5b70-87a1-2cf7e0368db6/fbce9e71-f6f9-5b70-87a1-2cf7e0368db6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV69BJO%252F699285802%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285802/600 saved to cache
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fbce9e71-f6f9-5b70-87a1-2cf7e0368db6
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547dc610>
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc0e7ef8-c401-5590-9e6c-d0083796c0be/dc0e7ef8-c401-5590-9e6c-d0083796c0be_expert_report_file_354095c5-2ea4-49d7-874c-c787ee2d2298.pdf HTTP/1.1" 201 0
2026-03-28 22:02:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item dc0e7ef8-c401-5590-9e6c-d0083796c0be
2026-03-28 22:02:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc0e7ef8-c401-5590-9e6c-d0083796c0be, skipping ID generation
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc0e7ef8-c401-5590-9e6c-d0083796c0be
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYY56ODW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YY56ODW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000924%27 HTTP/1.1" 200 None
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000924 not downloaded yet
2026-03-28 22:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VKZ2608/42811188?sv=2020-08-04&st=2026-03-28T22%3A02%3A48Z&se=2026-03-28T22%3A27%3A48Z&sr=b&sp=r&sig=YVDhW6ZhxmecwpaZ94EoTimfYWdl6%2B0eIaf2M%2FFyfB8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944169/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK60YGR/42810557?sv=2020-08-04&st=2026-03-28T22%3A02%3A45Z&se=2026-03-28T22%3A27%3A45Z&sr=b&sp=r&sig=lfQwNL0RjYiP29It%2FA%2FLLtjFCBW9HSDzJKoNh8e2V4U%3D)
2026-03-28 22:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944178/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698944178>
2026-03-28 22:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944177/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698944177>
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189765%27 HTTP/1.1" 200 None
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189765 not downloaded yet
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000928%27 HTTP/1.1" 200 None
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000928 not downloaded yet
2026-03-28 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544dd810>
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f1a744f-dcf7-513c-adf2-49d9ca828470/8f1a744f-dcf7-513c-adf2-49d9ca828470_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD57OLK%252F698966038%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966038/600 saved to cache
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f1a744f-dcf7-513c-adf2-49d9ca828470
2026-03-28 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549bacd0>
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc2a305-976b-5d20-86ca-43ed711c23db/1fc2a305-976b-5d20-86ca-43ed711c23db_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND62EWM%252F698981103%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981103/600 saved to cache
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1fc2a305-976b-5d20-86ca-43ed711c23db
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189770%27 HTTP/1.1" 200 None
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189770 not downloaded yet
2026-03-28 22:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058568/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058568>
2026-03-28 22:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944180/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698944180>
2026-03-28 22:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000862/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MT07FBY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS06XVF/42809475?sv=2020-08-04&st=2026-03-28T22%3A02%3A50Z&se=2026-03-28T22%3A27%3A50Z&sr=b&sp=r&sig=7Rd0007gIVtwgJc%2BuHu6suhKAfz0%2FmWCGr73AcdrD7s%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YS06%20XVF-GB>
2026-03-28 22:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000876/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000876>
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000948%27 HTTP/1.1" 200 None
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000948 not downloaded yet
2026-03-28 22:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944172/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK60YGR/42810557?sv=2020-08-04&st=2026-03-28T22%3A02%3A45Z&se=2026-03-28T22%3A27%3A45Z&sr=b&sp=r&sig=lfQwNL0RjYiP29It%2FA%2FLLtjFCBW9HSDzJKoNh8e2V4U%3D)
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189775%27 HTTP/1.1" 200 None
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189775 not downloaded yet
2026-03-28 22:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944170/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK60YGR/42810557?sv=2020-08-04&st=2026-03-28T22%3A02%3A45Z&se=2026-03-28T22%3A27%3A45Z&sr=b&sp=r&sig=lfQwNL0RjYiP29It%2FA%2FLLtjFCBW9HSDzJKoNh8e2V4U%3D)
2026-03-28 22:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944173/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK60YGR/42810557?sv=2020-08-04&st=2026-03-28T22%3A02%3A45Z&se=2026-03-28T22%3A27%3A45Z&sr=b&sp=r&sig=lfQwNL0RjYiP29It%2FA%2FLLtjFCBW9HSDzJKoNh8e2V4U%3D)
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000970%27 HTTP/1.1" 200 None
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000970 not downloaded yet
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189786%27 HTTP/1.1" 200 None
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189786 not downloaded yet
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547117f90>
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e083fc-0fc7-5652-936e-3a40315f73e3/a0e083fc-0fc7-5652-936e-3a40315f73e3_expert_report_file_29ac2c17-0b3e-40ea-ad8d-376b08f720f7.pdf HTTP/1.1" 201 0
2026-03-28 22:02:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a0e083fc-0fc7-5652-936e-3a40315f73e3
2026-03-28 22:02:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0e083fc-0fc7-5652-936e-3a40315f73e3, skipping ID generation
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a0e083fc-0fc7-5652-936e-3a40315f73e3
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DVKZ2608-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VKZ2608-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f83310>
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c199cc4-2b6f-5122-8d05-996d23603f8a/1c199cc4-2b6f-5122-8d05-996d23603f8a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK60YGR%252F698944169%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944169/600 saved to cache
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c199cc4-2b6f-5122-8d05-996d23603f8a
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699001004%27 HTTP/1.1" 200 None
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001004 not downloaded yet
2026-03-28 22:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966081/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966081>
2026-03-28 22:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000896/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000896>
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189795%27 HTTP/1.1" 200 None
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189795 not downloaded yet
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074167%27 HTTP/1.1" 200 None
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074167 not downloaded yet
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699001033%27 HTTP/1.1" 200 None
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001033 not downloaded yet
2026-03-28 22:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944177/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK60YGR/42810557?sv=2020-08-04&st=2026-03-28T22%3A02%3A45Z&se=2026-03-28T22%3A27%3A45Z&sr=b&sp=r&sig=lfQwNL0RjYiP29It%2FA%2FLLtjFCBW9HSDzJKoNh8e2V4U%3D)
2026-03-28 22:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944174/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK60YGR/42810557?sv=2020-08-04&st=2026-03-28T22%3A02%3A45Z&se=2026-03-28T22%3A27%3A45Z&sr=b&sp=r&sig=lfQwNL0RjYiP29It%2FA%2FLLtjFCBW9HSDzJKoNh8e2V4U%3D)
2026-03-28 22:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944176/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK60YGR/42810557?sv=2020-08-04&st=2026-03-28T22%3A02%3A45Z&se=2026-03-28T22%3A27%3A45Z&sr=b&sp=r&sig=lfQwNL0RjYiP29It%2FA%2FLLtjFCBW9HSDzJKoNh8e2V4U%3D)
2026-03-28 22:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944178/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK60YGR/42810557?sv=2020-08-04&st=2026-03-28T22%3A02%3A45Z&se=2026-03-28T22%3A27%3A45Z&sr=b&sp=r&sig=lfQwNL0RjYiP29It%2FA%2FLLtjFCBW9HSDzJKoNh8e2V4U%3D)
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189809%27 HTTP/1.1" 200 None
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189809 not downloaded yet
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074172%27 HTTP/1.1" 200 None
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074172 not downloaded yet
2026-03-28 22:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189759/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YY56ODW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000910/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000910>
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55428e5d0>
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c199cc4-2b6f-5122-8d05-996d23603f8a/1c199cc4-2b6f-5122-8d05-996d23603f8a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK60YGR%252F698944172%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944172/600 saved to cache
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1c199cc4-2b6f-5122-8d05-996d23603f8a
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554908fd0>
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c199cc4-2b6f-5122-8d05-996d23603f8a/1c199cc4-2b6f-5122-8d05-996d23603f8a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK60YGR%252F698944170%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944170/600 saved to cache
2026-03-28 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1c199cc4-2b6f-5122-8d05-996d23603f8a
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542fdc50>
2026-03-28 22:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c199cc4-2b6f-5122-8d05-996d23603f8a/1c199cc4-2b6f-5122-8d05-996d23603f8a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK60YGR%252F698944173%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944173/600 saved to cache
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1c199cc4-2b6f-5122-8d05-996d23603f8a
2026-03-28 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000876/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT07FBY/42810797?sv=2020-08-04&st=2026-03-28T22%3A02%3A46Z&se=2026-03-28T22%3A27%3A46Z&sr=b&sp=r&sig=Ocei6JJU1dwDaO5Faxnq3iQo5eTP1n10igBRAXI9SK4%3D)
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189830%27 HTTP/1.1" 200 None
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189830 not downloaded yet
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074179%27 HTTP/1.1" 200 None
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074179 not downloaded yet
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189845%27 HTTP/1.1" 200 None
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189845 not downloaded yet
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074185%27 HTTP/1.1" 200 None
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074185 not downloaded yet
2026-03-28 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000862/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT07FBY/42810797?sv=2020-08-04&st=2026-03-28T22%3A02%3A46Z&se=2026-03-28T22%3A27%3A46Z&sr=b&sp=r&sig=Ocei6JJU1dwDaO5Faxnq3iQo5eTP1n10igBRAXI9SK4%3D)
2026-03-28 22:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000948/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000948>
2026-03-28 22:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189770/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189770>
2026-03-28 22:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189775/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189775>
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189858%27 HTTP/1.1" 200 None
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189858 not downloaded yet
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074191%27 HTTP/1.1" 200 None
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074191 not downloaded yet
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554941a90>
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c199cc4-2b6f-5122-8d05-996d23603f8a/1c199cc4-2b6f-5122-8d05-996d23603f8a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK60YGR%252F698944177%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944177/600 saved to cache
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1c199cc4-2b6f-5122-8d05-996d23603f8a
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547265690>
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c199cc4-2b6f-5122-8d05-996d23603f8a/1c199cc4-2b6f-5122-8d05-996d23603f8a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK60YGR%252F698944174%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944174/600 saved to cache
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1c199cc4-2b6f-5122-8d05-996d23603f8a
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547205e50>
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c199cc4-2b6f-5122-8d05-996d23603f8a/1c199cc4-2b6f-5122-8d05-996d23603f8a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK60YGR%252F698944176%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944176/600 saved to cache
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1c199cc4-2b6f-5122-8d05-996d23603f8a
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b40cd0>
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c199cc4-2b6f-5122-8d05-996d23603f8a/1c199cc4-2b6f-5122-8d05-996d23603f8a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK60YGR%252F698944178%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944178/600 saved to cache
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1c199cc4-2b6f-5122-8d05-996d23603f8a
2026-03-28 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058568/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ12NEO/42811151?sv=2020-08-04&st=2026-03-28T22%3A01%3A05Z&se=2026-03-28T22%3A26%3A05Z&sr=b&sp=r&sig=62h1oUPBDkzrRTgiSRZPyg2OGFZw9gvgjM6%2Bng4Eeco%3D)
2026-03-28 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000896/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT07FBY/42810797?sv=2020-08-04&st=2026-03-28T22%3A02%3A46Z&se=2026-03-28T22%3A27%3A46Z&sr=b&sp=r&sig=Ocei6JJU1dwDaO5Faxnq3iQo5eTP1n10igBRAXI9SK4%3D)
2026-03-28 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944180/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK60YGR/42810557?sv=2020-08-04&st=2026-03-28T22%3A02%3A45Z&se=2026-03-28T22%3A27%3A45Z&sr=b&sp=r&sig=lfQwNL0RjYiP29It%2FA%2FLLtjFCBW9HSDzJKoNh8e2V4U%3D)
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074197%27 HTTP/1.1" 200 None
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074197 not downloaded yet
2026-03-28 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS06XVF/42809475?sv=2020-08-04&st=2026-03-28T22%3A02%3A50Z&se=2026-03-28T22%3A27%3A50Z&sr=b&sp=r&sig=7Rd0007gIVtwgJc%2BuHu6suhKAfz0%2FmWCGr73AcdrD7s%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074204%27 HTTP/1.1" 200 None
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074204 not downloaded yet
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554957ad0>
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5efd40b-81d0-5f93-9693-58ba123af3be/b5efd40b-81d0-5f93-9693-58ba123af3be_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT07FBY%252F699000876%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000876/600 saved to cache
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b5efd40b-81d0-5f93-9693-58ba123af3be
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547239110>
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5efd40b-81d0-5f93-9693-58ba123af3be/b5efd40b-81d0-5f93-9693-58ba123af3be_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT07FBY%252F699000862%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000862/600 saved to cache
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5efd40b-81d0-5f93-9693-58ba123af3be
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074213%27 HTTP/1.1" 200 None
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074213 not downloaded yet
2026-03-28 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189759/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY56ODW/42809574?sv=2020-08-04&st=2026-03-28T22%3A02%3A48Z&se=2026-03-28T22%3A27%3A48Z&sr=b&sp=r&sig=8fVzHiWrIaauGS6DCsPlv8wdZIhmrpcIGmHyoExhyuc%3D)
2026-03-28 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000910/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT07FBY/42810797?sv=2020-08-04&st=2026-03-28T22%3A02%3A46Z&se=2026-03-28T22%3A27%3A46Z&sr=b&sp=r&sig=Ocei6JJU1dwDaO5Faxnq3iQo5eTP1n10igBRAXI9SK4%3D)
2026-03-28 22:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699001033/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001033>
2026-03-28 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966081/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VA62BTY/42810684?sv=2020-08-04&st=2026-03-28T22%3A01%3A03Z&se=2026-03-28T22%3A26%3A03Z&sr=b&sp=r&sig=N35MQzuEGC1T9OsmIXtmUT3IIUk5%2F7R2XsmdyzT4d0M%3D)
2026-03-28 22:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699001004/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001004>
2026-03-28 22:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189795/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189795>
2026-03-28 22:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074167/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074167>
2026-03-28 22:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074172/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074172>
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699074221%27 HTTP/1.1" 200 None
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074221 not downloaded yet
2026-03-28 22:02:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473dd210>
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf9384a7-c2b5-5829-81c5-0ab07891768a/cf9384a7-c2b5-5829-81c5-0ab07891768a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ12NEO%252F699058568%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058568/600 saved to cache
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf9384a7-c2b5-5829-81c5-0ab07891768a
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f83d50>
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5efd40b-81d0-5f93-9693-58ba123af3be/b5efd40b-81d0-5f93-9693-58ba123af3be_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT07FBY%252F699000896%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000896/600 saved to cache
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b5efd40b-81d0-5f93-9693-58ba123af3be
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54728d5d0>
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c199cc4-2b6f-5122-8d05-996d23603f8a/1c199cc4-2b6f-5122-8d05-996d23603f8a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK60YGR%252F698944180%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944180/600 saved to cache
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1c199cc4-2b6f-5122-8d05-996d23603f8a
2026-03-28 22:02:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c199cc4-2b6f-5122-8d05-996d23603f8a, skipping ID generation
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c199cc4-2b6f-5122-8d05-996d23603f8a sending to next pipeline
2026-03-28 22:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1c199cc4-2b6f-5122-8d05-996d23603f8a, identifier: AK60%20YGR
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54777f410>
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee972586-3286-5910-8d85-df63dfdcf24d/ee972586-3286-5910-8d85-df63dfdcf24d_expert_report_file_15ae65c8-f884-4bed-ad5b-555b76cabe3a.pdf HTTP/1.1" 201 0
2026-03-28 22:02:51 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ee972586-3286-5910-8d85-df63dfdcf24d
2026-03-28 22:02:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee972586-3286-5910-8d85-df63dfdcf24d, skipping ID generation
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee972586-3286-5910-8d85-df63dfdcf24d
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYS06XVF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YS06XVF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1c199cc4-2b6f-5122-8d05-996d23603f8a with identifier: AK60%20YGR
2026-03-28 22:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1c199cc4-2b6f-5122-8d05-996d23603f8a with identifier: AK60%20YGR
2026-03-28 22:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1c199cc4-2b6f-5122-8d05-996d23603f8a with identifier: AK60%20YGR to the API
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944180/600>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c199cc4-2b6f-5122-8d05-996d23603f8a/1c199cc4-2b6f-5122-8d05-996d23603f8a_expert_report_file_bfcfc1cf-d6ca-4116-b5f0-a2b13a4801eb.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AK60%20YGR-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1c199cc4-2b6f-5122-8d05-996d23603f8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AK60 YGR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AK60%20YGR&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VOLVO',
'model': 'S80',
'odometer': 270375,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c199cc4-2b6f-5122-8d05-996d23603f8a/1c199cc4-2b6f-5122-8d05-996d23603f8a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 177174,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944169/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c199cc4-2b6f-5122-8d05-996d23603f8a/1c199cc4-2b6f-5122-8d05-996d23603f8a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180778,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944170/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c199cc4-2b6f-5122-8d05-996d23603f8a/1c199cc4-2b6f-5122-8d05-996d23603f8a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 160934,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944172/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c199cc4-2b6f-5122-8d05-996d23603f8a/1c199cc4-2b6f-5122-8d05-996d23603f8a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170454,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944173/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c199cc4-2b6f-5122-8d05-996d23603f8a/1c199cc4-2b6f-5122-8d05-996d23603f8a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 134647,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944174/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c199cc4-2b6f-5122-8d05-996d23603f8a/1c199cc4-2b6f-5122-8d05-996d23603f8a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139142,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944176/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c199cc4-2b6f-5122-8d05-996d23603f8a/1c199cc4-2b6f-5122-8d05-996d23603f8a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 146793,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944177/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c199cc4-2b6f-5122-8d05-996d23603f8a/1c199cc4-2b6f-5122-8d05-996d23603f8a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 138327,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944178/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c199cc4-2b6f-5122-8d05-996d23603f8a/1c199cc4-2b6f-5122-8d05-996d23603f8a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152722,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK60YGR/698944180/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'VOLVO S80 2.0 D3 163 SE G/T Saloon',
'transmission': 'manual',
'trim': 'D3 163 SE G/T',
'vin': 'YV1AS5250B1142602',
'year': 2010}
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK60%2520YGR%27 HTTP/1.1" 200 None
2026-03-28 22:02:52 [bca.uk] INFO: Saving data for AK60%20YGR: {'created_time': 1774735372.437902, 'last_price_update_time': 1774735372.437912, 'auction_closing_time': 1774864800.0}
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AK60%2520YGR') HTTP/1.1" 204 0
2026-03-28 22:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189775/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY56ODW/42809574?sv=2020-08-04&st=2026-03-28T22%3A02%3A48Z&se=2026-03-28T22%3A27%3A48Z&sr=b&sp=r&sig=8fVzHiWrIaauGS6DCsPlv8wdZIhmrpcIGmHyoExhyuc%3D)
2026-03-28 22:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189770/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY56ODW/42809574?sv=2020-08-04&st=2026-03-28T22%3A02%3A48Z&se=2026-03-28T22%3A27%3A48Z&sr=b&sp=r&sig=8fVzHiWrIaauGS6DCsPlv8wdZIhmrpcIGmHyoExhyuc%3D)
2026-03-28 22:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074179/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074179>
2026-03-28 22:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074185/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074185>
2026-03-28 22:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074191/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074191>
2026-03-28 22:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189858/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189858>
2026-03-28 22:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189845/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189845>
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189727%27 HTTP/1.1" 200 None
2026-03-28 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189727 not downloaded yet
2026-03-28 22:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000948/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT07FBY/42810797?sv=2020-08-04&st=2026-03-28T22%3A02%3A46Z&se=2026-03-28T22%3A27%3A46Z&sr=b&sp=r&sig=Ocei6JJU1dwDaO5Faxnq3iQo5eTP1n10igBRAXI9SK4%3D)
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189731%27 HTTP/1.1" 200 None
2026-03-28 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189731 not downloaded yet
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474f7790>
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc0e7ef8-c401-5590-9e6c-d0083796c0be/dc0e7ef8-c401-5590-9e6c-d0083796c0be_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY56ODW%252F699189759%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189759/600 saved to cache
2026-03-28 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc0e7ef8-c401-5590-9e6c-d0083796c0be
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471172d0>
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5efd40b-81d0-5f93-9693-58ba123af3be/b5efd40b-81d0-5f93-9693-58ba123af3be_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT07FBY%252F699000910%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000910/600 saved to cache
2026-03-28 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b5efd40b-81d0-5f93-9693-58ba123af3be
2026-03-28 22:02:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549096d0>
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44fab252-6185-51e4-87e9-3f4c2a42edd8/44fab252-6185-51e4-87e9-3f4c2a42edd8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVA62BTY%252F698966081%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966081/600 saved to cache
2026-03-28 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 44fab252-6185-51e4-87e9-3f4c2a42edd8
2026-03-28 22:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189795/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY56ODW/42809574?sv=2020-08-04&st=2026-03-28T22%3A02%3A48Z&se=2026-03-28T22%3A27%3A48Z&sr=b&sp=r&sig=8fVzHiWrIaauGS6DCsPlv8wdZIhmrpcIGmHyoExhyuc%3D)
2026-03-28 22:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074172/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VKZ2608/42811188?sv=2020-08-04&st=2026-03-28T22%3A02%3A48Z&se=2026-03-28T22%3A27%3A48Z&sr=b&sp=r&sig=YVDhW6ZhxmecwpaZ94EoTimfYWdl6%2B0eIaf2M%2FFyfB8%3D)
2026-03-28 22:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074167/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VKZ2608/42811188?sv=2020-08-04&st=2026-03-28T22%3A02%3A48Z&se=2026-03-28T22%3A27%3A48Z&sr=b&sp=r&sig=YVDhW6ZhxmecwpaZ94EoTimfYWdl6%2B0eIaf2M%2FFyfB8%3D)
2026-03-28 22:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074204/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074204>
2026-03-28 22:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074197/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074197>
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189736%27 HTTP/1.1" 200 None
2026-03-28 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189736 not downloaded yet
2026-03-28 22:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699001004/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT07FBY/42810797?sv=2020-08-04&st=2026-03-28T22%3A02%3A46Z&se=2026-03-28T22%3A27%3A46Z&sr=b&sp=r&sig=Ocei6JJU1dwDaO5Faxnq3iQo5eTP1n10igBRAXI9SK4%3D)
2026-03-28 22:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699001033/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT07FBY/42810797?sv=2020-08-04&st=2026-03-28T22%3A02%3A46Z&se=2026-03-28T22%3A27%3A46Z&sr=b&sp=r&sig=Ocei6JJU1dwDaO5Faxnq3iQo5eTP1n10igBRAXI9SK4%3D)
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473d8210>
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc0e7ef8-c401-5590-9e6c-d0083796c0be/dc0e7ef8-c401-5590-9e6c-d0083796c0be_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY56ODW%252F699189775%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189775/600 saved to cache
2026-03-28 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc0e7ef8-c401-5590-9e6c-d0083796c0be
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55436d650>
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc0e7ef8-c401-5590-9e6c-d0083796c0be/dc0e7ef8-c401-5590-9e6c-d0083796c0be_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY56ODW%252F699189770%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189770/600 saved to cache
2026-03-28 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc0e7ef8-c401-5590-9e6c-d0083796c0be
2026-03-28 22:02:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473b8750>
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5efd40b-81d0-5f93-9693-58ba123af3be/b5efd40b-81d0-5f93-9693-58ba123af3be_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT07FBY%252F699000948%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000948/600 saved to cache
2026-03-28 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b5efd40b-81d0-5f93-9693-58ba123af3be
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189740%27 HTTP/1.1" 200 None
2026-03-28 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189740 not downloaded yet
2026-03-28 22:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189830/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189830>
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189747%27 HTTP/1.1" 200 None
2026-03-28 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189747 not downloaded yet
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547ef7d0>
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc0e7ef8-c401-5590-9e6c-d0083796c0be/dc0e7ef8-c401-5590-9e6c-d0083796c0be_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY56ODW%252F699189795%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189795/600 saved to cache
2026-03-28 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc0e7ef8-c401-5590-9e6c-d0083796c0be
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54777ef50>
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e083fc-0fc7-5652-936e-3a40315f73e3/a0e083fc-0fc7-5652-936e-3a40315f73e3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVKZ2608%252F699074172%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074172/600 saved to cache
2026-03-28 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0e083fc-0fc7-5652-936e-3a40315f73e3
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549bb7d0>
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e083fc-0fc7-5652-936e-3a40315f73e3/a0e083fc-0fc7-5652-936e-3a40315f73e3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVKZ2608%252F699074167%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074167/600 saved to cache
2026-03-28 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0e083fc-0fc7-5652-936e-3a40315f73e3
2026-03-28 22:02:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557306a50>
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5efd40b-81d0-5f93-9693-58ba123af3be/b5efd40b-81d0-5f93-9693-58ba123af3be_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT07FBY%252F699001004%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699001004/600 saved to cache
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b5efd40b-81d0-5f93-9693-58ba123af3be
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b60b10>
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5efd40b-81d0-5f93-9693-58ba123af3be/b5efd40b-81d0-5f93-9693-58ba123af3be_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT07FBY%252F699001033%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699001033/600 saved to cache
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b5efd40b-81d0-5f93-9693-58ba123af3be
2026-03-28 22:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074191/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VKZ2608/42811188?sv=2020-08-04&st=2026-03-28T22%3A02%3A48Z&se=2026-03-28T22%3A27%3A48Z&sr=b&sp=r&sig=YVDhW6ZhxmecwpaZ94EoTimfYWdl6%2B0eIaf2M%2FFyfB8%3D)
2026-03-28 22:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074185/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VKZ2608/42811188?sv=2020-08-04&st=2026-03-28T22%3A02%3A48Z&se=2026-03-28T22%3A27%3A48Z&sr=b&sp=r&sig=YVDhW6ZhxmecwpaZ94EoTimfYWdl6%2B0eIaf2M%2FFyfB8%3D)
2026-03-28 22:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074179/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VKZ2608/42811188?sv=2020-08-04&st=2026-03-28T22%3A02%3A48Z&se=2026-03-28T22%3A27%3A48Z&sr=b&sp=r&sig=YVDhW6ZhxmecwpaZ94EoTimfYWdl6%2B0eIaf2M%2FFyfB8%3D)
2026-03-28 22:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074221/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074221>
2026-03-28 22:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189722/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YS06XVF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189755%27 HTTP/1.1" 200 None
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189755 not downloaded yet
2026-03-28 22:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189845/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY56ODW/42809574?sv=2020-08-04&st=2026-03-28T22%3A02%3A48Z&se=2026-03-28T22%3A27%3A48Z&sr=b&sp=r&sig=8fVzHiWrIaauGS6DCsPlv8wdZIhmrpcIGmHyoExhyuc%3D)
2026-03-28 22:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189858/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY56ODW/42809574?sv=2020-08-04&st=2026-03-28T22%3A02%3A48Z&se=2026-03-28T22%3A27%3A48Z&sr=b&sp=r&sig=8fVzHiWrIaauGS6DCsPlv8wdZIhmrpcIGmHyoExhyuc%3D)
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189767%27 HTTP/1.1" 200 None
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189767 not downloaded yet
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189782%27 HTTP/1.1" 200 None
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189782 not downloaded yet
2026-03-28 22:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189727/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189727>
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189798%27 HTTP/1.1" 200 None
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189798 not downloaded yet
2026-03-28 22:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189809/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189809>
2026-03-28 22:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189786/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189786>
2026-03-28 22:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189731/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189731>
2026-03-28 22:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074213/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074213>
2026-03-28 22:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074163/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VKZ2608-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074204/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VKZ2608/42811188?sv=2020-08-04&st=2026-03-28T22%3A02%3A48Z&se=2026-03-28T22%3A27%3A48Z&sr=b&sp=r&sig=YVDhW6ZhxmecwpaZ94EoTimfYWdl6%2B0eIaf2M%2FFyfB8%3D)
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a6d010>
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e083fc-0fc7-5652-936e-3a40315f73e3/a0e083fc-0fc7-5652-936e-3a40315f73e3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVKZ2608%252F699074191%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074191/600 saved to cache
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0e083fc-0fc7-5652-936e-3a40315f73e3
2026-03-28 22:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074197/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VKZ2608/42811188?sv=2020-08-04&st=2026-03-28T22%3A02%3A48Z&se=2026-03-28T22%3A27%3A48Z&sr=b&sp=r&sig=YVDhW6ZhxmecwpaZ94EoTimfYWdl6%2B0eIaf2M%2FFyfB8%3D)
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542a5010>
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e083fc-0fc7-5652-936e-3a40315f73e3/a0e083fc-0fc7-5652-936e-3a40315f73e3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVKZ2608%252F699074185%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074185/600 saved to cache
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0e083fc-0fc7-5652-936e-3a40315f73e3
2026-03-28 22:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189722/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS06XVF/42809475?sv=2020-08-04&st=2026-03-28T22%3A02%3A50Z&se=2026-03-28T22%3A27%3A50Z&sr=b&sp=r&sig=7Rd0007gIVtwgJc%2BuHu6suhKAfz0%2FmWCGr73AcdrD7s%3D)
2026-03-28 22:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000970/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000970>
2026-03-28 22:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189740/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189740>
2026-03-28 22:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189747/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189747>
2026-03-28 22:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189736/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189736>
2026-03-28 22:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189830/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY56ODW/42809574?sv=2020-08-04&st=2026-03-28T22%3A02%3A48Z&se=2026-03-28T22%3A27%3A48Z&sr=b&sp=r&sig=8fVzHiWrIaauGS6DCsPlv8wdZIhmrpcIGmHyoExhyuc%3D)
2026-03-28 22:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074221/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VKZ2608/42811188?sv=2020-08-04&st=2026-03-28T22%3A02%3A48Z&se=2026-03-28T22%3A27%3A48Z&sr=b&sp=r&sig=YVDhW6ZhxmecwpaZ94EoTimfYWdl6%2B0eIaf2M%2FFyfB8%3D)
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543e8a90>
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e083fc-0fc7-5652-936e-3a40315f73e3/a0e083fc-0fc7-5652-936e-3a40315f73e3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVKZ2608%252F699074179%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074179/600 saved to cache
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0e083fc-0fc7-5652-936e-3a40315f73e3
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54728ec10>
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc0e7ef8-c401-5590-9e6c-d0083796c0be/dc0e7ef8-c401-5590-9e6c-d0083796c0be_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY56ODW%252F699189845%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189845/600 saved to cache
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dc0e7ef8-c401-5590-9e6c-d0083796c0be
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554301150>
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc0e7ef8-c401-5590-9e6c-d0083796c0be/dc0e7ef8-c401-5590-9e6c-d0083796c0be_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY56ODW%252F699189858%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189858/600 saved to cache
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dc0e7ef8-c401-5590-9e6c-d0083796c0be
2026-03-28 22:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000928/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000928>
2026-03-28 22:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189727/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS06XVF/42809475?sv=2020-08-04&st=2026-03-28T22%3A02%3A50Z&se=2026-03-28T22%3A27%3A50Z&sr=b&sp=r&sig=7Rd0007gIVtwgJc%2BuHu6suhKAfz0%2FmWCGr73AcdrD7s%3D)
2026-03-28 22:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189786/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY56ODW/42809574?sv=2020-08-04&st=2026-03-28T22%3A02%3A48Z&se=2026-03-28T22%3A27%3A48Z&sr=b&sp=r&sig=8fVzHiWrIaauGS6DCsPlv8wdZIhmrpcIGmHyoExhyuc%3D)
2026-03-28 22:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189731/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS06XVF/42809475?sv=2020-08-04&st=2026-03-28T22%3A02%3A50Z&se=2026-03-28T22%3A27%3A50Z&sr=b&sp=r&sig=7Rd0007gIVtwgJc%2BuHu6suhKAfz0%2FmWCGr73AcdrD7s%3D)
2026-03-28 22:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189798/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189798>
2026-03-28 22:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189782/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189782>
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544a8250>
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e083fc-0fc7-5652-936e-3a40315f73e3/a0e083fc-0fc7-5652-936e-3a40315f73e3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVKZ2608%252F699074204%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074204/600 saved to cache
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0e083fc-0fc7-5652-936e-3a40315f73e3
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b22c50>
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e083fc-0fc7-5652-936e-3a40315f73e3/a0e083fc-0fc7-5652-936e-3a40315f73e3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVKZ2608%252F699074197%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074197/600 saved to cache
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0e083fc-0fc7-5652-936e-3a40315f73e3
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477632d0>
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee972586-3286-5910-8d85-df63dfdcf24d/ee972586-3286-5910-8d85-df63dfdcf24d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS06XVF%252F699189722%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189722/600 saved to cache
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee972586-3286-5910-8d85-df63dfdcf24d
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471383d0>
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc0e7ef8-c401-5590-9e6c-d0083796c0be/dc0e7ef8-c401-5590-9e6c-d0083796c0be_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY56ODW%252F699189830%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189830/600 saved to cache
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dc0e7ef8-c401-5590-9e6c-d0083796c0be
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473053d0>
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e083fc-0fc7-5652-936e-3a40315f73e3/a0e083fc-0fc7-5652-936e-3a40315f73e3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVKZ2608%252F699074221%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074221/600 saved to cache
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a0e083fc-0fc7-5652-936e-3a40315f73e3
2026-03-28 22:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189809/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY56ODW/42809574?sv=2020-08-04&st=2026-03-28T22%3A02%3A48Z&se=2026-03-28T22%3A27%3A48Z&sr=b&sp=r&sig=8fVzHiWrIaauGS6DCsPlv8wdZIhmrpcIGmHyoExhyuc%3D)
2026-03-28 22:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074213/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VKZ2608/42811188?sv=2020-08-04&st=2026-03-28T22%3A02%3A48Z&se=2026-03-28T22%3A27%3A48Z&sr=b&sp=r&sig=YVDhW6ZhxmecwpaZ94EoTimfYWdl6%2B0eIaf2M%2FFyfB8%3D)
2026-03-28 22:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074163/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VKZ2608/42811188?sv=2020-08-04&st=2026-03-28T22%3A02%3A48Z&se=2026-03-28T22%3A27%3A48Z&sr=b&sp=r&sig=YVDhW6ZhxmecwpaZ94EoTimfYWdl6%2B0eIaf2M%2FFyfB8%3D)
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473f82d0>
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee972586-3286-5910-8d85-df63dfdcf24d/ee972586-3286-5910-8d85-df63dfdcf24d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS06XVF%252F699189727%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189727/600 saved to cache
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee972586-3286-5910-8d85-df63dfdcf24d
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543bbc50>
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc0e7ef8-c401-5590-9e6c-d0083796c0be/dc0e7ef8-c401-5590-9e6c-d0083796c0be_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY56ODW%252F699189786%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189786/600 saved to cache
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc0e7ef8-c401-5590-9e6c-d0083796c0be
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547372e50>
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee972586-3286-5910-8d85-df63dfdcf24d/ee972586-3286-5910-8d85-df63dfdcf24d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS06XVF%252F699189731%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189731/600 saved to cache
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee972586-3286-5910-8d85-df63dfdcf24d
2026-03-28 22:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189747/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS06XVF/42809475?sv=2020-08-04&st=2026-03-28T22%3A02%3A50Z&se=2026-03-28T22%3A27%3A50Z&sr=b&sp=r&sig=7Rd0007gIVtwgJc%2BuHu6suhKAfz0%2FmWCGr73AcdrD7s%3D)
2026-03-28 22:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189736/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS06XVF/42809475?sv=2020-08-04&st=2026-03-28T22%3A02%3A50Z&se=2026-03-28T22%3A27%3A50Z&sr=b&sp=r&sig=7Rd0007gIVtwgJc%2BuHu6suhKAfz0%2FmWCGr73AcdrD7s%3D)
2026-03-28 22:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189740/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS06XVF/42809475?sv=2020-08-04&st=2026-03-28T22%3A02%3A50Z&se=2026-03-28T22%3A27%3A50Z&sr=b&sp=r&sig=7Rd0007gIVtwgJc%2BuHu6suhKAfz0%2FmWCGr73AcdrD7s%3D)
2026-03-28 22:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000928/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT07FBY/42810797?sv=2020-08-04&st=2026-03-28T22%3A02%3A46Z&se=2026-03-28T22%3A27%3A46Z&sr=b&sp=r&sig=Ocei6JJU1dwDaO5Faxnq3iQo5eTP1n10igBRAXI9SK4%3D)
2026-03-28 22:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189767/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189767>
2026-03-28 22:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189765/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189765>
2026-03-28 22:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189755/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189755>
2026-03-28 22:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000970/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT07FBY/42810797?sv=2020-08-04&st=2026-03-28T22%3A02%3A46Z&se=2026-03-28T22%3A27%3A46Z&sr=b&sp=r&sig=Ocei6JJU1dwDaO5Faxnq3iQo5eTP1n10igBRAXI9SK4%3D)
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557fb6990>
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc0e7ef8-c401-5590-9e6c-d0083796c0be/dc0e7ef8-c401-5590-9e6c-d0083796c0be_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY56ODW%252F699189809%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189809/600 saved to cache
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dc0e7ef8-c401-5590-9e6c-d0083796c0be
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543ded10>
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e083fc-0fc7-5652-936e-3a40315f73e3/a0e083fc-0fc7-5652-936e-3a40315f73e3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVKZ2608%252F699074213%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074213/600 saved to cache
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a0e083fc-0fc7-5652-936e-3a40315f73e3
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543026d0>
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e083fc-0fc7-5652-936e-3a40315f73e3/a0e083fc-0fc7-5652-936e-3a40315f73e3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVKZ2608%252F699074163%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074163/600 saved to cache
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0e083fc-0fc7-5652-936e-3a40315f73e3
2026-03-28 22:02:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0e083fc-0fc7-5652-936e-3a40315f73e3, skipping ID generation
2026-03-28 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0e083fc-0fc7-5652-936e-3a40315f73e3 sending to next pipeline
2026-03-28 22:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a0e083fc-0fc7-5652-936e-3a40315f73e3, identifier: VKZ%202608
2026-03-28 22:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a0e083fc-0fc7-5652-936e-3a40315f73e3 with identifier: VKZ%202608
2026-03-28 22:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a0e083fc-0fc7-5652-936e-3a40315f73e3 with identifier: VKZ%202608
2026-03-28 22:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a0e083fc-0fc7-5652-936e-3a40315f73e3 with identifier: VKZ%202608 to the API
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074163/600>
{'auction_title': '',
'c_o_2_emission_value': 169,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e083fc-0fc7-5652-936e-3a40315f73e3/a0e083fc-0fc7-5652-936e-3a40315f73e3_expert_report_file_29ac2c17-0b3e-40ea-ad8d-376b08f720f7.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VKZ%202608-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a0e083fc-0fc7-5652-936e-3a40315f73e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VKZ 2608',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VKZ%202608&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 128852,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e083fc-0fc7-5652-936e-3a40315f73e3/a0e083fc-0fc7-5652-936e-3a40315f73e3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48667,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074163/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e083fc-0fc7-5652-936e-3a40315f73e3/a0e083fc-0fc7-5652-936e-3a40315f73e3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46215,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074167/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e083fc-0fc7-5652-936e-3a40315f73e3/a0e083fc-0fc7-5652-936e-3a40315f73e3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43678,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074172/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e083fc-0fc7-5652-936e-3a40315f73e3/a0e083fc-0fc7-5652-936e-3a40315f73e3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41943,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074179/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e083fc-0fc7-5652-936e-3a40315f73e3/a0e083fc-0fc7-5652-936e-3a40315f73e3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39020,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074185/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e083fc-0fc7-5652-936e-3a40315f73e3/a0e083fc-0fc7-5652-936e-3a40315f73e3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37193,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074191/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e083fc-0fc7-5652-936e-3a40315f73e3/a0e083fc-0fc7-5652-936e-3a40315f73e3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99907,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074197/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e083fc-0fc7-5652-936e-3a40315f73e3/a0e083fc-0fc7-5652-936e-3a40315f73e3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59837,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074204/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e083fc-0fc7-5652-936e-3a40315f73e3/a0e083fc-0fc7-5652-936e-3a40315f73e3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93978,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074213/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e083fc-0fc7-5652-936e-3a40315f73e3/a0e083fc-0fc7-5652-936e-3a40315f73e3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84823,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VKZ2608/699074221/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'FORD FOCUS 2.0 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'TITANIUM',
'vin': 'WF0PXXGCDP8B12189',
'year': 2008}
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VKZ%25202608%27 HTTP/1.1" 200 None
2026-03-28 22:02:54 [bca.uk] INFO: Saving data for VKZ%202608: {'created_time': 1774735374.604453, 'last_price_update_time': 1774735374.604465, 'auction_closing_time': 1774864800.0}
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VKZ%25202608') HTTP/1.1" 204 0
2026-03-28 22:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000924/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000924>
2026-03-28 22:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031386/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BJ68UWN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126405/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HT19CVS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF12MYT/42810729?sv=2020-08-04&st=2026-03-28T22%3A02%3A53Z&se=2026-03-28T22%3A27%3A53Z&sr=b&sp=r&sig=nHFjMnwBFzMU1zyEasRXDPYGybeVhUB71rIUr1xyFl0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BF12%20MYT-GB>
2026-03-28 22:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC08XBB/42811084?sv=2020-08-04&st=2026-03-28T22%3A02%3A53Z&se=2026-03-28T22%3A27%3A53Z&sr=b&sp=r&sig=xK62%2B9MijGs2SiW%2FUaMz8MiEI%2Bw8pLNfo8XyMBO55R0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LC08%20XBB-GB>
2026-03-28 22:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994091/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994091>
2026-03-28 22:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189782/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS06XVF/42809475?sv=2020-08-04&st=2026-03-28T22%3A02%3A50Z&se=2026-03-28T22%3A27%3A50Z&sr=b&sp=r&sig=7Rd0007gIVtwgJc%2BuHu6suhKAfz0%2FmWCGr73AcdrD7s%3D)
2026-03-28 22:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189798/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS06XVF/42809475?sv=2020-08-04&st=2026-03-28T22%3A02%3A50Z&se=2026-03-28T22%3A27%3A50Z&sr=b&sp=r&sig=7Rd0007gIVtwgJc%2BuHu6suhKAfz0%2FmWCGr73AcdrD7s%3D)
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543de090>
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee972586-3286-5910-8d85-df63dfdcf24d/ee972586-3286-5910-8d85-df63dfdcf24d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS06XVF%252F699189747%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189747/600 saved to cache
2026-03-28 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee972586-3286-5910-8d85-df63dfdcf24d
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55423ad50>
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee972586-3286-5910-8d85-df63dfdcf24d/ee972586-3286-5910-8d85-df63dfdcf24d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS06XVF%252F699189736%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189736/600 saved to cache
2026-03-28 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee972586-3286-5910-8d85-df63dfdcf24d
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547762350>
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee972586-3286-5910-8d85-df63dfdcf24d/ee972586-3286-5910-8d85-df63dfdcf24d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS06XVF%252F699189740%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189740/600 saved to cache
2026-03-28 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee972586-3286-5910-8d85-df63dfdcf24d
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473dde50>
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5efd40b-81d0-5f93-9693-58ba123af3be/b5efd40b-81d0-5f93-9693-58ba123af3be_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT07FBY%252F699000928%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000928/600 saved to cache
2026-03-28 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b5efd40b-81d0-5f93-9693-58ba123af3be
2026-03-28 22:02:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547761cd0>
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5efd40b-81d0-5f93-9693-58ba123af3be/b5efd40b-81d0-5f93-9693-58ba123af3be_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT07FBY%252F699000970%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000970/600 saved to cache
2026-03-28 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b5efd40b-81d0-5f93-9693-58ba123af3be
2026-03-28 22:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189765/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY56ODW/42809574?sv=2020-08-04&st=2026-03-28T22%3A02%3A48Z&se=2026-03-28T22%3A27%3A48Z&sr=b&sp=r&sig=8fVzHiWrIaauGS6DCsPlv8wdZIhmrpcIGmHyoExhyuc%3D)
2026-03-28 22:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126412/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126412>
2026-03-28 22:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074183/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074183>
2026-03-28 22:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189755/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS06XVF/42809475?sv=2020-08-04&st=2026-03-28T22%3A02%3A50Z&se=2026-03-28T22%3A27%3A50Z&sr=b&sp=r&sig=7Rd0007gIVtwgJc%2BuHu6suhKAfz0%2FmWCGr73AcdrD7s%3D)
2026-03-28 22:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189767/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS06XVF/42809475?sv=2020-08-04&st=2026-03-28T22%3A02%3A50Z&se=2026-03-28T22%3A27%3A50Z&sr=b&sp=r&sig=7Rd0007gIVtwgJc%2BuHu6suhKAfz0%2FmWCGr73AcdrD7s%3D)
2026-03-28 22:02:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547365010>
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee972586-3286-5910-8d85-df63dfdcf24d/ee972586-3286-5910-8d85-df63dfdcf24d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS06XVF%252F699189782%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189782/600 saved to cache
2026-03-28 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee972586-3286-5910-8d85-df63dfdcf24d
2026-03-28 22:02:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547135310>
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee972586-3286-5910-8d85-df63dfdcf24d/ee972586-3286-5910-8d85-df63dfdcf24d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS06XVF%252F699189798%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189798/600 saved to cache
2026-03-28 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee972586-3286-5910-8d85-df63dfdcf24d
2026-03-28 22:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285790/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285790>
2026-03-28 22:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981057/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981057>
2026-03-28 22:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081007/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081007>
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549ac290>
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc0e7ef8-c401-5590-9e6c-d0083796c0be/dc0e7ef8-c401-5590-9e6c-d0083796c0be_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY56ODW%252F699189765%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189765/600 saved to cache
2026-03-28 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc0e7ef8-c401-5590-9e6c-d0083796c0be
2026-03-28 22:02:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc0e7ef8-c401-5590-9e6c-d0083796c0be, skipping ID generation
2026-03-28 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc0e7ef8-c401-5590-9e6c-d0083796c0be sending to next pipeline
2026-03-28 22:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dc0e7ef8-c401-5590-9e6c-d0083796c0be, identifier: YY56%20ODW
2026-03-28 22:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dc0e7ef8-c401-5590-9e6c-d0083796c0be with identifier: YY56%20ODW
2026-03-28 22:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dc0e7ef8-c401-5590-9e6c-d0083796c0be with identifier: YY56%20ODW
2026-03-28 22:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dc0e7ef8-c401-5590-9e6c-d0083796c0be with identifier: YY56%20ODW to the API
2026-03-28 22:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189765/600>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc0e7ef8-c401-5590-9e6c-d0083796c0be/dc0e7ef8-c401-5590-9e6c-d0083796c0be_expert_report_file_354095c5-2ea4-49d7-874c-c787ee2d2298.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YY56%20ODW-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'dc0e7ef8-c401-5590-9e6c-d0083796c0be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YY56 ODW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YY56%20ODW&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 115903,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc0e7ef8-c401-5590-9e6c-d0083796c0be/dc0e7ef8-c401-5590-9e6c-d0083796c0be_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40462,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189759/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc0e7ef8-c401-5590-9e6c-d0083796c0be/dc0e7ef8-c401-5590-9e6c-d0083796c0be_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41156,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189765/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc0e7ef8-c401-5590-9e6c-d0083796c0be/dc0e7ef8-c401-5590-9e6c-d0083796c0be_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38173,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189770/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc0e7ef8-c401-5590-9e6c-d0083796c0be/dc0e7ef8-c401-5590-9e6c-d0083796c0be_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39044,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189775/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc0e7ef8-c401-5590-9e6c-d0083796c0be/dc0e7ef8-c401-5590-9e6c-d0083796c0be_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39599,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189786/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc0e7ef8-c401-5590-9e6c-d0083796c0be/dc0e7ef8-c401-5590-9e6c-d0083796c0be_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38989,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189795/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc0e7ef8-c401-5590-9e6c-d0083796c0be/dc0e7ef8-c401-5590-9e6c-d0083796c0be_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99193,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189809/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc0e7ef8-c401-5590-9e6c-d0083796c0be/dc0e7ef8-c401-5590-9e6c-d0083796c0be_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76814,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189830/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc0e7ef8-c401-5590-9e6c-d0083796c0be/dc0e7ef8-c401-5590-9e6c-d0083796c0be_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83361,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189845/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc0e7ef8-c401-5590-9e6c-d0083796c0be/dc0e7ef8-c401-5590-9e6c-d0083796c0be_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72790,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56ODW/699189858/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.3 VVT-I ZINC MMT Hatchback',
'transmission': 'automatic',
'trim': 'VVT-I ZINC MMT',
'vin': 'VNKKL96350A138138',
'year': 2007}
2026-03-28 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY56%2520ODW%27 HTTP/1.1" 200 None
2026-03-28 22:02:55 [bca.uk] INFO: Saving data for YY56%20ODW: {'created_time': 1774735375.469346, 'last_price_update_time': 1774735375.469358, 'auction_closing_time': 1774864800.0}
2026-03-28 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YY56%2520ODW') HTTP/1.1" 204 0
2026-03-28 22:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000924/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT07FBY/42810797?sv=2020-08-04&st=2026-03-28T22%3A02%3A46Z&se=2026-03-28T22%3A27%3A46Z&sr=b&sp=r&sig=Ocei6JJU1dwDaO5Faxnq3iQo5eTP1n10igBRAXI9SK4%3D)
2026-03-28 22:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031386/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ68UWN/42811039?sv=2020-08-04&st=2026-03-28T22%3A01%3A10Z&se=2026-03-28T22%3A26%3A10Z&sr=b&sp=r&sig=1ZiFBHKVUwguyFOSNXk0RG8MN%2BDlXzRukHPnqyWqOFk%3D)
2026-03-28 22:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126405/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT19CVS/42811387?sv=2020-08-04&st=2026-03-28T22%3A01%3A08Z&se=2026-03-28T22%3A26%3A08Z&sr=b&sp=r&sig=Xezo2YoS0t9x6abxzIwcxCNA1wXAbFztVA4zM%2F%2Bntk8%3D)
2026-03-28 22:02:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058536/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058536>
2026-03-28 22:02:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966027/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966027>
2026-03-28 22:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994091/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN63OLH/42810834?sv=2020-08-04&st=2026-03-28T22%3A01%3A09Z&se=2026-03-28T22%3A26%3A09Z&sr=b&sp=r&sig=NMpNDT8TSdoKfgfMWv1wobNIeXn3SgscjQpSI5aPQXk%3D)
2026-03-28 22:02:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe563738550>
2026-03-28 22:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee972586-3286-5910-8d85-df63dfdcf24d/ee972586-3286-5910-8d85-df63dfdcf24d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS06XVF%252F699189755%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189755/600 saved to cache
2026-03-28 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee972586-3286-5910-8d85-df63dfdcf24d
2026-03-28 22:02:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:02:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:02:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:02:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477cecd0>
2026-03-28 22:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee972586-3286-5910-8d85-df63dfdcf24d/ee972586-3286-5910-8d85-df63dfdcf24d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS06XVF%252F699189767%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189767/600 saved to cache
2026-03-28 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee972586-3286-5910-8d85-df63dfdcf24d
2026-03-28 22:02:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee972586-3286-5910-8d85-df63dfdcf24d, skipping ID generation
2026-03-28 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee972586-3286-5910-8d85-df63dfdcf24d sending to next pipeline
2026-03-28 22:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ee972586-3286-5910-8d85-df63dfdcf24d, identifier: YS06%20XVF
2026-03-28 22:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ee972586-3286-5910-8d85-df63dfdcf24d with identifier: YS06%20XVF
2026-03-28 22:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ee972586-3286-5910-8d85-df63dfdcf24d with identifier: YS06%20XVF
2026-03-28 22:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ee972586-3286-5910-8d85-df63dfdcf24d with identifier: YS06%20XVF to the API
2026-03-28 22:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189767/600>
{'auction_title': '',
'c_o_2_emission_value': 184,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee972586-3286-5910-8d85-df63dfdcf24d/ee972586-3286-5910-8d85-df63dfdcf24d_expert_report_file_15ae65c8-f884-4bed-ad5b-555b76cabe3a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YS06%20XVF-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ee972586-3286-5910-8d85-df63dfdcf24d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YS06 XVF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YS06%20XVF&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 119669,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee972586-3286-5910-8d85-df63dfdcf24d/ee972586-3286-5910-8d85-df63dfdcf24d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41762,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189722/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee972586-3286-5910-8d85-df63dfdcf24d/ee972586-3286-5910-8d85-df63dfdcf24d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42042,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189727/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee972586-3286-5910-8d85-df63dfdcf24d/ee972586-3286-5910-8d85-df63dfdcf24d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38710,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189731/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee972586-3286-5910-8d85-df63dfdcf24d/ee972586-3286-5910-8d85-df63dfdcf24d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40043,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189736/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee972586-3286-5910-8d85-df63dfdcf24d/ee972586-3286-5910-8d85-df63dfdcf24d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37124,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189740/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee972586-3286-5910-8d85-df63dfdcf24d/ee972586-3286-5910-8d85-df63dfdcf24d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37024,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189747/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee972586-3286-5910-8d85-df63dfdcf24d/ee972586-3286-5910-8d85-df63dfdcf24d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66187,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189755/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee972586-3286-5910-8d85-df63dfdcf24d/ee972586-3286-5910-8d85-df63dfdcf24d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79652,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189767/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee972586-3286-5910-8d85-df63dfdcf24d/ee972586-3286-5910-8d85-df63dfdcf24d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89908,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189782/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee972586-3286-5910-8d85-df63dfdcf24d/ee972586-3286-5910-8d85-df63dfdcf24d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78306,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS06XVF/699189798/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 ZETEC CLIMATE Hatchback',
'transmission': 'automatic',
'trim': 'ZETEC CLIMATE',
'vin': 'WF05XXWPD56U20954',
'year': 2006}
2026-03-28 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS06%2520XVF%27 HTTP/1.1" 200 None
2026-03-28 22:02:56 [bca.uk] INFO: Saving data for YS06%20XVF: {'created_time': 1774735376.450475, 'last_price_update_time': 1774735376.450484, 'auction_closing_time': 1774864800.0}
2026-03-28 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YS06%2520XVF') HTTP/1.1" 204 0
2026-03-28 22:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF12MYT/42810729?sv=2020-08-04&st=2026-03-28T22%3A02%3A53Z&se=2026-03-28T22%3A27%3A53Z&sr=b&sp=r&sig=nHFjMnwBFzMU1zyEasRXDPYGybeVhUB71rIUr1xyFl0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC08XBB/42811084?sv=2020-08-04&st=2026-03-28T22%3A02%3A53Z&se=2026-03-28T22%3A27%3A53Z&sr=b&sp=r&sig=xK62%2B9MijGs2SiW%2FUaMz8MiEI%2Bw8pLNfo8XyMBO55R0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126412/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT70TDO/42811400?sv=2020-08-04&st=2026-03-28T22%3A01%3A09Z&se=2026-03-28T22%3A26%3A09Z&sr=b&sp=r&sig=sz4G2m%2Bww1tbH3aSNvJ2DJLyecaaL3NNq%2FlejxEYTpI%3D)
2026-03-28 22:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074183/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV03RSZ/42811210?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=XPdxTou37%2FSrb2139PEgleDE82DPAqY3LhSbwh%2FScoQ%3D)
2026-03-28 22:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081007/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX68XHM/42809660?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=LehtVWZLTGCUq%2FHVaWaxVcM6eZjoYBHWl7BsrTTno54%3D)
2026-03-28 22:02:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ67VEM/42791734?sv=2020-08-04&st=2026-03-28T22%3A02%3A55Z&se=2026-03-28T22%3A27%3A55Z&sr=b&sp=r&sig=aRp2e8voaQFNGNBQntrnH3BCsqhsjEpfLYOzq029Whc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ67%20VEM-GB>
2026-03-28 22:02:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966077/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966077>
2026-03-28 22:02:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP07ZRX/42810964?sv=2020-08-04&st=2026-03-28T22%3A02%3A55Z&se=2026-03-28T22%3A27%3A55Z&sr=b&sp=r&sig=ineLLrCg%2B1RldNyJZ5fTpgH%2BIym%2B22PLhonhjbuM15c%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YP07%20ZRX-GB>
2026-03-28 22:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54728ee50>
2026-03-28 22:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5efd40b-81d0-5f93-9693-58ba123af3be/b5efd40b-81d0-5f93-9693-58ba123af3be_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT07FBY%252F699000924%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000924/600 saved to cache
2026-03-28 22:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b5efd40b-81d0-5f93-9693-58ba123af3be
2026-03-28 22:02:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5efd40b-81d0-5f93-9693-58ba123af3be, skipping ID generation
2026-03-28 22:02:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5efd40b-81d0-5f93-9693-58ba123af3be sending to next pipeline
2026-03-28 22:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b5efd40b-81d0-5f93-9693-58ba123af3be, identifier: MT07%20FBY
2026-03-28 22:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544ab790>
2026-03-28 22:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f05d113-747f-52ed-a1ad-9799bad35377/7f05d113-747f-52ed-a1ad-9799bad35377_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ68UWN%252F699031386%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031386/600 saved to cache
2026-03-28 22:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f05d113-747f-52ed-a1ad-9799bad35377
2026-03-28 22:02:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f05d113-747f-52ed-a1ad-9799bad35377, skipping ID generation
2026-03-28 22:02:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f05d113-747f-52ed-a1ad-9799bad35377 sending to next pipeline
2026-03-28 22:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7f05d113-747f-52ed-a1ad-9799bad35377, identifier: BJ68%20UWN
2026-03-28 22:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554283910>
2026-03-28 22:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b3f5c4-70ca-530a-a56a-701b7ee98ebe/d2b3f5c4-70ca-530a-a56a-701b7ee98ebe_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT19CVS%252F699126405%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126405/600 saved to cache
2026-03-28 22:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2b3f5c4-70ca-530a-a56a-701b7ee98ebe
2026-03-28 22:02:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2b3f5c4-70ca-530a-a56a-701b7ee98ebe, skipping ID generation
2026-03-28 22:02:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2b3f5c4-70ca-530a-a56a-701b7ee98ebe sending to next pipeline
2026-03-28 22:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d2b3f5c4-70ca-530a-a56a-701b7ee98ebe, identifier: HT19%20CVS
2026-03-28 22:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547757c10>
2026-03-28 22:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39f18d5c-38c9-5802-bc90-29e03976b40f/39f18d5c-38c9-5802-bc90-29e03976b40f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN63OLH%252F698994091%252F600') HTTP/1.1" 204 0
2026-03-28 22:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994091/600 saved to cache
2026-03-28 22:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 39f18d5c-38c9-5802-bc90-29e03976b40f
2026-03-28 22:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b5efd40b-81d0-5f93-9693-58ba123af3be with identifier: MT07%20FBY
2026-03-28 22:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b5efd40b-81d0-5f93-9693-58ba123af3be with identifier: MT07%20FBY
2026-03-28 22:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b5efd40b-81d0-5f93-9693-58ba123af3be with identifier: MT07%20FBY to the API
2026-03-28 22:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000924/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5efd40b-81d0-5f93-9693-58ba123af3be/b5efd40b-81d0-5f93-9693-58ba123af3be_expert_report_file_0948bcee-d7dc-49cc-af2d-cec07958f669.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT07%20FBY-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b5efd40b-81d0-5f93-9693-58ba123af3be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT07 FBY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT07%20FBY&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'HONDA',
'model': 'CIVIC',
'odometer': 140738,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5efd40b-81d0-5f93-9693-58ba123af3be/b5efd40b-81d0-5f93-9693-58ba123af3be_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39592,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000862/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5efd40b-81d0-5f93-9693-58ba123af3be/b5efd40b-81d0-5f93-9693-58ba123af3be_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35555,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000876/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5efd40b-81d0-5f93-9693-58ba123af3be/b5efd40b-81d0-5f93-9693-58ba123af3be_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40262,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000896/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5efd40b-81d0-5f93-9693-58ba123af3be/b5efd40b-81d0-5f93-9693-58ba123af3be_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37996,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000910/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5efd40b-81d0-5f93-9693-58ba123af3be/b5efd40b-81d0-5f93-9693-58ba123af3be_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35388,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000924/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5efd40b-81d0-5f93-9693-58ba123af3be/b5efd40b-81d0-5f93-9693-58ba123af3be_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34171,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000928/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5efd40b-81d0-5f93-9693-58ba123af3be/b5efd40b-81d0-5f93-9693-58ba123af3be_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70778,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000948/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5efd40b-81d0-5f93-9693-58ba123af3be/b5efd40b-81d0-5f93-9693-58ba123af3be_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77276,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699000970/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5efd40b-81d0-5f93-9693-58ba123af3be/b5efd40b-81d0-5f93-9693-58ba123af3be_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90936,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699001004/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5efd40b-81d0-5f93-9693-58ba123af3be/b5efd40b-81d0-5f93-9693-58ba123af3be_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72304,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT07FBY/699001033/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'HONDA CIVIC 1.4 I-DSI SE I-SHIFT Hatchback',
'transmission': 'automatic',
'trim': 'I-DSI SE I-SHIFT',
'vin': 'SHHFK18407U013324',
'year': 2007}
2026-03-28 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT07%2520FBY%27 HTTP/1.1" 200 None
2026-03-28 22:02:57 [bca.uk] INFO: Saving data for MT07%20FBY: {'created_time': 1774735377.253475, 'last_price_update_time': 1774735377.253485, 'auction_closing_time': 1774864800.0}
2026-03-28 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT07%2520FBY') HTTP/1.1" 204 0
2026-03-28 22:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7f05d113-747f-52ed-a1ad-9799bad35377 with identifier: BJ68%20UWN
2026-03-28 22:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7f05d113-747f-52ed-a1ad-9799bad35377 with identifier: BJ68%20UWN
2026-03-28 22:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7f05d113-747f-52ed-a1ad-9799bad35377 with identifier: BJ68%20UWN to the API
2026-03-28 22:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031386/600>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f05d113-747f-52ed-a1ad-9799bad35377/7f05d113-747f-52ed-a1ad-9799bad35377_expert_report_file_c3ac6563-da9a-4d07-b035-ce34701a17d9.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ68%20UWN-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7f05d113-747f-52ed-a1ad-9799bad35377',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BJ68 UWN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BJ68%20UWN&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 76699,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f05d113-747f-52ed-a1ad-9799bad35377/7f05d113-747f-52ed-a1ad-9799bad35377_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37384,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031386/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f05d113-747f-52ed-a1ad-9799bad35377/7f05d113-747f-52ed-a1ad-9799bad35377_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37689,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031396/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f05d113-747f-52ed-a1ad-9799bad35377/7f05d113-747f-52ed-a1ad-9799bad35377_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36202,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031407/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f05d113-747f-52ed-a1ad-9799bad35377/7f05d113-747f-52ed-a1ad-9799bad35377_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35111,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031421/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f05d113-747f-52ed-a1ad-9799bad35377/7f05d113-747f-52ed-a1ad-9799bad35377_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33954,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031439/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f05d113-747f-52ed-a1ad-9799bad35377/7f05d113-747f-52ed-a1ad-9799bad35377_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34293,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031464/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f05d113-747f-52ed-a1ad-9799bad35377/7f05d113-747f-52ed-a1ad-9799bad35377_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71431,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031495/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f05d113-747f-52ed-a1ad-9799bad35377/7f05d113-747f-52ed-a1ad-9799bad35377_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53360,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031527/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f05d113-747f-52ed-a1ad-9799bad35377/7f05d113-747f-52ed-a1ad-9799bad35377_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78203,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031550/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f05d113-747f-52ed-a1ad-9799bad35377/7f05d113-747f-52ed-a1ad-9799bad35377_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76978,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ68UWN/699031575/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 125 ZETEC EDITION Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 ZETEC EDITION',
'vin': 'WF05XXGCC5JT29100',
'year': 2018}
2026-03-28 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ68%2520UWN%27 HTTP/1.1" 200 None
2026-03-28 22:02:58 [bca.uk] INFO: Saving data for BJ68%20UWN: {'created_time': 1774735378.505773, 'last_price_update_time': 1774735378.505786, 'auction_closing_time': 1774951200.0}
2026-03-28 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BJ68%2520UWN') HTTP/1.1" 204 0
2026-03-28 22:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d2b3f5c4-70ca-530a-a56a-701b7ee98ebe with identifier: HT19%20CVS
2026-03-28 22:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d2b3f5c4-70ca-530a-a56a-701b7ee98ebe with identifier: HT19%20CVS
2026-03-28 22:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d2b3f5c4-70ca-530a-a56a-701b7ee98ebe with identifier: HT19%20CVS to the API
2026-03-28 22:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126405/600>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b3f5c4-70ca-530a-a56a-701b7ee98ebe/d2b3f5c4-70ca-530a-a56a-701b7ee98ebe_expert_report_file_7917b8d7-9b13-45a9-a020-204974c04ad6.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HT19%20CVS-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.9L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd2b3f5c4-70ca-530a-a56a-701b7ee98ebe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HT19 CVS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HT19%20CVS&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 41159,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b3f5c4-70ca-530a-a56a-701b7ee98ebe/d2b3f5c4-70ca-530a-a56a-701b7ee98ebe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38482,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126405/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b3f5c4-70ca-530a-a56a-701b7ee98ebe/d2b3f5c4-70ca-530a-a56a-701b7ee98ebe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38400,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126416/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b3f5c4-70ca-530a-a56a-701b7ee98ebe/d2b3f5c4-70ca-530a-a56a-701b7ee98ebe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37774,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126433/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b3f5c4-70ca-530a-a56a-701b7ee98ebe/d2b3f5c4-70ca-530a-a56a-701b7ee98ebe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36913,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126460/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b3f5c4-70ca-530a-a56a-701b7ee98ebe/d2b3f5c4-70ca-530a-a56a-701b7ee98ebe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32921,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126485/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b3f5c4-70ca-530a-a56a-701b7ee98ebe/d2b3f5c4-70ca-530a-a56a-701b7ee98ebe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33065,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126505/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b3f5c4-70ca-530a-a56a-701b7ee98ebe/d2b3f5c4-70ca-530a-a56a-701b7ee98ebe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55858,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126531/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b3f5c4-70ca-530a-a56a-701b7ee98ebe/d2b3f5c4-70ca-530a-a56a-701b7ee98ebe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60732,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126547/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b3f5c4-70ca-530a-a56a-701b7ee98ebe/d2b3f5c4-70ca-530a-a56a-701b7ee98ebe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73306,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126568/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b3f5c4-70ca-530a-a56a-701b7ee98ebe/d2b3f5c4-70ca-530a-a56a-701b7ee98ebe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63443,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19CVS/699126590/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'RENAULT CLIO 0.9 TCE 90 ICONIC Hatchback',
'transmission': 'manual',
'trim': 'TCE 90 ICONIC',
'vin': 'VF1R9800062734886',
'year': 2019}
2026-03-28 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT19%2520CVS%27 HTTP/1.1" 200 None
2026-03-28 22:02:59 [bca.uk] INFO: Saving data for HT19%20CVS: {'created_time': 1774735379.866401, 'last_price_update_time': 1774735379.866411, 'auction_closing_time': 1774951200.0}
2026-03-28 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HT19%2520CVS') HTTP/1.1" 204 0
2026-03-28 22:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058536/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ12NEO/42811151?sv=2020-08-04&st=2026-03-28T22%3A01%3A05Z&se=2026-03-28T22%3A26%3A05Z&sr=b&sp=r&sig=62h1oUPBDkzrRTgiSRZPyg2OGFZw9gvgjM6%2Bng4Eeco%3D)
2026-03-28 22:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699080991/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699080991>
2026-03-28 22:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126403/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126403>
2026-03-28 22:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074176/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699074176>
2026-03-28 22:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994074/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CN63OLH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285790/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV69BJO/42810768?sv=2020-08-04&st=2026-03-28T22%3A01%3A08Z&se=2026-03-28T22%3A26%3A08Z&sr=b&sp=r&sig=RhBgWIDbmwF%2F8XqW9pjzomUmOVaJM8ThWq2ap8w7j1M%3D)
2026-03-28 22:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966027/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD57OLK/42810740?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=6hm7fODnR3wBKimIVKSkEorWvM8%2B5kHNq4nMJt6A%2BvY%3D)
2026-03-28 22:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981057/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND62EWM/42810799?sv=2020-08-04&st=2026-03-28T22%3A01%3A06Z&se=2026-03-28T22%3A26%3A06Z&sr=b&sp=r&sig=KD3C6SJzwrdEgIjlL7QRYHJfSgh8rbJ%2FPC%2F%2BEfVah7k%3D)
2026-03-28 22:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544aa890>
2026-03-28 22:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3301d1-7f13-5013-82e2-ed3f1a597939/be3301d1-7f13-5013-82e2-ed3f1a597939_expert_report_file_2f03d12b-b760-446b-97bd-e2f1a8e7f60a.pdf HTTP/1.1" 201 0
2026-03-28 22:02:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item be3301d1-7f13-5013-82e2-ed3f1a597939
2026-03-28 22:02:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be3301d1-7f13-5013-82e2-ed3f1a597939, skipping ID generation
2026-03-28 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item be3301d1-7f13-5013-82e2-ed3f1a597939
2026-03-28 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBF12MYT-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BF12MYT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554238d50>
2026-03-28 22:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85ebd75-b202-5555-83e0-f40ad749d770/f85ebd75-b202-5555-83e0-f40ad749d770_expert_report_file_7e10b15a-5db5-48c3-badf-cef56fd86bed.pdf HTTP/1.1" 201 0
2026-03-28 22:03:00 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f85ebd75-b202-5555-83e0-f40ad749d770
2026-03-28 22:03:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f85ebd75-b202-5555-83e0-f40ad749d770, skipping ID generation
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f85ebd75-b202-5555-83e0-f40ad749d770
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLC08XBB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LC08XBB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544dc210>
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d540cd8f-d715-5405-a8d5-11721b31b439/d540cd8f-d715-5405-a8d5-11721b31b439_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT70TDO%252F699126412%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126412/600 saved to cache
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d540cd8f-d715-5405-a8d5-11721b31b439
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55480a1d0>
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8076e5d-cb8b-5578-9e3b-020e67e6d8b5/d8076e5d-cb8b-5578-9e3b-020e67e6d8b5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV03RSZ%252F699074183%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074183/600 saved to cache
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d8076e5d-cb8b-5578-9e3b-020e67e6d8b5
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55423ba50>
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502dec79-4436-5ea8-b8a4-1afd151a13a2/502dec79-4436-5ea8-b8a4-1afd151a13a2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX68XHM%252F699081007%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081007/600 saved to cache
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 502dec79-4436-5ea8-b8a4-1afd151a13a2
2026-03-28 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981039/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981039>
2026-03-28 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966013/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966013>
2026-03-28 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058527/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058527>
2026-03-28 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285782/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285782>
2026-03-28 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO16OOC/42804916?sv=2020-08-04&st=2026-03-28T22%3A02%3A59Z&se=2026-03-28T22%3A27%3A59Z&sr=b&sp=r&sig=IPhuMCbNLcDWB4o3Qn3QcPs2vdSL6YhQsTjfdKyEDcc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO16%20OOC-GB>
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000857%27 HTTP/1.1" 200 None
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000857 not downloaded yet
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699049688%27 HTTP/1.1" 200 None
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049688 not downloaded yet
2026-03-28 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966077/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VA62BTY/42810684?sv=2020-08-04&st=2026-03-28T22%3A01%3A03Z&se=2026-03-28T22%3A26%3A03Z&sr=b&sp=r&sig=N35MQzuEGC1T9OsmIXtmUT3IIUk5%2F7R2XsmdyzT4d0M%3D)
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477ed590>
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf9384a7-c2b5-5829-81c5-0ab07891768a/cf9384a7-c2b5-5829-81c5-0ab07891768a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ12NEO%252F699058536%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058536/600 saved to cache
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf9384a7-c2b5-5829-81c5-0ab07891768a
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473803d0>
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbce9e71-f6f9-5b70-87a1-2cf7e0368db6/fbce9e71-f6f9-5b70-87a1-2cf7e0368db6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV69BJO%252F699285790%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285790/600 saved to cache
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fbce9e71-f6f9-5b70-87a1-2cf7e0368db6
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f9b6d0>
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f1a744f-dcf7-513c-adf2-49d9ca828470/8f1a744f-dcf7-513c-adf2-49d9ca828470_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD57OLK%252F698966027%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966027/600 saved to cache
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f1a744f-dcf7-513c-adf2-49d9ca828470
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473803d0>
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc2a305-976b-5d20-86ca-43ed711c23db/1fc2a305-976b-5d20-86ca-43ed711c23db_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND62EWM%252F698981057%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981057/600 saved to cache
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1fc2a305-976b-5d20-86ca-43ed711c23db
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000870%27 HTTP/1.1" 200 None
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000870 not downloaded yet
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699049699%27 HTTP/1.1" 200 None
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049699 not downloaded yet
2026-03-28 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ67VEM/42791734?sv=2020-08-04&st=2026-03-28T22%3A02%3A55Z&se=2026-03-28T22%3A27%3A55Z&sr=b&sp=r&sig=aRp2e8voaQFNGNBQntrnH3BCsqhsjEpfLYOzq029Whc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP07ZRX/42810964?sv=2020-08-04&st=2026-03-28T22%3A02%3A55Z&se=2026-03-28T22%3A27%3A55Z&sr=b&sp=r&sig=ineLLrCg%2B1RldNyJZ5fTpgH%2BIym%2B22PLhonhjbuM15c%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000881%27 HTTP/1.1" 200 None
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000881 not downloaded yet
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699049711%27 HTTP/1.1" 200 None
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049711 not downloaded yet
2026-03-28 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547496190>
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44fab252-6185-51e4-87e9-3f4c2a42edd8/44fab252-6185-51e4-87e9-3f4c2a42edd8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVA62BTY%252F698966077%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966077/600 saved to cache
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 44fab252-6185-51e4-87e9-3f4c2a42edd8
2026-03-28 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699080991/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX68XHM/42809660?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=LehtVWZLTGCUq%2FHVaWaxVcM6eZjoYBHWl7BsrTTno54%3D)
2026-03-28 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994074/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN63OLH/42810834?sv=2020-08-04&st=2026-03-28T22%3A01%3A09Z&se=2026-03-28T22%3A26%3A09Z&sr=b&sp=r&sig=NMpNDT8TSdoKfgfMWv1wobNIeXn3SgscjQpSI5aPQXk%3D)
2026-03-28 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074176/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV03RSZ/42811210?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=XPdxTou37%2FSrb2139PEgleDE82DPAqY3LhSbwh%2FScoQ%3D)
2026-03-28 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966068/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966068>
2026-03-28 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE59VRX/42810877?sv=2020-08-04&st=2026-03-28T22%3A03%3A00Z&se=2026-03-28T22%3A28%3A00Z&sr=b&sp=r&sig=6HdncOqF%2FQAeBC1Cor8GiUoAjsKrswoLj4OuWjoWyf8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YE59%20VRX-GB>
2026-03-28 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126403/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT70TDO/42811400?sv=2020-08-04&st=2026-03-28T22%3A01%3A09Z&se=2026-03-28T22%3A26%3A09Z&sr=b&sp=r&sig=sz4G2m%2Bww1tbH3aSNvJ2DJLyecaaL3NNq%2FlejxEYTpI%3D)
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000895%27 HTTP/1.1" 200 None
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000895 not downloaded yet
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699049722%27 HTTP/1.1" 200 None
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049722 not downloaded yet
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000909%27 HTTP/1.1" 200 None
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000909 not downloaded yet
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699049731%27 HTTP/1.1" 200 None
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049731 not downloaded yet
2026-03-28 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074170/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AV03RSZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126399/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LT70TDO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000940%27 HTTP/1.1" 200 None
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000940 not downloaded yet
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699049747%27 HTTP/1.1" 200 None
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049747 not downloaded yet
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542ffa50>
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0b8d3c-494f-51dc-ba6a-63cfe435e086/3c0b8d3c-494f-51dc-ba6a-63cfe435e086_expert_report_file_dc5332fc-3a98-4491-8bc0-e3cf5f737853.pdf HTTP/1.1" 201 0
2026-03-28 22:03:00 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3c0b8d3c-494f-51dc-ba6a-63cfe435e086
2026-03-28 22:03:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c0b8d3c-494f-51dc-ba6a-63cfe435e086, skipping ID generation
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c0b8d3c-494f-51dc-ba6a-63cfe435e086
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWJ67VEM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WJ67VEM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473fb890>
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9778d0fc-88ae-5ce5-b8be-dfaa70e989c2/9778d0fc-88ae-5ce5-b8be-dfaa70e989c2_expert_report_file_98e97749-4515-40ce-a631-1ba5d5b46c44.pdf HTTP/1.1" 201 0
2026-03-28 22:03:00 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2
2026-03-28 22:03:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2, skipping ID generation
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYP07ZRX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YP07ZRX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285782/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV69BJO/42810768?sv=2020-08-04&st=2026-03-28T22%3A01%3A08Z&se=2026-03-28T22%3A26%3A08Z&sr=b&sp=r&sig=RhBgWIDbmwF%2F8XqW9pjzomUmOVaJM8ThWq2ap8w7j1M%3D)
2026-03-28 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966013/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD57OLK/42810740?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=6hm7fODnR3wBKimIVKSkEorWvM8%2B5kHNq4nMJt6A%2BvY%3D)
2026-03-28 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058527/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ12NEO/42811151?sv=2020-08-04&st=2026-03-28T22%3A01%3A05Z&se=2026-03-28T22%3A26%3A05Z&sr=b&sp=r&sig=62h1oUPBDkzrRTgiSRZPyg2OGFZw9gvgjM6%2Bng4Eeco%3D)
2026-03-28 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049678/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LC08XBB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981039/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND62EWM/42810799?sv=2020-08-04&st=2026-03-28T22%3A01%3A06Z&se=2026-03-28T22%3A26%3A06Z&sr=b&sp=r&sig=KD3C6SJzwrdEgIjlL7QRYHJfSgh8rbJ%2FPC%2F%2BEfVah7k%3D)
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000963%27 HTTP/1.1" 200 None
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000963 not downloaded yet
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699049765%27 HTTP/1.1" 200 None
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049765 not downloaded yet
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189522%27 HTTP/1.1" 200 None
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189522 not downloaded yet
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024872%27 HTTP/1.1" 200 None
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024872 not downloaded yet
2026-03-28 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO16OOC/42804916?sv=2020-08-04&st=2026-03-28T22%3A02%3A59Z&se=2026-03-28T22%3A27%3A59Z&sr=b&sp=r&sig=IPhuMCbNLcDWB4o3Qn3QcPs2vdSL6YhQsTjfdKyEDcc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049699/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049699>
2026-03-28 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000870/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000870>
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699001008%27 HTTP/1.1" 200 None
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001008 not downloaded yet
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699049793%27 HTTP/1.1" 200 None
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049793 not downloaded yet
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189530%27 HTTP/1.1" 200 None
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189530 not downloaded yet
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024877%27 HTTP/1.1" 200 None
2026-03-28 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024877 not downloaded yet
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547117f10>
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502dec79-4436-5ea8-b8a4-1afd151a13a2/502dec79-4436-5ea8-b8a4-1afd151a13a2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX68XHM%252F699080991%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699080991/600 saved to cache
2026-03-28 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 502dec79-4436-5ea8-b8a4-1afd151a13a2
2026-03-28 22:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55456cdd0>
2026-03-28 22:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39f18d5c-38c9-5802-bc90-29e03976b40f/39f18d5c-38c9-5802-bc90-29e03976b40f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN63OLH%252F698994074%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994074/600 saved to cache
2026-03-28 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39f18d5c-38c9-5802-bc90-29e03976b40f
2026-03-28 22:03:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39f18d5c-38c9-5802-bc90-29e03976b40f, skipping ID generation
2026-03-28 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39f18d5c-38c9-5802-bc90-29e03976b40f sending to next pipeline
2026-03-28 22:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 39f18d5c-38c9-5802-bc90-29e03976b40f, identifier: CN63%20OLH
2026-03-28 22:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54722c910>
2026-03-28 22:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8076e5d-cb8b-5578-9e3b-020e67e6d8b5/d8076e5d-cb8b-5578-9e3b-020e67e6d8b5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV03RSZ%252F699074176%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074176/600 saved to cache
2026-03-28 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d8076e5d-cb8b-5578-9e3b-020e67e6d8b5
2026-03-28 22:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554826e10>
2026-03-28 22:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d540cd8f-d715-5405-a8d5-11721b31b439/d540cd8f-d715-5405-a8d5-11721b31b439_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT70TDO%252F699126403%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126403/600 saved to cache
2026-03-28 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d540cd8f-d715-5405-a8d5-11721b31b439
2026-03-28 22:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966068/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VA62BTY/42810684?sv=2020-08-04&st=2026-03-28T22%3A01%3A03Z&se=2026-03-28T22%3A26%3A03Z&sr=b&sp=r&sig=N35MQzuEGC1T9OsmIXtmUT3IIUk5%2F7R2XsmdyzT4d0M%3D)
2026-03-28 22:03:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000881/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000881>
2026-03-28 22:03:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049688/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049688>
2026-03-28 22:03:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049711/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049711>
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699001034%27 HTTP/1.1" 200 None
2026-03-28 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001034 not downloaded yet
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699049815%27 HTTP/1.1" 200 None
2026-03-28 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049815 not downloaded yet
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189534%27 HTTP/1.1" 200 None
2026-03-28 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189534 not downloaded yet
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024878%27 HTTP/1.1" 200 None
2026-03-28 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024878 not downloaded yet
2026-03-28 22:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 39f18d5c-38c9-5802-bc90-29e03976b40f with identifier: CN63%20OLH
2026-03-28 22:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 39f18d5c-38c9-5802-bc90-29e03976b40f with identifier: CN63%20OLH
2026-03-28 22:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 39f18d5c-38c9-5802-bc90-29e03976b40f with identifier: CN63%20OLH to the API
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994074/600>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f18d5c-38c9-5802-bc90-29e03976b40f/39f18d5c-38c9-5802-bc90-29e03976b40f_expert_report_file_8795e20d-36cc-4ce2-8133-87a9f26c8864.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CN63%20OLH-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '39f18d5c-38c9-5802-bc90-29e03976b40f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CN63 OLH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CN63%20OLH&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VOLVO',
'model': 'V60 SPORTWAGON',
'odometer': 135388,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f18d5c-38c9-5802-bc90-29e03976b40f/39f18d5c-38c9-5802-bc90-29e03976b40f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41241,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994074/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f18d5c-38c9-5802-bc90-29e03976b40f/39f18d5c-38c9-5802-bc90-29e03976b40f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40676,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994091/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f18d5c-38c9-5802-bc90-29e03976b40f/39f18d5c-38c9-5802-bc90-29e03976b40f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40146,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994106/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f18d5c-38c9-5802-bc90-29e03976b40f/39f18d5c-38c9-5802-bc90-29e03976b40f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39571,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994130/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f18d5c-38c9-5802-bc90-29e03976b40f/39f18d5c-38c9-5802-bc90-29e03976b40f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34957,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994141/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f18d5c-38c9-5802-bc90-29e03976b40f/39f18d5c-38c9-5802-bc90-29e03976b40f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34552,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994151/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f18d5c-38c9-5802-bc90-29e03976b40f/39f18d5c-38c9-5802-bc90-29e03976b40f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69639,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994176/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f18d5c-38c9-5802-bc90-29e03976b40f/39f18d5c-38c9-5802-bc90-29e03976b40f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75169,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994196/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f18d5c-38c9-5802-bc90-29e03976b40f/39f18d5c-38c9-5802-bc90-29e03976b40f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63614,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994217/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f18d5c-38c9-5802-bc90-29e03976b40f/39f18d5c-38c9-5802-bc90-29e03976b40f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57735,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN63OLH/698994240/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VOLVO V60 SPORTWAGON 1.6 D2 115 BUSINESS EDITION P/S Estate',
'transmission': 'automatic',
'trim': 'D2 115 BUSINESS EDITION P/S',
'vin': 'YV1FW848BE1157465',
'year': 2013}
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN63%2520OLH%27 HTTP/1.1" 200 None
2026-03-28 22:03:01 [bca.uk] INFO: Saving data for CN63%20OLH: {'created_time': 1774735381.927656, 'last_price_update_time': 1774735381.927669, 'auction_closing_time': 1774864800.0}
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CN63%2520OLH') HTTP/1.1" 204 0
2026-03-28 22:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473638d0>
2026-03-28 22:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbce9e71-f6f9-5b70-87a1-2cf7e0368db6/fbce9e71-f6f9-5b70-87a1-2cf7e0368db6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV69BJO%252F699285782%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285782/600 saved to cache
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fbce9e71-f6f9-5b70-87a1-2cf7e0368db6
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5572a5250>
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f1a744f-dcf7-513c-adf2-49d9ca828470/8f1a744f-dcf7-513c-adf2-49d9ca828470_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD57OLK%252F698966013%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966013/600 saved to cache
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f1a744f-dcf7-513c-adf2-49d9ca828470
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54724b2d0>
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf9384a7-c2b5-5829-81c5-0ab07891768a/cf9384a7-c2b5-5829-81c5-0ab07891768a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ12NEO%252F699058527%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058527/600 saved to cache
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf9384a7-c2b5-5829-81c5-0ab07891768a
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477d8cd0>
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc2a305-976b-5d20-86ca-43ed711c23db/1fc2a305-976b-5d20-86ca-43ed711c23db_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND62EWM%252F698981039%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981039/600 saved to cache
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1fc2a305-976b-5d20-86ca-43ed711c23db
2026-03-28 22:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126399/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT70TDO/42811400?sv=2020-08-04&st=2026-03-28T22%3A01%3A09Z&se=2026-03-28T22%3A26%3A09Z&sr=b&sp=r&sig=sz4G2m%2Bww1tbH3aSNvJ2DJLyecaaL3NNq%2FlejxEYTpI%3D)
2026-03-28 22:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074170/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV03RSZ/42811210?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=XPdxTou37%2FSrb2139PEgleDE82DPAqY3LhSbwh%2FScoQ%3D)
2026-03-28 22:03:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000857/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000857>
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189541%27 HTTP/1.1" 200 None
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189541 not downloaded yet
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024881%27 HTTP/1.1" 200 None
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024881 not downloaded yet
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189547%27 HTTP/1.1" 200 None
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189547 not downloaded yet
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024885%27 HTTP/1.1" 200 None
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024885 not downloaded yet
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554ae6490>
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a483ecb-536a-5a7a-b51b-bc1d2c782d27/5a483ecb-536a-5a7a-b51b-bc1d2c782d27_expert_report_file_dd1f2f52-36a1-4337-b1e3-39cbf611f02e.pdf HTTP/1.1" 201 0
2026-03-28 22:03:02 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5a483ecb-536a-5a7a-b51b-bc1d2c782d27
2026-03-28 22:03:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a483ecb-536a-5a7a-b51b-bc1d2c782d27, skipping ID generation
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a483ecb-536a-5a7a-b51b-bc1d2c782d27
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DVO16OOC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VO16OOC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554934b10>
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44fab252-6185-51e4-87e9-3f4c2a42edd8/44fab252-6185-51e4-87e9-3f4c2a42edd8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVA62BTY%252F698966068%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966068/600 saved to cache
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 44fab252-6185-51e4-87e9-3f4c2a42edd8
2026-03-28 22:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE59VRX/42810877?sv=2020-08-04&st=2026-03-28T22%3A03%3A00Z&se=2026-03-28T22%3A28%3A00Z&sr=b&sp=r&sig=6HdncOqF%2FQAeBC1Cor8GiUoAjsKrswoLj4OuWjoWyf8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049678/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC08XBB/42811084?sv=2020-08-04&st=2026-03-28T22%3A02%3A53Z&se=2026-03-28T22%3A27%3A53Z&sr=b&sp=r&sig=xK62%2B9MijGs2SiW%2FUaMz8MiEI%2Bw8pLNfo8XyMBO55R0%3D)
2026-03-28 22:03:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024867/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YP07ZRX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049747/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049747>
2026-03-28 22:03:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189517/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WJ67VEM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049699/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC08XBB/42811084?sv=2020-08-04&st=2026-03-28T22%3A02%3A53Z&se=2026-03-28T22%3A27%3A53Z&sr=b&sp=r&sig=xK62%2B9MijGs2SiW%2FUaMz8MiEI%2Bw8pLNfo8XyMBO55R0%3D)
2026-03-28 22:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000870/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF12MYT/42810729?sv=2020-08-04&st=2026-03-28T22%3A02%3A53Z&se=2026-03-28T22%3A27%3A53Z&sr=b&sp=r&sig=nHFjMnwBFzMU1zyEasRXDPYGybeVhUB71rIUr1xyFl0%3D)
2026-03-28 22:03:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000940/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000940>
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189560%27 HTTP/1.1" 200 None
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189560 not downloaded yet
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024889%27 HTTP/1.1" 200 None
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024889 not downloaded yet
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189408%27 HTTP/1.1" 200 None
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189408 not downloaded yet
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189573%27 HTTP/1.1" 200 None
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189573 not downloaded yet
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024892%27 HTTP/1.1" 200 None
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024892 not downloaded yet
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189417%27 HTTP/1.1" 200 None
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189417 not downloaded yet
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542dbc50>
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d540cd8f-d715-5405-a8d5-11721b31b439/d540cd8f-d715-5405-a8d5-11721b31b439_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT70TDO%252F699126399%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126399/600 saved to cache
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d540cd8f-d715-5405-a8d5-11721b31b439
2026-03-28 22:03:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d540cd8f-d715-5405-a8d5-11721b31b439, skipping ID generation
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d540cd8f-d715-5405-a8d5-11721b31b439 sending to next pipeline
2026-03-28 22:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d540cd8f-d715-5405-a8d5-11721b31b439, identifier: LT70%20TDO
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547291a90>
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8076e5d-cb8b-5578-9e3b-020e67e6d8b5/d8076e5d-cb8b-5578-9e3b-020e67e6d8b5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV03RSZ%252F699074170%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074170/600 saved to cache
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8076e5d-cb8b-5578-9e3b-020e67e6d8b5
2026-03-28 22:03:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8076e5d-cb8b-5578-9e3b-020e67e6d8b5, skipping ID generation
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8076e5d-cb8b-5578-9e3b-020e67e6d8b5 sending to next pipeline
2026-03-28 22:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d8076e5d-cb8b-5578-9e3b-020e67e6d8b5, identifier: AV03%20RSZ
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189587%27 HTTP/1.1" 200 None
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189587 not downloaded yet
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024895%27 HTTP/1.1" 200 None
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024895 not downloaded yet
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189420%27 HTTP/1.1" 200 None
2026-03-28 22:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189420 not downloaded yet
2026-03-28 22:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d540cd8f-d715-5405-a8d5-11721b31b439 with identifier: LT70%20TDO
2026-03-28 22:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d540cd8f-d715-5405-a8d5-11721b31b439 with identifier: LT70%20TDO
2026-03-28 22:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d540cd8f-d715-5405-a8d5-11721b31b439 with identifier: LT70%20TDO to the API
2026-03-28 22:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126399/600>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d540cd8f-d715-5405-a8d5-11721b31b439/d540cd8f-d715-5405-a8d5-11721b31b439_expert_report_file_11c27647-3734-4965-93db-996809912791.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT70%20TDO-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd540cd8f-d715-5405-a8d5-11721b31b439',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LT70 TDO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LT70%20TDO&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'PEUGEOT',
'model': '208',
'odometer': 34563,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d540cd8f-d715-5405-a8d5-11721b31b439/d540cd8f-d715-5405-a8d5-11721b31b439_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39014,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126399/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d540cd8f-d715-5405-a8d5-11721b31b439/d540cd8f-d715-5405-a8d5-11721b31b439_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39847,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126403/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d540cd8f-d715-5405-a8d5-11721b31b439/d540cd8f-d715-5405-a8d5-11721b31b439_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36144,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126412/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d540cd8f-d715-5405-a8d5-11721b31b439/d540cd8f-d715-5405-a8d5-11721b31b439_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35739,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126423/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d540cd8f-d715-5405-a8d5-11721b31b439/d540cd8f-d715-5405-a8d5-11721b31b439_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33146,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126439/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d540cd8f-d715-5405-a8d5-11721b31b439/d540cd8f-d715-5405-a8d5-11721b31b439_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33979,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126462/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d540cd8f-d715-5405-a8d5-11721b31b439/d540cd8f-d715-5405-a8d5-11721b31b439_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83988,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126495/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d540cd8f-d715-5405-a8d5-11721b31b439/d540cd8f-d715-5405-a8d5-11721b31b439_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65750,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126527/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d540cd8f-d715-5405-a8d5-11721b31b439/d540cd8f-d715-5405-a8d5-11721b31b439_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85872,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126555/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d540cd8f-d715-5405-a8d5-11721b31b439/d540cd8f-d715-5405-a8d5-11721b31b439_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72199,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT70TDO/699126571/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'PEUGEOT 208 1.2 P/T 75 ACTIVE Hatchback',
'transmission': 'manual',
'trim': 'P/T 75 ACTIVE',
'vin': 'VR3UPHMHDLT076359',
'year': 2020}
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT70%2520TDO%27 HTTP/1.1" 200 None
2026-03-28 22:03:03 [bca.uk] INFO: Saving data for LT70%20TDO: {'created_time': 1774735383.120061, 'last_price_update_time': 1774735383.120073, 'auction_closing_time': 1774951200.0}
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LT70%2520TDO') HTTP/1.1" 204 0
2026-03-28 22:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d8076e5d-cb8b-5578-9e3b-020e67e6d8b5 with identifier: AV03%20RSZ
2026-03-28 22:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d8076e5d-cb8b-5578-9e3b-020e67e6d8b5 with identifier: AV03%20RSZ
2026-03-28 22:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d8076e5d-cb8b-5578-9e3b-020e67e6d8b5 with identifier: AV03%20RSZ to the API
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074170/600>
{'auction_title': '',
'c_o_2_emission_value': 350,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8076e5d-cb8b-5578-9e3b-020e67e6d8b5/d8076e5d-cb8b-5578-9e3b-020e67e6d8b5_expert_report_file_347a9b99-df7c-4f00-ac0f-3f9f04fd3524.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV03%20RSZ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '4.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd8076e5d-cb8b-5578-9e3b-020e67e6d8b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV03 RSZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV03%20RSZ&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'AUDI',
'model': 'RS6 AVANT',
'odometer': 109172,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8076e5d-cb8b-5578-9e3b-020e67e6d8b5/d8076e5d-cb8b-5578-9e3b-020e67e6d8b5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48653,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074170/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8076e5d-cb8b-5578-9e3b-020e67e6d8b5/d8076e5d-cb8b-5578-9e3b-020e67e6d8b5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46122,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074176/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8076e5d-cb8b-5578-9e3b-020e67e6d8b5/d8076e5d-cb8b-5578-9e3b-020e67e6d8b5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44017,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074183/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8076e5d-cb8b-5578-9e3b-020e67e6d8b5/d8076e5d-cb8b-5578-9e3b-020e67e6d8b5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41799,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074190/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8076e5d-cb8b-5578-9e3b-020e67e6d8b5/d8076e5d-cb8b-5578-9e3b-020e67e6d8b5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38022,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074195/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8076e5d-cb8b-5578-9e3b-020e67e6d8b5/d8076e5d-cb8b-5578-9e3b-020e67e6d8b5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37044,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074200/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8076e5d-cb8b-5578-9e3b-020e67e6d8b5/d8076e5d-cb8b-5578-9e3b-020e67e6d8b5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90260,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074206/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8076e5d-cb8b-5578-9e3b-020e67e6d8b5/d8076e5d-cb8b-5578-9e3b-020e67e6d8b5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75106,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074212/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8076e5d-cb8b-5578-9e3b-020e67e6d8b5/d8076e5d-cb8b-5578-9e3b-020e67e6d8b5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79149,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074220/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8076e5d-cb8b-5578-9e3b-020e67e6d8b5/d8076e5d-cb8b-5578-9e3b-020e67e6d8b5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73279,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV03RSZ/699074227/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-01-01',
'seller_name': None,
'title': 'AUDI RS6 AVANT 4.2 QUATTRO TIPTRONIC Estate',
'transmission': 'manual',
'trim': 'QUATTRO TIPTRONIC',
'vin': 'WUAZZZ4B93N903030',
'year': 2003}
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV03%2520RSZ%27 HTTP/1.1" 200 None
2026-03-28 22:03:03 [bca.uk] INFO: Saving data for AV03%20RSZ: {'created_time': 1774735383.506329, 'last_price_update_time': 1774735383.506341, 'auction_closing_time': 1774951200.0}
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV03%2520RSZ') HTTP/1.1" 204 0
2026-03-28 22:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000857/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF12MYT/42810729?sv=2020-08-04&st=2026-03-28T22%3A02%3A53Z&se=2026-03-28T22%3A27%3A53Z&sr=b&sp=r&sig=nHFjMnwBFzMU1zyEasRXDPYGybeVhUB71rIUr1xyFl0%3D)
2026-03-28 22:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024872/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024872>
2026-03-28 22:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000881/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF12MYT/42810729?sv=2020-08-04&st=2026-03-28T22%3A02%3A53Z&se=2026-03-28T22%3A27%3A53Z&sr=b&sp=r&sig=nHFjMnwBFzMU1zyEasRXDPYGybeVhUB71rIUr1xyFl0%3D)
2026-03-28 22:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024878/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024878>
2026-03-28 22:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189534/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189534>
2026-03-28 22:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024877/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024877>
2026-03-28 22:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049711/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC08XBB/42811084?sv=2020-08-04&st=2026-03-28T22%3A02%3A53Z&se=2026-03-28T22%3A27%3A53Z&sr=b&sp=r&sig=xK62%2B9MijGs2SiW%2FUaMz8MiEI%2Bw8pLNfo8XyMBO55R0%3D)
2026-03-28 22:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049688/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC08XBB/42811084?sv=2020-08-04&st=2026-03-28T22%3A02%3A53Z&se=2026-03-28T22%3A27%3A53Z&sr=b&sp=r&sig=xK62%2B9MijGs2SiW%2FUaMz8MiEI%2Bw8pLNfo8XyMBO55R0%3D)
2026-03-28 22:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547170890>
2026-03-28 22:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e840cff7-63ef-534e-a127-ffab51ca54c5/e840cff7-63ef-534e-a127-ffab51ca54c5_expert_report_file_c7c89db1-30bb-48ad-8103-04a4f8bce479.pdf HTTP/1.1" 201 0
2026-03-28 22:03:03 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e840cff7-63ef-534e-a127-ffab51ca54c5
2026-03-28 22:03:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e840cff7-63ef-534e-a127-ffab51ca54c5, skipping ID generation
2026-03-28 22:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e840cff7-63ef-534e-a127-ffab51ca54c5
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYE59VRX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YE59VRX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54724b0d0>
2026-03-28 22:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85ebd75-b202-5555-83e0-f40ad749d770/f85ebd75-b202-5555-83e0-f40ad749d770_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC08XBB%252F699049678%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049678/600 saved to cache
2026-03-28 22:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f85ebd75-b202-5555-83e0-f40ad749d770
2026-03-28 22:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472b2f10>
2026-03-28 22:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85ebd75-b202-5555-83e0-f40ad749d770/f85ebd75-b202-5555-83e0-f40ad749d770_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC08XBB%252F699049699%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049699/600 saved to cache
2026-03-28 22:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f85ebd75-b202-5555-83e0-f40ad749d770
2026-03-28 22:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f95450>
2026-03-28 22:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3301d1-7f13-5013-82e2-ed3f1a597939/be3301d1-7f13-5013-82e2-ed3f1a597939_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF12MYT%252F699000870%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000870/600 saved to cache
2026-03-28 22:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item be3301d1-7f13-5013-82e2-ed3f1a597939
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189600%27 HTTP/1.1" 200 None
2026-03-28 22:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189600 not downloaded yet
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024898%27 HTTP/1.1" 200 None
2026-03-28 22:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024898 not downloaded yet
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189426%27 HTTP/1.1" 200 None
2026-03-28 22:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189426 not downloaded yet
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000873%27 HTTP/1.1" 200 None
2026-03-28 22:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000873 not downloaded yet
2026-03-28 22:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189517/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ67VEM/42791734?sv=2020-08-04&st=2026-03-28T22%3A02%3A55Z&se=2026-03-28T22%3A27%3A55Z&sr=b&sp=r&sig=aRp2e8voaQFNGNBQntrnH3BCsqhsjEpfLYOzq029Whc%3D)
2026-03-28 22:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024867/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP07ZRX/42810964?sv=2020-08-04&st=2026-03-28T22%3A02%3A55Z&se=2026-03-28T22%3A27%3A55Z&sr=b&sp=r&sig=ineLLrCg%2B1RldNyJZ5fTpgH%2BIym%2B22PLhonhjbuM15c%3D)
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189432%27 HTTP/1.1" 200 None
2026-03-28 22:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189432 not downloaded yet
2026-03-28 22:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024885/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024885>
2026-03-28 22:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189547/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189547>
2026-03-28 22:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024881/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024881>
2026-03-28 22:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189404/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VO16OOC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000887%27 HTTP/1.1" 200 None
2026-03-28 22:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000887 not downloaded yet
2026-03-28 22:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049747/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC08XBB/42811084?sv=2020-08-04&st=2026-03-28T22%3A02%3A53Z&se=2026-03-28T22%3A27%3A53Z&sr=b&sp=r&sig=xK62%2B9MijGs2SiW%2FUaMz8MiEI%2Bw8pLNfo8XyMBO55R0%3D)
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189446%27 HTTP/1.1" 200 None
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189446 not downloaded yet
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477a7090>
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3301d1-7f13-5013-82e2-ed3f1a597939/be3301d1-7f13-5013-82e2-ed3f1a597939_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF12MYT%252F699000857%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000857/600 saved to cache
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item be3301d1-7f13-5013-82e2-ed3f1a597939
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fdac90>
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3301d1-7f13-5013-82e2-ed3f1a597939/be3301d1-7f13-5013-82e2-ed3f1a597939_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF12MYT%252F699000881%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000881/600 saved to cache
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item be3301d1-7f13-5013-82e2-ed3f1a597939
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55490bf50>
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85ebd75-b202-5555-83e0-f40ad749d770/f85ebd75-b202-5555-83e0-f40ad749d770_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC08XBB%252F699049711%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049711/600 saved to cache
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f85ebd75-b202-5555-83e0-f40ad749d770
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fd9e50>
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85ebd75-b202-5555-83e0-f40ad749d770/f85ebd75-b202-5555-83e0-f40ad749d770_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC08XBB%252F699049688%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049688/600 saved to cache
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f85ebd75-b202-5555-83e0-f40ad749d770
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000899%27 HTTP/1.1" 200 None
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000899 not downloaded yet
2026-03-28 22:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024877/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP07ZRX/42810964?sv=2020-08-04&st=2026-03-28T22%3A02%3A55Z&se=2026-03-28T22%3A27%3A55Z&sr=b&sp=r&sig=ineLLrCg%2B1RldNyJZ5fTpgH%2BIym%2B22PLhonhjbuM15c%3D)
2026-03-28 22:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189534/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ67VEM/42791734?sv=2020-08-04&st=2026-03-28T22%3A02%3A55Z&se=2026-03-28T22%3A27%3A55Z&sr=b&sp=r&sig=aRp2e8voaQFNGNBQntrnH3BCsqhsjEpfLYOzq029Whc%3D)
2026-03-28 22:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000940/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF12MYT/42810729?sv=2020-08-04&st=2026-03-28T22%3A02%3A53Z&se=2026-03-28T22%3A27%3A53Z&sr=b&sp=r&sig=nHFjMnwBFzMU1zyEasRXDPYGybeVhUB71rIUr1xyFl0%3D)
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189458%27 HTTP/1.1" 200 None
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189458 not downloaded yet
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000914%27 HTTP/1.1" 200 None
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000914 not downloaded yet
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557644390>
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0b8d3c-494f-51dc-ba6a-63cfe435e086/3c0b8d3c-494f-51dc-ba6a-63cfe435e086_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ67VEM%252F699189517%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189517/600 saved to cache
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c0b8d3c-494f-51dc-ba6a-63cfe435e086
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55428fad0>
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9778d0fc-88ae-5ce5-b8be-dfaa70e989c2/9778d0fc-88ae-5ce5-b8be-dfaa70e989c2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP07ZRX%252F699024867%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024867/600 saved to cache
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2
2026-03-28 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a6ff90>
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85ebd75-b202-5555-83e0-f40ad749d770/f85ebd75-b202-5555-83e0-f40ad749d770_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC08XBB%252F699049747%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049747/600 saved to cache
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f85ebd75-b202-5555-83e0-f40ad749d770
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189469%27 HTTP/1.1" 200 None
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189469 not downloaded yet
2026-03-28 22:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024878/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP07ZRX/42810964?sv=2020-08-04&st=2026-03-28T22%3A02%3A55Z&se=2026-03-28T22%3A27%3A55Z&sr=b&sp=r&sig=ineLLrCg%2B1RldNyJZ5fTpgH%2BIym%2B22PLhonhjbuM15c%3D)
2026-03-28 22:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024872/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP07ZRX/42810964?sv=2020-08-04&st=2026-03-28T22%3A02%3A55Z&se=2026-03-28T22%3A27%3A55Z&sr=b&sp=r&sig=ineLLrCg%2B1RldNyJZ5fTpgH%2BIym%2B22PLhonhjbuM15c%3D)
2026-03-28 22:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189573/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189573>
2026-03-28 22:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189417/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189417>
2026-03-28 22:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024892/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024892>
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000925%27 HTTP/1.1" 200 None
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000925 not downloaded yet
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189483%27 HTTP/1.1" 200 None
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189483 not downloaded yet
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554966050>
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9778d0fc-88ae-5ce5-b8be-dfaa70e989c2/9778d0fc-88ae-5ce5-b8be-dfaa70e989c2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP07ZRX%252F699024877%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024877/600 saved to cache
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547763890>
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0b8d3c-494f-51dc-ba6a-63cfe435e086/3c0b8d3c-494f-51dc-ba6a-63cfe435e086_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ67VEM%252F699189534%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189534/600 saved to cache
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c0b8d3c-494f-51dc-ba6a-63cfe435e086
2026-03-28 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547478510>
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3301d1-7f13-5013-82e2-ed3f1a597939/be3301d1-7f13-5013-82e2-ed3f1a597939_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF12MYT%252F699000940%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000940/600 saved to cache
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item be3301d1-7f13-5013-82e2-ed3f1a597939
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000945%27 HTTP/1.1" 200 None
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000945 not downloaded yet
2026-03-28 22:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024898/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024898>
2026-03-28 22:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189426/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189426>
2026-03-28 22:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189408/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189408>
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000979%27 HTTP/1.1" 200 None
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000979 not downloaded yet
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544dd690>
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9778d0fc-88ae-5ce5-b8be-dfaa70e989c2/9778d0fc-88ae-5ce5-b8be-dfaa70e989c2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP07ZRX%252F699024878%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024878/600 saved to cache
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474dc250>
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9778d0fc-88ae-5ce5-b8be-dfaa70e989c2/9778d0fc-88ae-5ce5-b8be-dfaa70e989c2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP07ZRX%252F699024872%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024872/600 saved to cache
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2
2026-03-28 22:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189404/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO16OOC/42804916?sv=2020-08-04&st=2026-03-28T22%3A02%3A59Z&se=2026-03-28T22%3A27%3A59Z&sr=b&sp=r&sig=IPhuMCbNLcDWB4o3Qn3QcPs2vdSL6YhQsTjfdKyEDcc%3D)
2026-03-28 22:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024885/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP07ZRX/42810964?sv=2020-08-04&st=2026-03-28T22%3A02%3A55Z&se=2026-03-28T22%3A27%3A55Z&sr=b&sp=r&sig=ineLLrCg%2B1RldNyJZ5fTpgH%2BIym%2B22PLhonhjbuM15c%3D)
2026-03-28 22:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024881/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP07ZRX/42810964?sv=2020-08-04&st=2026-03-28T22%3A02%3A55Z&se=2026-03-28T22%3A27%3A55Z&sr=b&sp=r&sig=ineLLrCg%2B1RldNyJZ5fTpgH%2BIym%2B22PLhonhjbuM15c%3D)
2026-03-28 22:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189432/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189432>
2026-03-28 22:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189547/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ67VEM/42791734?sv=2020-08-04&st=2026-03-28T22%3A02%3A55Z&se=2026-03-28T22%3A27%3A55Z&sr=b&sp=r&sig=aRp2e8voaQFNGNBQntrnH3BCsqhsjEpfLYOzq029Whc%3D)
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699001003%27 HTTP/1.1" 200 None
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001003 not downloaded yet
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699001028%27 HTTP/1.1" 200 None
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001028 not downloaded yet
2026-03-28 22:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000887/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000887>
2026-03-28 22:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189446/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189446>
2026-03-28 22:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000899/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000899>
2026-03-28 22:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189417/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO16OOC/42804916?sv=2020-08-04&st=2026-03-28T22%3A02%3A59Z&se=2026-03-28T22%3A27%3A59Z&sr=b&sp=r&sig=IPhuMCbNLcDWB4o3Qn3QcPs2vdSL6YhQsTjfdKyEDcc%3D)
2026-03-28 22:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000914/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000914>
2026-03-28 22:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024892/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP07ZRX/42810964?sv=2020-08-04&st=2026-03-28T22%3A02%3A55Z&se=2026-03-28T22%3A27%3A55Z&sr=b&sp=r&sig=ineLLrCg%2B1RldNyJZ5fTpgH%2BIym%2B22PLhonhjbuM15c%3D)
2026-03-28 22:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189469/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189469>
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472481d0>
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a483ecb-536a-5a7a-b51b-bc1d2c782d27/5a483ecb-536a-5a7a-b51b-bc1d2c782d27_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO16OOC%252F699189404%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189404/600 saved to cache
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a483ecb-536a-5a7a-b51b-bc1d2c782d27
2026-03-28 22:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189426/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO16OOC/42804916?sv=2020-08-04&st=2026-03-28T22%3A02%3A59Z&se=2026-03-28T22%3A27%3A59Z&sr=b&sp=r&sig=IPhuMCbNLcDWB4o3Qn3QcPs2vdSL6YhQsTjfdKyEDcc%3D)
2026-03-28 22:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189408/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO16OOC/42804916?sv=2020-08-04&st=2026-03-28T22%3A02%3A59Z&se=2026-03-28T22%3A27%3A59Z&sr=b&sp=r&sig=IPhuMCbNLcDWB4o3Qn3QcPs2vdSL6YhQsTjfdKyEDcc%3D)
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54738c8d0>
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9778d0fc-88ae-5ce5-b8be-dfaa70e989c2/9778d0fc-88ae-5ce5-b8be-dfaa70e989c2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP07ZRX%252F699024885%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024885/600 saved to cache
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2
2026-03-28 22:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189573/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ67VEM/42791734?sv=2020-08-04&st=2026-03-28T22%3A02%3A55Z&se=2026-03-28T22%3A27%3A55Z&sr=b&sp=r&sig=aRp2e8voaQFNGNBQntrnH3BCsqhsjEpfLYOzq029Whc%3D)
2026-03-28 22:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024898/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP07ZRX/42810964?sv=2020-08-04&st=2026-03-28T22%3A02%3A55Z&se=2026-03-28T22%3A27%3A55Z&sr=b&sp=r&sig=ineLLrCg%2B1RldNyJZ5fTpgH%2BIym%2B22PLhonhjbuM15c%3D)
2026-03-28 22:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000979/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000979>
2026-03-28 22:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189432/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO16OOC/42804916?sv=2020-08-04&st=2026-03-28T22%3A02%3A59Z&se=2026-03-28T22%3A27%3A59Z&sr=b&sp=r&sig=IPhuMCbNLcDWB4o3Qn3QcPs2vdSL6YhQsTjfdKyEDcc%3D)
2026-03-28 22:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000945/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000945>
2026-03-28 22:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189483/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189483>
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549c8350>
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9778d0fc-88ae-5ce5-b8be-dfaa70e989c2/9778d0fc-88ae-5ce5-b8be-dfaa70e989c2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP07ZRX%252F699024881%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024881/600 saved to cache
2026-03-28 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe564c1c790>
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0b8d3c-494f-51dc-ba6a-63cfe435e086/3c0b8d3c-494f-51dc-ba6a-63cfe435e086_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ67VEM%252F699189547%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189547/600 saved to cache
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c0b8d3c-494f-51dc-ba6a-63cfe435e086
2026-03-28 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000887/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE59VRX/42810877?sv=2020-08-04&st=2026-03-28T22%3A03%3A00Z&se=2026-03-28T22%3A28%3A00Z&sr=b&sp=r&sig=6HdncOqF%2FQAeBC1Cor8GiUoAjsKrswoLj4OuWjoWyf8%3D)
2026-03-28 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000925/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000925>
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549b8750>
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a483ecb-536a-5a7a-b51b-bc1d2c782d27/5a483ecb-536a-5a7a-b51b-bc1d2c782d27_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO16OOC%252F699189417%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189417/600 saved to cache
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5a483ecb-536a-5a7a-b51b-bc1d2c782d27
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a8d950>
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9778d0fc-88ae-5ce5-b8be-dfaa70e989c2/9778d0fc-88ae-5ce5-b8be-dfaa70e989c2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP07ZRX%252F699024892%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024892/600 saved to cache
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f7b3d0>
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a483ecb-536a-5a7a-b51b-bc1d2c782d27/5a483ecb-536a-5a7a-b51b-bc1d2c782d27_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO16OOC%252F699189426%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189426/600 saved to cache
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a483ecb-536a-5a7a-b51b-bc1d2c782d27
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54722c7d0>
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a483ecb-536a-5a7a-b51b-bc1d2c782d27/5a483ecb-536a-5a7a-b51b-bc1d2c782d27_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO16OOC%252F699189408%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189408/600 saved to cache
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a483ecb-536a-5a7a-b51b-bc1d2c782d27
2026-03-28 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000899/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE59VRX/42810877?sv=2020-08-04&st=2026-03-28T22%3A03%3A00Z&se=2026-03-28T22%3A28%3A00Z&sr=b&sp=r&sig=6HdncOqF%2FQAeBC1Cor8GiUoAjsKrswoLj4OuWjoWyf8%3D)
2026-03-28 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000914/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE59VRX/42810877?sv=2020-08-04&st=2026-03-28T22%3A03%3A00Z&se=2026-03-28T22%3A28%3A00Z&sr=b&sp=r&sig=6HdncOqF%2FQAeBC1Cor8GiUoAjsKrswoLj4OuWjoWyf8%3D)
2026-03-28 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699001028/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001028>
2026-03-28 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699001003/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001003>
2026-03-28 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189469/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO16OOC/42804916?sv=2020-08-04&st=2026-03-28T22%3A02%3A59Z&se=2026-03-28T22%3A27%3A59Z&sr=b&sp=r&sig=IPhuMCbNLcDWB4o3Qn3QcPs2vdSL6YhQsTjfdKyEDcc%3D)
2026-03-28 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189446/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO16OOC/42804916?sv=2020-08-04&st=2026-03-28T22%3A02%3A59Z&se=2026-03-28T22%3A27%3A59Z&sr=b&sp=r&sig=IPhuMCbNLcDWB4o3Qn3QcPs2vdSL6YhQsTjfdKyEDcc%3D)
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547730890>
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0b8d3c-494f-51dc-ba6a-63cfe435e086/3c0b8d3c-494f-51dc-ba6a-63cfe435e086_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ67VEM%252F699189573%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189573/600 saved to cache
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c0b8d3c-494f-51dc-ba6a-63cfe435e086
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54722e350>
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9778d0fc-88ae-5ce5-b8be-dfaa70e989c2/9778d0fc-88ae-5ce5-b8be-dfaa70e989c2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP07ZRX%252F699024898%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024898/600 saved to cache
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547741890>
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a483ecb-536a-5a7a-b51b-bc1d2c782d27/5a483ecb-536a-5a7a-b51b-bc1d2c782d27_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO16OOC%252F699189432%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189432/600 saved to cache
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a483ecb-536a-5a7a-b51b-bc1d2c782d27
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55428cfd0>
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e840cff7-63ef-534e-a127-ffab51ca54c5/e840cff7-63ef-534e-a127-ffab51ca54c5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE59VRX%252F699000887%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000887/600 saved to cache
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e840cff7-63ef-534e-a127-ffab51ca54c5
2026-03-28 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189458/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189458>
2026-03-28 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000873/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000873>
2026-03-28 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189600/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189600>
2026-03-28 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000945/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE59VRX/42810877?sv=2020-08-04&st=2026-03-28T22%3A03%3A00Z&se=2026-03-28T22%3A28%3A00Z&sr=b&sp=r&sig=6HdncOqF%2FQAeBC1Cor8GiUoAjsKrswoLj4OuWjoWyf8%3D)
2026-03-28 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000979/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE59VRX/42810877?sv=2020-08-04&st=2026-03-28T22%3A03%3A00Z&se=2026-03-28T22%3A28%3A00Z&sr=b&sp=r&sig=6HdncOqF%2FQAeBC1Cor8GiUoAjsKrswoLj4OuWjoWyf8%3D)
2026-03-28 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189483/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO16OOC/42804916?sv=2020-08-04&st=2026-03-28T22%3A02%3A59Z&se=2026-03-28T22%3A27%3A59Z&sr=b&sp=r&sig=IPhuMCbNLcDWB4o3Qn3QcPs2vdSL6YhQsTjfdKyEDcc%3D)
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544dfd50>
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e840cff7-63ef-534e-a127-ffab51ca54c5/e840cff7-63ef-534e-a127-ffab51ca54c5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE59VRX%252F699000899%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000899/600 saved to cache
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e840cff7-63ef-534e-a127-ffab51ca54c5
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547740250>
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e840cff7-63ef-534e-a127-ffab51ca54c5/e840cff7-63ef-534e-a127-ffab51ca54c5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE59VRX%252F699000914%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000914/600 saved to cache
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e840cff7-63ef-534e-a127-ffab51ca54c5
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b22d0>
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a483ecb-536a-5a7a-b51b-bc1d2c782d27/5a483ecb-536a-5a7a-b51b-bc1d2c782d27_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO16OOC%252F699189469%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189469/600 saved to cache
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5a483ecb-536a-5a7a-b51b-bc1d2c782d27
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b0850>
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a483ecb-536a-5a7a-b51b-bc1d2c782d27/5a483ecb-536a-5a7a-b51b-bc1d2c782d27_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO16OOC%252F699189446%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189446/600 saved to cache
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5a483ecb-536a-5a7a-b51b-bc1d2c782d27
2026-03-28 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000925/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE59VRX/42810877?sv=2020-08-04&st=2026-03-28T22%3A03%3A00Z&se=2026-03-28T22%3A28%3A00Z&sr=b&sp=r&sig=6HdncOqF%2FQAeBC1Cor8GiUoAjsKrswoLj4OuWjoWyf8%3D)
2026-03-28 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189420/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189420>
2026-03-28 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000856/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YE59VRX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024895/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024895>
2026-03-28 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699001003/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE59VRX/42810877?sv=2020-08-04&st=2026-03-28T22%3A03%3A00Z&se=2026-03-28T22%3A28%3A00Z&sr=b&sp=r&sig=6HdncOqF%2FQAeBC1Cor8GiUoAjsKrswoLj4OuWjoWyf8%3D)
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547743d10>
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e840cff7-63ef-534e-a127-ffab51ca54c5/e840cff7-63ef-534e-a127-ffab51ca54c5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE59VRX%252F699000945%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000945/600 saved to cache
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e840cff7-63ef-534e-a127-ffab51ca54c5
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477ad850>
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e840cff7-63ef-534e-a127-ffab51ca54c5/e840cff7-63ef-534e-a127-ffab51ca54c5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE59VRX%252F699000979%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000979/600 saved to cache
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e840cff7-63ef-534e-a127-ffab51ca54c5
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54722ff50>
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a483ecb-536a-5a7a-b51b-bc1d2c782d27/5a483ecb-536a-5a7a-b51b-bc1d2c782d27_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO16OOC%252F699189483%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189483/600 saved to cache
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5a483ecb-536a-5a7a-b51b-bc1d2c782d27
2026-03-28 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189587/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189587>
2026-03-28 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024889/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024889>
2026-03-28 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000873/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE59VRX/42810877?sv=2020-08-04&st=2026-03-28T22%3A03%3A00Z&se=2026-03-28T22%3A28%3A00Z&sr=b&sp=r&sig=6HdncOqF%2FQAeBC1Cor8GiUoAjsKrswoLj4OuWjoWyf8%3D)
2026-03-28 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189560/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189560>
2026-03-28 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189541/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189541>
2026-03-28 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699001028/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE59VRX/42810877?sv=2020-08-04&st=2026-03-28T22%3A03%3A00Z&se=2026-03-28T22%3A28%3A00Z&sr=b&sp=r&sig=6HdncOqF%2FQAeBC1Cor8GiUoAjsKrswoLj4OuWjoWyf8%3D)
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54778db90>
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e840cff7-63ef-534e-a127-ffab51ca54c5/e840cff7-63ef-534e-a127-ffab51ca54c5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE59VRX%252F699000925%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000925/600 saved to cache
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e840cff7-63ef-534e-a127-ffab51ca54c5
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543b8e50>
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e840cff7-63ef-534e-a127-ffab51ca54c5/e840cff7-63ef-534e-a127-ffab51ca54c5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE59VRX%252F699001003%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699001003/600 saved to cache
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e840cff7-63ef-534e-a127-ffab51ca54c5
2026-03-28 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189600/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ67VEM/42791734?sv=2020-08-04&st=2026-03-28T22%3A02%3A55Z&se=2026-03-28T22%3A27%3A55Z&sr=b&sp=r&sig=aRp2e8voaQFNGNBQntrnH3BCsqhsjEpfLYOzq029Whc%3D)
2026-03-28 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189458/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO16OOC/42804916?sv=2020-08-04&st=2026-03-28T22%3A02%3A59Z&se=2026-03-28T22%3A27%3A59Z&sr=b&sp=r&sig=IPhuMCbNLcDWB4o3Qn3QcPs2vdSL6YhQsTjfdKyEDcc%3D)
2026-03-28 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000856/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE59VRX/42810877?sv=2020-08-04&st=2026-03-28T22%3A03%3A00Z&se=2026-03-28T22%3A28%3A00Z&sr=b&sp=r&sig=6HdncOqF%2FQAeBC1Cor8GiUoAjsKrswoLj4OuWjoWyf8%3D)
2026-03-28 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699001034/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001034>
2026-03-28 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189530/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189530>
2026-03-28 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049815/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049815>
2026-03-28 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024895/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP07ZRX/42810964?sv=2020-08-04&st=2026-03-28T22%3A02%3A55Z&se=2026-03-28T22%3A27%3A55Z&sr=b&sp=r&sig=ineLLrCg%2B1RldNyJZ5fTpgH%2BIym%2B22PLhonhjbuM15c%3D)
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549caad0>
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e840cff7-63ef-534e-a127-ffab51ca54c5/e840cff7-63ef-534e-a127-ffab51ca54c5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE59VRX%252F699000873%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000873/600 saved to cache
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e840cff7-63ef-534e-a127-ffab51ca54c5
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549094d0>
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e840cff7-63ef-534e-a127-ffab51ca54c5/e840cff7-63ef-534e-a127-ffab51ca54c5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE59VRX%252F699001028%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699001028/600 saved to cache
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e840cff7-63ef-534e-a127-ffab51ca54c5
2026-03-28 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189420/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO16OOC/42804916?sv=2020-08-04&st=2026-03-28T22%3A02%3A59Z&se=2026-03-28T22%3A27%3A59Z&sr=b&sp=r&sig=IPhuMCbNLcDWB4o3Qn3QcPs2vdSL6YhQsTjfdKyEDcc%3D)
2026-03-28 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049793/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049793>
2026-03-28 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699001008/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001008>
2026-03-28 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189522/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189522>
2026-03-28 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189587/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ67VEM/42791734?sv=2020-08-04&st=2026-03-28T22%3A02%3A55Z&se=2026-03-28T22%3A27%3A55Z&sr=b&sp=r&sig=aRp2e8voaQFNGNBQntrnH3BCsqhsjEpfLYOzq029Whc%3D)
2026-03-28 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024889/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP07ZRX/42810964?sv=2020-08-04&st=2026-03-28T22%3A02%3A55Z&se=2026-03-28T22%3A27%3A55Z&sr=b&sp=r&sig=ineLLrCg%2B1RldNyJZ5fTpgH%2BIym%2B22PLhonhjbuM15c%3D)
2026-03-28 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189560/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ67VEM/42791734?sv=2020-08-04&st=2026-03-28T22%3A02%3A55Z&se=2026-03-28T22%3A27%3A55Z&sr=b&sp=r&sig=aRp2e8voaQFNGNBQntrnH3BCsqhsjEpfLYOzq029Whc%3D)
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471056d0>
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0b8d3c-494f-51dc-ba6a-63cfe435e086/3c0b8d3c-494f-51dc-ba6a-63cfe435e086_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ67VEM%252F699189600%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189600/600 saved to cache
2026-03-28 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c0b8d3c-494f-51dc-ba6a-63cfe435e086
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547de310>
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a483ecb-536a-5a7a-b51b-bc1d2c782d27/5a483ecb-536a-5a7a-b51b-bc1d2c782d27_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO16OOC%252F699189458%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189458/600 saved to cache
2026-03-28 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5a483ecb-536a-5a7a-b51b-bc1d2c782d27
2026-03-28 22:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473daf90>
2026-03-28 22:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e840cff7-63ef-534e-a127-ffab51ca54c5/e840cff7-63ef-534e-a127-ffab51ca54c5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE59VRX%252F699000856%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000856/600 saved to cache
2026-03-28 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e840cff7-63ef-534e-a127-ffab51ca54c5
2026-03-28 22:03:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e840cff7-63ef-534e-a127-ffab51ca54c5, skipping ID generation
2026-03-28 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e840cff7-63ef-534e-a127-ffab51ca54c5 sending to next pipeline
2026-03-28 22:03:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e840cff7-63ef-534e-a127-ffab51ca54c5, identifier: YE59%20VRX
2026-03-28 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555c43e10>
2026-03-28 22:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9778d0fc-88ae-5ce5-b8be-dfaa70e989c2/9778d0fc-88ae-5ce5-b8be-dfaa70e989c2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP07ZRX%252F699024895%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024895/600 saved to cache
2026-03-28 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2
2026-03-28 22:03:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e840cff7-63ef-534e-a127-ffab51ca54c5 with identifier: YE59%20VRX
2026-03-28 22:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e840cff7-63ef-534e-a127-ffab51ca54c5 with identifier: YE59%20VRX
2026-03-28 22:03:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e840cff7-63ef-534e-a127-ffab51ca54c5 with identifier: YE59%20VRX to the API
2026-03-28 22:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000856/600>
{'auction_title': '',
'c_o_2_emission_value': 145,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e840cff7-63ef-534e-a127-ffab51ca54c5/e840cff7-63ef-534e-a127-ffab51ca54c5_expert_report_file_c7c89db1-30bb-48ad-8103-04a4f8bce479.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YE59%20VRX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e840cff7-63ef-534e-a127-ffab51ca54c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YE59 VRX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YE59%20VRX&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'BMW',
'model': '320D',
'odometer': 141770,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e840cff7-63ef-534e-a127-ffab51ca54c5/e840cff7-63ef-534e-a127-ffab51ca54c5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38183,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000856/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e840cff7-63ef-534e-a127-ffab51ca54c5/e840cff7-63ef-534e-a127-ffab51ca54c5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34730,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000873/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e840cff7-63ef-534e-a127-ffab51ca54c5/e840cff7-63ef-534e-a127-ffab51ca54c5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37971,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000887/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e840cff7-63ef-534e-a127-ffab51ca54c5/e840cff7-63ef-534e-a127-ffab51ca54c5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34791,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000899/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e840cff7-63ef-534e-a127-ffab51ca54c5/e840cff7-63ef-534e-a127-ffab51ca54c5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32833,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000914/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e840cff7-63ef-534e-a127-ffab51ca54c5/e840cff7-63ef-534e-a127-ffab51ca54c5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31392,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000925/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e840cff7-63ef-534e-a127-ffab51ca54c5/e840cff7-63ef-534e-a127-ffab51ca54c5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82156,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000945/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e840cff7-63ef-534e-a127-ffab51ca54c5/e840cff7-63ef-534e-a127-ffab51ca54c5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65221,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699000979/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e840cff7-63ef-534e-a127-ffab51ca54c5/e840cff7-63ef-534e-a127-ffab51ca54c5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84335,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699001003/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e840cff7-63ef-534e-a127-ffab51ca54c5/e840cff7-63ef-534e-a127-ffab51ca54c5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77116,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE59VRX/699001028/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'BMW 320D 2.0 M SPORT Coupe',
'transmission': 'automatic',
'trim': 'M SPORT',
'vin': 'WBAWD12090PP60465',
'year': 2010}
2026-03-28 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE59%2520VRX%27 HTTP/1.1" 200 None
2026-03-28 22:03:06 [bca.uk] INFO: Saving data for YE59%20VRX: {'created_time': 1774735386.801983, 'last_price_update_time': 1774735386.801994, 'auction_closing_time': 1774864800.0}
2026-03-28 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YE59%2520VRX') HTTP/1.1" 204 0
2026-03-28 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189530/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ67VEM/42791734?sv=2020-08-04&st=2026-03-28T22%3A02%3A55Z&se=2026-03-28T22%3A27%3A55Z&sr=b&sp=r&sig=aRp2e8voaQFNGNBQntrnH3BCsqhsjEpfLYOzq029Whc%3D)
2026-03-28 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049765/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049765>
2026-03-28 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189541/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ67VEM/42791734?sv=2020-08-04&st=2026-03-28T22%3A02%3A55Z&se=2026-03-28T22%3A27%3A55Z&sr=b&sp=r&sig=aRp2e8voaQFNGNBQntrnH3BCsqhsjEpfLYOzq029Whc%3D)
2026-03-28 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000909/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000909>
2026-03-28 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000963/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000963>
2026-03-28 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049731/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049731>
2026-03-28 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699001034/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF12MYT/42810729?sv=2020-08-04&st=2026-03-28T22%3A02%3A53Z&se=2026-03-28T22%3A27%3A53Z&sr=b&sp=r&sig=nHFjMnwBFzMU1zyEasRXDPYGybeVhUB71rIUr1xyFl0%3D)
2026-03-28 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049815/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC08XBB/42811084?sv=2020-08-04&st=2026-03-28T22%3A02%3A53Z&se=2026-03-28T22%3A27%3A53Z&sr=b&sp=r&sig=xK62%2B9MijGs2SiW%2FUaMz8MiEI%2Bw8pLNfo8XyMBO55R0%3D)
2026-03-28 22:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55729af10>
2026-03-28 22:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a483ecb-536a-5a7a-b51b-bc1d2c782d27/5a483ecb-536a-5a7a-b51b-bc1d2c782d27_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO16OOC%252F699189420%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189420/600 saved to cache
2026-03-28 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5a483ecb-536a-5a7a-b51b-bc1d2c782d27
2026-03-28 22:03:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a483ecb-536a-5a7a-b51b-bc1d2c782d27, skipping ID generation
2026-03-28 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a483ecb-536a-5a7a-b51b-bc1d2c782d27 sending to next pipeline
2026-03-28 22:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5a483ecb-536a-5a7a-b51b-bc1d2c782d27, identifier: VO16%20OOC
2026-03-28 22:03:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547173050>
2026-03-28 22:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0b8d3c-494f-51dc-ba6a-63cfe435e086/3c0b8d3c-494f-51dc-ba6a-63cfe435e086_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ67VEM%252F699189587%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189587/600 saved to cache
2026-03-28 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c0b8d3c-494f-51dc-ba6a-63cfe435e086
2026-03-28 22:03:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b22e10>
2026-03-28 22:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9778d0fc-88ae-5ce5-b8be-dfaa70e989c2/9778d0fc-88ae-5ce5-b8be-dfaa70e989c2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP07ZRX%252F699024889%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024889/600 saved to cache
2026-03-28 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2
2026-03-28 22:03:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2, skipping ID generation
2026-03-28 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2 sending to next pipeline
2026-03-28 22:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2, identifier: YP07%20ZRX
2026-03-28 22:03:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543de890>
2026-03-28 22:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0b8d3c-494f-51dc-ba6a-63cfe435e086/3c0b8d3c-494f-51dc-ba6a-63cfe435e086_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ67VEM%252F699189560%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189560/600 saved to cache
2026-03-28 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c0b8d3c-494f-51dc-ba6a-63cfe435e086
2026-03-28 22:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5a483ecb-536a-5a7a-b51b-bc1d2c782d27 with identifier: VO16%20OOC
2026-03-28 22:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5a483ecb-536a-5a7a-b51b-bc1d2c782d27 with identifier: VO16%20OOC
2026-03-28 22:03:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5a483ecb-536a-5a7a-b51b-bc1d2c782d27 with identifier: VO16%20OOC to the API
2026-03-28 22:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189420/600>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a483ecb-536a-5a7a-b51b-bc1d2c782d27/5a483ecb-536a-5a7a-b51b-bc1d2c782d27_expert_report_file_dd1f2f52-36a1-4337-b1e3-39cbf611f02e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO16%20OOC-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5a483ecb-536a-5a7a-b51b-bc1d2c782d27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VO16 OOC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VO16%20OOC&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'MINI',
'model': 'COOPER',
'odometer': 78477,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a483ecb-536a-5a7a-b51b-bc1d2c782d27/5a483ecb-536a-5a7a-b51b-bc1d2c782d27_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41336,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189404/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a483ecb-536a-5a7a-b51b-bc1d2c782d27/5a483ecb-536a-5a7a-b51b-bc1d2c782d27_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39667,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189408/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a483ecb-536a-5a7a-b51b-bc1d2c782d27/5a483ecb-536a-5a7a-b51b-bc1d2c782d27_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36554,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189417/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a483ecb-536a-5a7a-b51b-bc1d2c782d27/5a483ecb-536a-5a7a-b51b-bc1d2c782d27_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38464,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189420/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a483ecb-536a-5a7a-b51b-bc1d2c782d27/5a483ecb-536a-5a7a-b51b-bc1d2c782d27_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35206,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189426/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a483ecb-536a-5a7a-b51b-bc1d2c782d27/5a483ecb-536a-5a7a-b51b-bc1d2c782d27_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33465,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189432/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a483ecb-536a-5a7a-b51b-bc1d2c782d27/5a483ecb-536a-5a7a-b51b-bc1d2c782d27_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71291,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189446/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a483ecb-536a-5a7a-b51b-bc1d2c782d27/5a483ecb-536a-5a7a-b51b-bc1d2c782d27_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62313,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189458/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a483ecb-536a-5a7a-b51b-bc1d2c782d27/5a483ecb-536a-5a7a-b51b-bc1d2c782d27_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66421,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189469/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a483ecb-536a-5a7a-b51b-bc1d2c782d27/5a483ecb-536a-5a7a-b51b-bc1d2c782d27_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72399,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO16OOC/699189483/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MINI COOPER 1.5 136 Hatchback',
'transmission': 'automatic',
'trim': '136',
'vin': 'WMWXM520202D01516',
'year': 2016}
2026-03-28 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO16%2520OOC%27 HTTP/1.1" 200 None
2026-03-28 22:03:07 [bca.uk] INFO: Saving data for VO16%20OOC: {'created_time': 1774735387.67162, 'last_price_update_time': 1774735387.671633, 'auction_closing_time': 1774864800.0}
2026-03-28 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VO16%2520OOC') HTTP/1.1" 204 0
2026-03-28 22:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2 with identifier: YP07%20ZRX
2026-03-28 22:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2 with identifier: YP07%20ZRX
2026-03-28 22:03:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2 with identifier: YP07%20ZRX to the API
2026-03-28 22:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024889/600>
{'auction_title': '',
'c_o_2_emission_value': 171,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9778d0fc-88ae-5ce5-b8be-dfaa70e989c2/9778d0fc-88ae-5ce5-b8be-dfaa70e989c2_expert_report_file_98e97749-4515-40ce-a631-1ba5d5b46c44.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YP07%20ZRX-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9778d0fc-88ae-5ce5-b8be-dfaa70e989c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YP07 ZRX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YP07%20ZRX&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'VOLKSWAGEN',
'model': 'GOLF PLUS',
'odometer': 88019,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9778d0fc-88ae-5ce5-b8be-dfaa70e989c2/9778d0fc-88ae-5ce5-b8be-dfaa70e989c2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37637,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024867/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9778d0fc-88ae-5ce5-b8be-dfaa70e989c2/9778d0fc-88ae-5ce5-b8be-dfaa70e989c2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35421,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024872/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9778d0fc-88ae-5ce5-b8be-dfaa70e989c2/9778d0fc-88ae-5ce5-b8be-dfaa70e989c2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37497,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024877/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9778d0fc-88ae-5ce5-b8be-dfaa70e989c2/9778d0fc-88ae-5ce5-b8be-dfaa70e989c2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36762,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024878/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9778d0fc-88ae-5ce5-b8be-dfaa70e989c2/9778d0fc-88ae-5ce5-b8be-dfaa70e989c2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35748,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024881/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9778d0fc-88ae-5ce5-b8be-dfaa70e989c2/9778d0fc-88ae-5ce5-b8be-dfaa70e989c2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34416,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024885/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9778d0fc-88ae-5ce5-b8be-dfaa70e989c2/9778d0fc-88ae-5ce5-b8be-dfaa70e989c2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74178,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024889/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9778d0fc-88ae-5ce5-b8be-dfaa70e989c2/9778d0fc-88ae-5ce5-b8be-dfaa70e989c2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64086,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024892/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9778d0fc-88ae-5ce5-b8be-dfaa70e989c2/9778d0fc-88ae-5ce5-b8be-dfaa70e989c2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74404,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024895/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9778d0fc-88ae-5ce5-b8be-dfaa70e989c2/9778d0fc-88ae-5ce5-b8be-dfaa70e989c2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68480,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP07ZRX/699024898/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF PLUS 1.6 FSI SE Hatchback',
'transmission': 'manual',
'trim': 'FSI SE',
'vin': 'WVWZZZ1KZ7W605493',
'year': 2007}
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP07%2520ZRX%27 HTTP/1.1" 200 None
2026-03-28 22:03:08 [bca.uk] INFO: Saving data for YP07%20ZRX: {'created_time': 1774735388.084639, 'last_price_update_time': 1774735388.084651, 'auction_closing_time': 1774864800.0}
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YP07%2520ZRX') HTTP/1.1" 204 0
2026-03-28 22:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049722/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699049722>
2026-03-28 22:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189522/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ67VEM/42791734?sv=2020-08-04&st=2026-03-28T22%3A02%3A55Z&se=2026-03-28T22%3A27%3A55Z&sr=b&sp=r&sig=aRp2e8voaQFNGNBQntrnH3BCsqhsjEpfLYOzq029Whc%3D)
2026-03-28 22:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000895/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000895>
2026-03-28 22:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285772/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285772>
2026-03-28 22:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699080986/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699080986>
2026-03-28 22:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000843/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BF12MYT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699001008/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF12MYT/42810729?sv=2020-08-04&st=2026-03-28T22%3A02%3A53Z&se=2026-03-28T22%3A27%3A53Z&sr=b&sp=r&sig=nHFjMnwBFzMU1zyEasRXDPYGybeVhUB71rIUr1xyFl0%3D)
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547732490>
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0b8d3c-494f-51dc-ba6a-63cfe435e086/3c0b8d3c-494f-51dc-ba6a-63cfe435e086_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ67VEM%252F699189530%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189530/600 saved to cache
2026-03-28 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c0b8d3c-494f-51dc-ba6a-63cfe435e086
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b524d0>
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0b8d3c-494f-51dc-ba6a-63cfe435e086/3c0b8d3c-494f-51dc-ba6a-63cfe435e086_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ67VEM%252F699189541%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189541/600 saved to cache
2026-03-28 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c0b8d3c-494f-51dc-ba6a-63cfe435e086
2026-03-28 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542e0610>
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3301d1-7f13-5013-82e2-ed3f1a597939/be3301d1-7f13-5013-82e2-ed3f1a597939_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF12MYT%252F699001034%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699001034/600 saved to cache
2026-03-28 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item be3301d1-7f13-5013-82e2-ed3f1a597939
2026-03-28 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b53550>
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85ebd75-b202-5555-83e0-f40ad749d770/f85ebd75-b202-5555-83e0-f40ad749d770_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC08XBB%252F699049815%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049815/600 saved to cache
2026-03-28 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f85ebd75-b202-5555-83e0-f40ad749d770
2026-03-28 22:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049793/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC08XBB/42811084?sv=2020-08-04&st=2026-03-28T22%3A02%3A53Z&se=2026-03-28T22%3A27%3A53Z&sr=b&sp=r&sig=xK62%2B9MijGs2SiW%2FUaMz8MiEI%2Bw8pLNfo8XyMBO55R0%3D)
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54728e990>
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0b8d3c-494f-51dc-ba6a-63cfe435e086/3c0b8d3c-494f-51dc-ba6a-63cfe435e086_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ67VEM%252F699189522%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189522/600 saved to cache
2026-03-28 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c0b8d3c-494f-51dc-ba6a-63cfe435e086
2026-03-28 22:03:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c0b8d3c-494f-51dc-ba6a-63cfe435e086, skipping ID generation
2026-03-28 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c0b8d3c-494f-51dc-ba6a-63cfe435e086 sending to next pipeline
2026-03-28 22:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3c0b8d3c-494f-51dc-ba6a-63cfe435e086, identifier: WJ67%20VEM
2026-03-28 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54728f890>
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3301d1-7f13-5013-82e2-ed3f1a597939/be3301d1-7f13-5013-82e2-ed3f1a597939_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF12MYT%252F699001008%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699001008/600 saved to cache
2026-03-28 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item be3301d1-7f13-5013-82e2-ed3f1a597939
2026-03-28 22:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3c0b8d3c-494f-51dc-ba6a-63cfe435e086 with identifier: WJ67%20VEM
2026-03-28 22:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3c0b8d3c-494f-51dc-ba6a-63cfe435e086 with identifier: WJ67%20VEM
2026-03-28 22:03:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3c0b8d3c-494f-51dc-ba6a-63cfe435e086 with identifier: WJ67%20VEM to the API
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189522/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0b8d3c-494f-51dc-ba6a-63cfe435e086/3c0b8d3c-494f-51dc-ba6a-63cfe435e086_expert_report_file_dc5332fc-3a98-4491-8bc0-e3cf5f737853.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ67%20VEM-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3c0b8d3c-494f-51dc-ba6a-63cfe435e086',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ67 VEM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ67%20VEM&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'TOYOTA',
'model': 'PROACE VERSO',
'odometer': 101634,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0b8d3c-494f-51dc-ba6a-63cfe435e086/3c0b8d3c-494f-51dc-ba6a-63cfe435e086_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38784,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189517/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0b8d3c-494f-51dc-ba6a-63cfe435e086/3c0b8d3c-494f-51dc-ba6a-63cfe435e086_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39190,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189522/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0b8d3c-494f-51dc-ba6a-63cfe435e086/3c0b8d3c-494f-51dc-ba6a-63cfe435e086_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34201,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189530/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0b8d3c-494f-51dc-ba6a-63cfe435e086/3c0b8d3c-494f-51dc-ba6a-63cfe435e086_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34766,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189534/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0b8d3c-494f-51dc-ba6a-63cfe435e086/3c0b8d3c-494f-51dc-ba6a-63cfe435e086_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32493,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189541/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0b8d3c-494f-51dc-ba6a-63cfe435e086/3c0b8d3c-494f-51dc-ba6a-63cfe435e086_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33354,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189547/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0b8d3c-494f-51dc-ba6a-63cfe435e086/3c0b8d3c-494f-51dc-ba6a-63cfe435e086_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88630,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189560/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0b8d3c-494f-51dc-ba6a-63cfe435e086/3c0b8d3c-494f-51dc-ba6a-63cfe435e086_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79775,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189573/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0b8d3c-494f-51dc-ba6a-63cfe435e086/3c0b8d3c-494f-51dc-ba6a-63cfe435e086_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91449,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189587/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0b8d3c-494f-51dc-ba6a-63cfe435e086/3c0b8d3c-494f-51dc-ba6a-63cfe435e086_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81193,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ67VEM/699189600/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'TOYOTA PROACE VERSO 2.0 D 150 FAMILY COMPACT MPV',
'transmission': 'manual',
'trim': 'D 150 FAMILY COMPACT',
'vin': 'YARVEAHXHGZ111651',
'year': 2017}
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ67%2520VEM%27 HTTP/1.1" 200 None
2026-03-28 22:03:08 [bca.uk] INFO: Saving data for WJ67%20VEM: {'created_time': 1774735388.840957, 'last_price_update_time': 1774735388.840968, 'auction_closing_time': 1774864800.0}
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ67%2520VEM') HTTP/1.1" 204 0
2026-03-28 22:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058511/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058511>
2026-03-28 22:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966005/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966005>
2026-03-28 22:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981022/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981022>
2026-03-28 22:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966061/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966061>
2026-03-28 22:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049731/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC08XBB/42811084?sv=2020-08-04&st=2026-03-28T22%3A02%3A53Z&se=2026-03-28T22%3A27%3A53Z&sr=b&sp=r&sig=xK62%2B9MijGs2SiW%2FUaMz8MiEI%2Bw8pLNfo8XyMBO55R0%3D)
2026-03-28 22:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000909/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF12MYT/42810729?sv=2020-08-04&st=2026-03-28T22%3A02%3A53Z&se=2026-03-28T22%3A27%3A53Z&sr=b&sp=r&sig=nHFjMnwBFzMU1zyEasRXDPYGybeVhUB71rIUr1xyFl0%3D)
2026-03-28 22:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000963/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF12MYT/42810729?sv=2020-08-04&st=2026-03-28T22%3A02%3A53Z&se=2026-03-28T22%3A27%3A53Z&sr=b&sp=r&sig=nHFjMnwBFzMU1zyEasRXDPYGybeVhUB71rIUr1xyFl0%3D)
2026-03-28 22:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049765/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC08XBB/42811084?sv=2020-08-04&st=2026-03-28T22%3A02%3A53Z&se=2026-03-28T22%3A27%3A53Z&sr=b&sp=r&sig=xK62%2B9MijGs2SiW%2FUaMz8MiEI%2Bw8pLNfo8XyMBO55R0%3D)
2026-03-28 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b5b390>
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85ebd75-b202-5555-83e0-f40ad749d770/f85ebd75-b202-5555-83e0-f40ad749d770_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC08XBB%252F699049793%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049793/600 saved to cache
2026-03-28 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f85ebd75-b202-5555-83e0-f40ad749d770
2026-03-28 22:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285772/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV69BJO/42810768?sv=2020-08-04&st=2026-03-28T22%3A01%3A08Z&se=2026-03-28T22%3A26%3A08Z&sr=b&sp=r&sig=RhBgWIDbmwF%2F8XqW9pjzomUmOVaJM8ThWq2ap8w7j1M%3D)
2026-03-28 22:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000843/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF12MYT/42810729?sv=2020-08-04&st=2026-03-28T22%3A02%3A53Z&se=2026-03-28T22%3A27%3A53Z&sr=b&sp=r&sig=nHFjMnwBFzMU1zyEasRXDPYGybeVhUB71rIUr1xyFl0%3D)
2026-03-28 22:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699080974/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RX68XHM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285765/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285765>
2026-03-28 22:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000895/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF12MYT/42810729?sv=2020-08-04&st=2026-03-28T22%3A02%3A53Z&se=2026-03-28T22%3A27%3A53Z&sr=b&sp=r&sig=nHFjMnwBFzMU1zyEasRXDPYGybeVhUB71rIUr1xyFl0%3D)
2026-03-28 22:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049722/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC08XBB/42811084?sv=2020-08-04&st=2026-03-28T22%3A02%3A53Z&se=2026-03-28T22%3A27%3A53Z&sr=b&sp=r&sig=xK62%2B9MijGs2SiW%2FUaMz8MiEI%2Bw8pLNfo8XyMBO55R0%3D)
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473dbb90>
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85ebd75-b202-5555-83e0-f40ad749d770/f85ebd75-b202-5555-83e0-f40ad749d770_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC08XBB%252F699049731%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049731/600 saved to cache
2026-03-28 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f85ebd75-b202-5555-83e0-f40ad749d770
2026-03-28 22:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966005/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD57OLK/42810740?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=6hm7fODnR3wBKimIVKSkEorWvM8%2B5kHNq4nMJt6A%2BvY%3D)
2026-03-28 22:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981010/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981010>
2026-03-28 22:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058511/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ12NEO/42811151?sv=2020-08-04&st=2026-03-28T22%3A01%3A05Z&se=2026-03-28T22%3A26%3A05Z&sr=b&sp=r&sig=62h1oUPBDkzrRTgiSRZPyg2OGFZw9gvgjM6%2Bng4Eeco%3D)
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477a5650>
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3301d1-7f13-5013-82e2-ed3f1a597939/be3301d1-7f13-5013-82e2-ed3f1a597939_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF12MYT%252F699000909%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000909/600 saved to cache
2026-03-28 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item be3301d1-7f13-5013-82e2-ed3f1a597939
2026-03-28 22:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966061/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VA62BTY/42810684?sv=2020-08-04&st=2026-03-28T22%3A01%3A03Z&se=2026-03-28T22%3A26%3A03Z&sr=b&sp=r&sig=N35MQzuEGC1T9OsmIXtmUT3IIUk5%2F7R2XsmdyzT4d0M%3D)
2026-03-28 22:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981022/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND62EWM/42810799?sv=2020-08-04&st=2026-03-28T22%3A01%3A06Z&se=2026-03-28T22%3A26%3A06Z&sr=b&sp=r&sig=KD3C6SJzwrdEgIjlL7QRYHJfSgh8rbJ%2FPC%2F%2BEfVah7k%3D)
2026-03-28 22:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698965997/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698965997>
2026-03-28 22:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058496/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058496>
2026-03-28 22:03:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472e63d0>
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3301d1-7f13-5013-82e2-ed3f1a597939/be3301d1-7f13-5013-82e2-ed3f1a597939_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF12MYT%252F699000963%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000963/600 saved to cache
2026-03-28 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item be3301d1-7f13-5013-82e2-ed3f1a597939
2026-03-28 22:03:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555e13fd0>
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85ebd75-b202-5555-83e0-f40ad749d770/f85ebd75-b202-5555-83e0-f40ad749d770_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC08XBB%252F699049765%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049765/600 saved to cache
2026-03-28 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f85ebd75-b202-5555-83e0-f40ad749d770
2026-03-28 22:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699080974/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX68XHM/42809660?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=LehtVWZLTGCUq%2FHVaWaxVcM6eZjoYBHWl7BsrTTno54%3D)
2026-03-28 22:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966018/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966018>
2026-03-28 22:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV18WXN/42810969?sv=2020-08-04&st=2026-03-28T22%3A03%3A09Z&se=2026-03-28T22%3A28%3A09Z&sr=b&sp=r&sig=ksrJfTjChZbrk26bNVd0L5y19BjSjpLvc7IT%2FMyTyME%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WV18%20WXN-GB>
2026-03-28 22:03:09 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 22:03:09 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547319810>
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbce9e71-f6f9-5b70-87a1-2cf7e0368db6/fbce9e71-f6f9-5b70-87a1-2cf7e0368db6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV69BJO%252F699285772%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285772/600 saved to cache
2026-03-28 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fbce9e71-f6f9-5b70-87a1-2cf7e0368db6
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543dc5d0>
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3301d1-7f13-5013-82e2-ed3f1a597939/be3301d1-7f13-5013-82e2-ed3f1a597939_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF12MYT%252F699000843%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000843/600 saved to cache
2026-03-28 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be3301d1-7f13-5013-82e2-ed3f1a597939
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547139090>
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3301d1-7f13-5013-82e2-ed3f1a597939/be3301d1-7f13-5013-82e2-ed3f1a597939_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF12MYT%252F699000895%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000895/600 saved to cache
2026-03-28 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item be3301d1-7f13-5013-82e2-ed3f1a597939
2026-03-28 22:03:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be3301d1-7f13-5013-82e2-ed3f1a597939, skipping ID generation
2026-03-28 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be3301d1-7f13-5013-82e2-ed3f1a597939 sending to next pipeline
2026-03-28 22:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: be3301d1-7f13-5013-82e2-ed3f1a597939, identifier: BF12%20MYT
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5578cf8d0>
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85ebd75-b202-5555-83e0-f40ad749d770/f85ebd75-b202-5555-83e0-f40ad749d770_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC08XBB%252F699049722%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049722/600 saved to cache
2026-03-28 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f85ebd75-b202-5555-83e0-f40ad749d770
2026-03-28 22:03:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f85ebd75-b202-5555-83e0-f40ad749d770, skipping ID generation
2026-03-28 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f85ebd75-b202-5555-83e0-f40ad749d770 sending to next pipeline
2026-03-28 22:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f85ebd75-b202-5555-83e0-f40ad749d770, identifier: LC08%20XBB
2026-03-28 22:03:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477d9390>
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f1a744f-dcf7-513c-adf2-49d9ca828470/8f1a744f-dcf7-513c-adf2-49d9ca828470_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD57OLK%252F698966005%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966005/600 saved to cache
2026-03-28 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f1a744f-dcf7-513c-adf2-49d9ca828470
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547318250>
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf9384a7-c2b5-5829-81c5-0ab07891768a/cf9384a7-c2b5-5829-81c5-0ab07891768a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ12NEO%252F699058511%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058511/600 saved to cache
2026-03-28 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf9384a7-c2b5-5829-81c5-0ab07891768a
2026-03-28 22:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: be3301d1-7f13-5013-82e2-ed3f1a597939 with identifier: BF12%20MYT
2026-03-28 22:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: be3301d1-7f13-5013-82e2-ed3f1a597939 with identifier: BF12%20MYT
2026-03-28 22:03:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: be3301d1-7f13-5013-82e2-ed3f1a597939 with identifier: BF12%20MYT to the API
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000895/600>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3301d1-7f13-5013-82e2-ed3f1a597939/be3301d1-7f13-5013-82e2-ed3f1a597939_expert_report_file_2f03d12b-b760-446b-97bd-e2f1a8e7f60a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BF12%20MYT-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'be3301d1-7f13-5013-82e2-ed3f1a597939',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BF12 MYT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BF12%20MYT&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 75528,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3301d1-7f13-5013-82e2-ed3f1a597939/be3301d1-7f13-5013-82e2-ed3f1a597939_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37537,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000843/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3301d1-7f13-5013-82e2-ed3f1a597939/be3301d1-7f13-5013-82e2-ed3f1a597939_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35376,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000857/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3301d1-7f13-5013-82e2-ed3f1a597939/be3301d1-7f13-5013-82e2-ed3f1a597939_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38234,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000870/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3301d1-7f13-5013-82e2-ed3f1a597939/be3301d1-7f13-5013-82e2-ed3f1a597939_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37415,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000881/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3301d1-7f13-5013-82e2-ed3f1a597939/be3301d1-7f13-5013-82e2-ed3f1a597939_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37065,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000895/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3301d1-7f13-5013-82e2-ed3f1a597939/be3301d1-7f13-5013-82e2-ed3f1a597939_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35427,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000909/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3301d1-7f13-5013-82e2-ed3f1a597939/be3301d1-7f13-5013-82e2-ed3f1a597939_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86979,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000940/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3301d1-7f13-5013-82e2-ed3f1a597939/be3301d1-7f13-5013-82e2-ed3f1a597939_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63126,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699000963/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3301d1-7f13-5013-82e2-ed3f1a597939/be3301d1-7f13-5013-82e2-ed3f1a597939_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80134,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699001008/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3301d1-7f13-5013-82e2-ed3f1a597939/be3301d1-7f13-5013-82e2-ed3f1a597939_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85625,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF12MYT/699001034/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.4 16V SE Hatchback',
'transmission': 'manual',
'trim': '16V SE',
'vin': 'W0L0SDL68C4133567',
'year': 2012}
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF12%2520MYT%27 HTTP/1.1" 200 None
2026-03-28 22:03:09 [bca.uk] INFO: Saving data for BF12%20MYT: {'created_time': 1774735389.966115, 'last_price_update_time': 1774735389.966129, 'auction_closing_time': 1774864800.0}
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BF12%2520MYT') HTTP/1.1" 204 0
2026-03-28 22:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f85ebd75-b202-5555-83e0-f40ad749d770 with identifier: LC08%20XBB
2026-03-28 22:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f85ebd75-b202-5555-83e0-f40ad749d770 with identifier: LC08%20XBB
2026-03-28 22:03:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f85ebd75-b202-5555-83e0-f40ad749d770 with identifier: LC08%20XBB to the API
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049722/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85ebd75-b202-5555-83e0-f40ad749d770/f85ebd75-b202-5555-83e0-f40ad749d770_expert_report_file_7e10b15a-5db5-48c3-badf-cef56fd86bed.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LC08%20XBB-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f85ebd75-b202-5555-83e0-f40ad749d770',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LC08 XBB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LC08%20XBB&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'HONDA',
'model': 'JAZZ',
'odometer': 60636,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85ebd75-b202-5555-83e0-f40ad749d770/f85ebd75-b202-5555-83e0-f40ad749d770_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46447,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049678/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85ebd75-b202-5555-83e0-f40ad749d770/f85ebd75-b202-5555-83e0-f40ad749d770_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45727,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049688/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85ebd75-b202-5555-83e0-f40ad749d770/f85ebd75-b202-5555-83e0-f40ad749d770_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45024,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049699/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85ebd75-b202-5555-83e0-f40ad749d770/f85ebd75-b202-5555-83e0-f40ad749d770_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42341,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049711/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85ebd75-b202-5555-83e0-f40ad749d770/f85ebd75-b202-5555-83e0-f40ad749d770_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40236,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049722/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85ebd75-b202-5555-83e0-f40ad749d770/f85ebd75-b202-5555-83e0-f40ad749d770_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40500,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049731/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85ebd75-b202-5555-83e0-f40ad749d770/f85ebd75-b202-5555-83e0-f40ad749d770_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98416,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049747/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85ebd75-b202-5555-83e0-f40ad749d770/f85ebd75-b202-5555-83e0-f40ad749d770_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79571,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049765/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85ebd75-b202-5555-83e0-f40ad749d770/f85ebd75-b202-5555-83e0-f40ad749d770_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86513,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049793/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85ebd75-b202-5555-83e0-f40ad749d770/f85ebd75-b202-5555-83e0-f40ad749d770_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84603,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC08XBB/699049815/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'HONDA JAZZ 1.4 I-DSI SPORT CVT-7 Hatchback',
'transmission': 'manual',
'trim': 'I-DSI SPORT CVT-7',
'vin': 'LUCGE389083216916',
'year': 2008}
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC08%2520XBB%27 HTTP/1.1" 200 None
2026-03-28 22:03:10 [bca.uk] INFO: Saving data for LC08%20XBB: {'created_time': 1774735390.345679, 'last_price_update_time': 1774735390.345692, 'auction_closing_time': 1774864800.0}
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LC08%2520XBB') HTTP/1.1" 204 0
2026-03-28 22:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699080986/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX68XHM/42809660?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=LehtVWZLTGCUq%2FHVaWaxVcM6eZjoYBHWl7BsrTTno54%3D)
2026-03-28 22:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285765/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV69BJO/42810768?sv=2020-08-04&st=2026-03-28T22%3A01%3A08Z&se=2026-03-28T22%3A26%3A08Z&sr=b&sp=r&sig=RhBgWIDbmwF%2F8XqW9pjzomUmOVaJM8ThWq2ap8w7j1M%3D)
2026-03-28 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698965992/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698965992>
2026-03-28 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285758/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285758>
2026-03-28 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981002/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981002>
2026-03-28 22:03:10 [scrapy.extensions.logstats] INFO: Crawled 80 pages (at 27 pages/min), scraped 123 items (at 47 items/min)
2026-03-28 22:03:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 22:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981010/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND62EWM/42810799?sv=2020-08-04&st=2026-03-28T22%3A01%3A06Z&se=2026-03-28T22%3A26%3A06Z&sr=b&sp=r&sig=KD3C6SJzwrdEgIjlL7QRYHJfSgh8rbJ%2FPC%2F%2BEfVah7k%3D)
2026-03-28 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058481/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699058481>
2026-03-28 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN07YUR/42809458?sv=2020-08-04&st=2026-03-28T22%3A03%3A09Z&se=2026-03-28T22%3A28%3A09Z&sr=b&sp=r&sig=PjRBmghGEeF4nZEPRiNU7FeSxRlVnvjHhXHrBd%2BKkEE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LN07%20YUR-GB>
2026-03-28 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547248890>
2026-03-28 22:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44fab252-6185-51e4-87e9-3f4c2a42edd8/44fab252-6185-51e4-87e9-3f4c2a42edd8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVA62BTY%252F698966061%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966061/600 saved to cache
2026-03-28 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 44fab252-6185-51e4-87e9-3f4c2a42edd8
2026-03-28 22:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544dd990>
2026-03-28 22:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc2a305-976b-5d20-86ca-43ed711c23db/1fc2a305-976b-5d20-86ca-43ed711c23db_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND62EWM%252F698981022%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981022/600 saved to cache
2026-03-28 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1fc2a305-976b-5d20-86ca-43ed711c23db
2026-03-28 22:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54739d810>
2026-03-28 22:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502dec79-4436-5ea8-b8a4-1afd151a13a2/502dec79-4436-5ea8-b8a4-1afd151a13a2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX68XHM%252F699080974%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699080974/600 saved to cache
2026-03-28 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 502dec79-4436-5ea8-b8a4-1afd151a13a2
2026-03-28 22:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058496/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ12NEO/42811151?sv=2020-08-04&st=2026-03-28T22%3A01%3A05Z&se=2026-03-28T22%3A26%3A05Z&sr=b&sp=r&sig=62h1oUPBDkzrRTgiSRZPyg2OGFZw9gvgjM6%2Bng4Eeco%3D)
2026-03-28 22:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698965997/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD57OLK/42810740?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=6hm7fODnR3wBKimIVKSkEorWvM8%2B5kHNq4nMJt6A%2BvY%3D)
2026-03-28 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698965985/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BD57OLK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966012/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966012>
2026-03-28 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058467/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PJ12NEO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544de490>
2026-03-28 22:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502dec79-4436-5ea8-b8a4-1afd151a13a2/502dec79-4436-5ea8-b8a4-1afd151a13a2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX68XHM%252F699080986%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699080986/600 saved to cache
2026-03-28 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 502dec79-4436-5ea8-b8a4-1afd151a13a2
2026-03-28 22:03:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 502dec79-4436-5ea8-b8a4-1afd151a13a2, skipping ID generation
2026-03-28 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 502dec79-4436-5ea8-b8a4-1afd151a13a2 sending to next pipeline
2026-03-28 22:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 502dec79-4436-5ea8-b8a4-1afd151a13a2, identifier: RX68%20XHM
2026-03-28 22:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55428fa50>
2026-03-28 22:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbce9e71-f6f9-5b70-87a1-2cf7e0368db6/fbce9e71-f6f9-5b70-87a1-2cf7e0368db6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV69BJO%252F699285765%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285765/600 saved to cache
2026-03-28 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fbce9e71-f6f9-5b70-87a1-2cf7e0368db6
2026-03-28 22:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a6f9d0>
2026-03-28 22:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc2a305-976b-5d20-86ca-43ed711c23db/1fc2a305-976b-5d20-86ca-43ed711c23db_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND62EWM%252F698981010%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981010/600 saved to cache
2026-03-28 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1fc2a305-976b-5d20-86ca-43ed711c23db
2026-03-28 22:03:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 502dec79-4436-5ea8-b8a4-1afd151a13a2 with identifier: RX68%20XHM
2026-03-28 22:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 502dec79-4436-5ea8-b8a4-1afd151a13a2 with identifier: RX68%20XHM
2026-03-28 22:03:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 502dec79-4436-5ea8-b8a4-1afd151a13a2 with identifier: RX68%20XHM to the API
2026-03-28 22:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699080986/600>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502dec79-4436-5ea8-b8a4-1afd151a13a2/502dec79-4436-5ea8-b8a4-1afd151a13a2_expert_report_file_b97225d5-e2ab-4eda-846b-ef5bee244ee7.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RX68%20XHM-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '502dec79-4436-5ea8-b8a4-1afd151a13a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RX68 XHM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RX68%20XHM&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'HONDA',
'model': 'CIVIC',
'odometer': 82544,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502dec79-4436-5ea8-b8a4-1afd151a13a2/502dec79-4436-5ea8-b8a4-1afd151a13a2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38753,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699080974/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502dec79-4436-5ea8-b8a4-1afd151a13a2/502dec79-4436-5ea8-b8a4-1afd151a13a2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37932,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699080986/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502dec79-4436-5ea8-b8a4-1afd151a13a2/502dec79-4436-5ea8-b8a4-1afd151a13a2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38745,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699080991/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502dec79-4436-5ea8-b8a4-1afd151a13a2/502dec79-4436-5ea8-b8a4-1afd151a13a2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38598,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081007/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502dec79-4436-5ea8-b8a4-1afd151a13a2/502dec79-4436-5ea8-b8a4-1afd151a13a2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31521,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081014/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502dec79-4436-5ea8-b8a4-1afd151a13a2/502dec79-4436-5ea8-b8a4-1afd151a13a2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31387,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081034/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502dec79-4436-5ea8-b8a4-1afd151a13a2/502dec79-4436-5ea8-b8a4-1afd151a13a2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62347,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081056/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502dec79-4436-5ea8-b8a4-1afd151a13a2/502dec79-4436-5ea8-b8a4-1afd151a13a2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59680,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081079/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502dec79-4436-5ea8-b8a4-1afd151a13a2/502dec79-4436-5ea8-b8a4-1afd151a13a2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63106,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081101/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502dec79-4436-5ea8-b8a4-1afd151a13a2/502dec79-4436-5ea8-b8a4-1afd151a13a2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64128,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX68XHM/699081138/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'HONDA CIVIC 1.5 VTEC TURBO 180 SPORT Hatchback',
'transmission': 'automatic',
'trim': 'VTEC TURBO 180 SPORT',
'vin': 'SHHFK7860JU005440',
'year': 2018}
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX68%2520XHM%27 HTTP/1.1" 200 None
2026-03-28 22:03:11 [bca.uk] INFO: Saving data for RX68%20XHM: {'created_time': 1774735391.213022, 'last_price_update_time': 1774735391.213037, 'auction_closing_time': 1774864800.0}
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RX68%2520XHM') HTTP/1.1" 204 0
2026-03-28 22:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966018/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VA62BTY/42810684?sv=2020-08-04&st=2026-03-28T22%3A01%3A03Z&se=2026-03-28T22%3A26%3A03Z&sr=b&sp=r&sig=N35MQzuEGC1T9OsmIXtmUT3IIUk5%2F7R2XsmdyzT4d0M%3D)
2026-03-28 22:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981002/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND62EWM/42810799?sv=2020-08-04&st=2026-03-28T22%3A01%3A06Z&se=2026-03-28T22%3A26%3A06Z&sr=b&sp=r&sig=KD3C6SJzwrdEgIjlL7QRYHJfSgh8rbJ%2FPC%2F%2BEfVah7k%3D)
2026-03-28 22:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285758/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV69BJO/42810768?sv=2020-08-04&st=2026-03-28T22%3A01%3A08Z&se=2026-03-28T22%3A26%3A08Z&sr=b&sp=r&sig=RhBgWIDbmwF%2F8XqW9pjzomUmOVaJM8ThWq2ap8w7j1M%3D)
2026-03-28 22:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698965992/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD57OLK/42810740?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=6hm7fODnR3wBKimIVKSkEorWvM8%2B5kHNq4nMJt6A%2BvY%3D)
2026-03-28 22:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058481/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ12NEO/42811151?sv=2020-08-04&st=2026-03-28T22%3A01%3A05Z&se=2026-03-28T22%3A26%3A05Z&sr=b&sp=r&sig=62h1oUPBDkzrRTgiSRZPyg2OGFZw9gvgjM6%2Bng4Eeco%3D)
2026-03-28 22:03:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966008/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698966008>
2026-03-28 22:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV18WXN/42810969?sv=2020-08-04&st=2026-03-28T22%3A03%3A09Z&se=2026-03-28T22%3A28%3A09Z&sr=b&sp=r&sig=ksrJfTjChZbrk26bNVd0L5y19BjSjpLvc7IT%2FMyTyME%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55456f350>
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf9384a7-c2b5-5829-81c5-0ab07891768a/cf9384a7-c2b5-5829-81c5-0ab07891768a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ12NEO%252F699058496%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058496/600 saved to cache
2026-03-28 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf9384a7-c2b5-5829-81c5-0ab07891768a
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54714fb10>
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f1a744f-dcf7-513c-adf2-49d9ca828470/8f1a744f-dcf7-513c-adf2-49d9ca828470_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD57OLK%252F698965997%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698965997/600 saved to cache
2026-03-28 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f1a744f-dcf7-513c-adf2-49d9ca828470
2026-03-28 22:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN07YUR/42809458?sv=2020-08-04&st=2026-03-28T22%3A03%3A09Z&se=2026-03-28T22%3A28%3A09Z&sr=b&sp=r&sig=PjRBmghGEeF4nZEPRiNU7FeSxRlVnvjHhXHrBd%2BKkEE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966012/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VA62BTY/42810684?sv=2020-08-04&st=2026-03-28T22%3A01%3A03Z&se=2026-03-28T22%3A26%3A03Z&sr=b&sp=r&sig=N35MQzuEGC1T9OsmIXtmUT3IIUk5%2F7R2XsmdyzT4d0M%3D)
2026-03-28 22:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058467/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ12NEO/42811151?sv=2020-08-04&st=2026-03-28T22%3A01%3A05Z&se=2026-03-28T22%3A26%3A05Z&sr=b&sp=r&sig=62h1oUPBDkzrRTgiSRZPyg2OGFZw9gvgjM6%2Bng4Eeco%3D)
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474e4790>
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44fab252-6185-51e4-87e9-3f4c2a42edd8/44fab252-6185-51e4-87e9-3f4c2a42edd8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVA62BTY%252F698966018%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966018/600 saved to cache
2026-03-28 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 44fab252-6185-51e4-87e9-3f4c2a42edd8
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5572a0790>
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc2a305-976b-5d20-86ca-43ed711c23db/1fc2a305-976b-5d20-86ca-43ed711c23db_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND62EWM%252F698981002%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981002/600 saved to cache
2026-03-28 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1fc2a305-976b-5d20-86ca-43ed711c23db
2026-03-28 22:03:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1fc2a305-976b-5d20-86ca-43ed711c23db, skipping ID generation
2026-03-28 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1fc2a305-976b-5d20-86ca-43ed711c23db sending to next pipeline
2026-03-28 22:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1fc2a305-976b-5d20-86ca-43ed711c23db, identifier: ND62%20EWM
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557379390>
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbce9e71-f6f9-5b70-87a1-2cf7e0368db6/fbce9e71-f6f9-5b70-87a1-2cf7e0368db6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV69BJO%252F699285758%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285758/600 saved to cache
2026-03-28 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fbce9e71-f6f9-5b70-87a1-2cf7e0368db6
2026-03-28 22:03:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fbce9e71-f6f9-5b70-87a1-2cf7e0368db6, skipping ID generation
2026-03-28 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fbce9e71-f6f9-5b70-87a1-2cf7e0368db6 sending to next pipeline
2026-03-28 22:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fbce9e71-f6f9-5b70-87a1-2cf7e0368db6, identifier: FV69%20BJO
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547279110>
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f1a744f-dcf7-513c-adf2-49d9ca828470/8f1a744f-dcf7-513c-adf2-49d9ca828470_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD57OLK%252F698965992%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698965992/600 saved to cache
2026-03-28 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f1a744f-dcf7-513c-adf2-49d9ca828470
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547291c50>
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf9384a7-c2b5-5829-81c5-0ab07891768a/cf9384a7-c2b5-5829-81c5-0ab07891768a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ12NEO%252F699058481%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058481/600 saved to cache
2026-03-28 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf9384a7-c2b5-5829-81c5-0ab07891768a
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b3150>
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9706080c-71c1-5f73-bc14-083fec0112e7/9706080c-71c1-5f73-bc14-083fec0112e7_expert_report_file_8cc28d7c-6474-4bf5-9cb9-662e7b2407a5.pdf HTTP/1.1" 201 0
2026-03-28 22:03:11 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9706080c-71c1-5f73-bc14-083fec0112e7
2026-03-28 22:03:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9706080c-71c1-5f73-bc14-083fec0112e7, skipping ID generation
2026-03-28 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9706080c-71c1-5f73-bc14-083fec0112e7
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWV18WXN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WV18WXN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1fc2a305-976b-5d20-86ca-43ed711c23db with identifier: ND62%20EWM
2026-03-28 22:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1fc2a305-976b-5d20-86ca-43ed711c23db with identifier: ND62%20EWM
2026-03-28 22:03:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1fc2a305-976b-5d20-86ca-43ed711c23db with identifier: ND62%20EWM to the API
2026-03-28 22:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981002/600>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc2a305-976b-5d20-86ca-43ed711c23db/1fc2a305-976b-5d20-86ca-43ed711c23db_expert_report_file_8beb78f4-fca6-492c-8d96-6a99fbac9069.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND62%20EWM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1fc2a305-976b-5d20-86ca-43ed711c23db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ND62 EWM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ND62%20EWM&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 111765,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc2a305-976b-5d20-86ca-43ed711c23db/1fc2a305-976b-5d20-86ca-43ed711c23db_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37927,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698980998/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc2a305-976b-5d20-86ca-43ed711c23db/1fc2a305-976b-5d20-86ca-43ed711c23db_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37402,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981002/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc2a305-976b-5d20-86ca-43ed711c23db/1fc2a305-976b-5d20-86ca-43ed711c23db_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37326,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981010/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc2a305-976b-5d20-86ca-43ed711c23db/1fc2a305-976b-5d20-86ca-43ed711c23db_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36443,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981022/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc2a305-976b-5d20-86ca-43ed711c23db/1fc2a305-976b-5d20-86ca-43ed711c23db_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30848,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981039/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc2a305-976b-5d20-86ca-43ed711c23db/1fc2a305-976b-5d20-86ca-43ed711c23db_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31037,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981057/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc2a305-976b-5d20-86ca-43ed711c23db/1fc2a305-976b-5d20-86ca-43ed711c23db_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71067,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981103/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc2a305-976b-5d20-86ca-43ed711c23db/1fc2a305-976b-5d20-86ca-43ed711c23db_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61243,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981145/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc2a305-976b-5d20-86ca-43ed711c23db/1fc2a305-976b-5d20-86ca-43ed711c23db_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69087,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981179/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc2a305-976b-5d20-86ca-43ed711c23db/1fc2a305-976b-5d20-86ca-43ed711c23db_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63579,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND62EWM/698981217/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'NISSAN MICRA 1.2 TEKNA Hatchback',
'transmission': 'manual',
'trim': 'TEKNA',
'vin': 'MDHFBUK13U0519658',
'year': 2012}
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND62%2520EWM%27 HTTP/1.1" 200 None
2026-03-28 22:03:12 [bca.uk] INFO: Saving data for ND62%20EWM: {'created_time': 1774735392.152456, 'last_price_update_time': 1774735392.152466, 'auction_closing_time': 1774864800.0}
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ND62%2520EWM') HTTP/1.1" 204 0
2026-03-28 22:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fbce9e71-f6f9-5b70-87a1-2cf7e0368db6 with identifier: FV69%20BJO
2026-03-28 22:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fbce9e71-f6f9-5b70-87a1-2cf7e0368db6 with identifier: FV69%20BJO
2026-03-28 22:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fbce9e71-f6f9-5b70-87a1-2cf7e0368db6 with identifier: FV69%20BJO to the API
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285758/600>
{'auction_title': '',
'c_o_2_emission_value': 103,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbce9e71-f6f9-5b70-87a1-2cf7e0368db6/fbce9e71-f6f9-5b70-87a1-2cf7e0368db6_expert_report_file_1ef25e8b-f33f-4fe5-afb6-2a0b783ef3a6.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FV69%20BJO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fbce9e71-f6f9-5b70-87a1-2cf7e0368db6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FV69 BJO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FV69%20BJO&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'MAZDA',
'model': '3',
'odometer': 67242,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbce9e71-f6f9-5b70-87a1-2cf7e0368db6/fbce9e71-f6f9-5b70-87a1-2cf7e0368db6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39142,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285748/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbce9e71-f6f9-5b70-87a1-2cf7e0368db6/fbce9e71-f6f9-5b70-87a1-2cf7e0368db6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36077,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285758/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbce9e71-f6f9-5b70-87a1-2cf7e0368db6/fbce9e71-f6f9-5b70-87a1-2cf7e0368db6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37060,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285765/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbce9e71-f6f9-5b70-87a1-2cf7e0368db6/fbce9e71-f6f9-5b70-87a1-2cf7e0368db6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38110,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285772/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbce9e71-f6f9-5b70-87a1-2cf7e0368db6/fbce9e71-f6f9-5b70-87a1-2cf7e0368db6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32979,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285782/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbce9e71-f6f9-5b70-87a1-2cf7e0368db6/fbce9e71-f6f9-5b70-87a1-2cf7e0368db6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30881,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285790/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbce9e71-f6f9-5b70-87a1-2cf7e0368db6/fbce9e71-f6f9-5b70-87a1-2cf7e0368db6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70185,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285802/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbce9e71-f6f9-5b70-87a1-2cf7e0368db6/fbce9e71-f6f9-5b70-87a1-2cf7e0368db6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61955,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285814/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbce9e71-f6f9-5b70-87a1-2cf7e0368db6/fbce9e71-f6f9-5b70-87a1-2cf7e0368db6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75097,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285828/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbce9e71-f6f9-5b70-87a1-2cf7e0368db6/fbce9e71-f6f9-5b70-87a1-2cf7e0368db6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95838,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV69BJO/699285845/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'MAZDA 3 2.0 SKY-X SPORT LUX Hatchback',
'transmission': 'manual',
'trim': 'SKY-X SPORT LUX',
'vin': 'JMZBP6HH601133053',
'year': 2019}
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV69%2520BJO%27 HTTP/1.1" 200 None
2026-03-28 22:03:12 [bca.uk] INFO: Saving data for FV69%20BJO: {'created_time': 1774735392.541278, 'last_price_update_time': 1774735392.541288, 'auction_closing_time': 1774951200.0}
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FV69%2520BJO') HTTP/1.1" 204 0
2026-03-28 22:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966008/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VA62BTY/42810684?sv=2020-08-04&st=2026-03-28T22%3A01%3A03Z&se=2026-03-28T22%3A26%3A03Z&sr=b&sp=r&sig=N35MQzuEGC1T9OsmIXtmUT3IIUk5%2F7R2XsmdyzT4d0M%3D)
2026-03-28 22:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698965985/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD57OLK/42810740?sv=2020-08-04&st=2026-03-28T22%3A01%3A07Z&se=2026-03-28T22%3A26%3A07Z&sr=b&sp=r&sig=6hm7fODnR3wBKimIVKSkEorWvM8%2B5kHNq4nMJt6A%2BvY%3D)
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699032934%27 HTTP/1.1" 200 None
2026-03-28 22:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032934 not downloaded yet
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699032950%27 HTTP/1.1" 200 None
2026-03-28 22:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032950 not downloaded yet
2026-03-28 22:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473dcfd0>
2026-03-28 22:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20c106fd-0836-5717-a42b-17b79fbe25e4/20c106fd-0836-5717-a42b-17b79fbe25e4_expert_report_file_d469847c-94cc-4d7d-bba7-91d3346ee290.pdf HTTP/1.1" 201 0
2026-03-28 22:03:12 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 20c106fd-0836-5717-a42b-17b79fbe25e4
2026-03-28 22:03:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20c106fd-0836-5717-a42b-17b79fbe25e4, skipping ID generation
2026-03-28 22:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 20c106fd-0836-5717-a42b-17b79fbe25e4
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLN07YUR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LN07YUR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547775590>
2026-03-28 22:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44fab252-6185-51e4-87e9-3f4c2a42edd8/44fab252-6185-51e4-87e9-3f4c2a42edd8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVA62BTY%252F698966012%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966012/600 saved to cache
2026-03-28 22:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 44fab252-6185-51e4-87e9-3f4c2a42edd8
2026-03-28 22:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555033fd0>
2026-03-28 22:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf9384a7-c2b5-5829-81c5-0ab07891768a/cf9384a7-c2b5-5829-81c5-0ab07891768a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ12NEO%252F699058467%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058467/600 saved to cache
2026-03-28 22:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf9384a7-c2b5-5829-81c5-0ab07891768a
2026-03-28 22:03:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf9384a7-c2b5-5829-81c5-0ab07891768a, skipping ID generation
2026-03-28 22:03:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf9384a7-c2b5-5829-81c5-0ab07891768a sending to next pipeline
2026-03-28 22:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cf9384a7-c2b5-5829-81c5-0ab07891768a, identifier: PJ12%20NEO
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699032961%27 HTTP/1.1" 200 None
2026-03-28 22:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032961 not downloaded yet
2026-03-28 22:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cf9384a7-c2b5-5829-81c5-0ab07891768a with identifier: PJ12%20NEO
2026-03-28 22:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cf9384a7-c2b5-5829-81c5-0ab07891768a with identifier: PJ12%20NEO
2026-03-28 22:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cf9384a7-c2b5-5829-81c5-0ab07891768a with identifier: PJ12%20NEO to the API
2026-03-28 22:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058467/600>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf9384a7-c2b5-5829-81c5-0ab07891768a/cf9384a7-c2b5-5829-81c5-0ab07891768a_expert_report_file_b5833f2b-ad9a-4b04-9de0-257c9ebeb040.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ12%20NEO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'cf9384a7-c2b5-5829-81c5-0ab07891768a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PJ12 NEO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PJ12%20NEO&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VAUXHALL',
'model': 'ZAFIRA TOURER',
'odometer': 109931,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf9384a7-c2b5-5829-81c5-0ab07891768a/cf9384a7-c2b5-5829-81c5-0ab07891768a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37107,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058467/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf9384a7-c2b5-5829-81c5-0ab07891768a/cf9384a7-c2b5-5829-81c5-0ab07891768a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38324,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058481/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf9384a7-c2b5-5829-81c5-0ab07891768a/cf9384a7-c2b5-5829-81c5-0ab07891768a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36296,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058496/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf9384a7-c2b5-5829-81c5-0ab07891768a/cf9384a7-c2b5-5829-81c5-0ab07891768a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35564,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058511/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf9384a7-c2b5-5829-81c5-0ab07891768a/cf9384a7-c2b5-5829-81c5-0ab07891768a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32015,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058527/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf9384a7-c2b5-5829-81c5-0ab07891768a/cf9384a7-c2b5-5829-81c5-0ab07891768a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32149,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058536/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf9384a7-c2b5-5829-81c5-0ab07891768a/cf9384a7-c2b5-5829-81c5-0ab07891768a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87010,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058568/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf9384a7-c2b5-5829-81c5-0ab07891768a/cf9384a7-c2b5-5829-81c5-0ab07891768a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83219,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058600/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf9384a7-c2b5-5829-81c5-0ab07891768a/cf9384a7-c2b5-5829-81c5-0ab07891768a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95723,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058625/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf9384a7-c2b5-5829-81c5-0ab07891768a/cf9384a7-c2b5-5829-81c5-0ab07891768a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88688,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ12NEO/699058638/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'VAUXHALL ZAFIRA TOURER 2.0 CDTI 130 E/F EXCLUSIV MPV',
'transmission': 'manual',
'trim': 'CDTI 130 E/F EXCLUSIV',
'vin': 'W0LPD9EM3C2053446',
'year': 2012}
2026-03-28 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ12%2520NEO%27 HTTP/1.1" 200 None
2026-03-28 22:03:13 [bca.uk] INFO: Saving data for PJ12%20NEO: {'created_time': 1774735393.343568, 'last_price_update_time': 1774735393.343579, 'auction_closing_time': 1774864800.0}
2026-03-28 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PJ12%2520NEO') HTTP/1.1" 204 0
2026-03-28 22:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699032919/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WV18WXN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189122%27 HTTP/1.1" 200 None
2026-03-28 22:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189122 not downloaded yet
2026-03-28 22:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542fea10>
2026-03-28 22:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44fab252-6185-51e4-87e9-3f4c2a42edd8/44fab252-6185-51e4-87e9-3f4c2a42edd8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVA62BTY%252F698966008%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966008/600 saved to cache
2026-03-28 22:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 44fab252-6185-51e4-87e9-3f4c2a42edd8
2026-03-28 22:03:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44fab252-6185-51e4-87e9-3f4c2a42edd8, skipping ID generation
2026-03-28 22:03:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44fab252-6185-51e4-87e9-3f4c2a42edd8 sending to next pipeline
2026-03-28 22:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 44fab252-6185-51e4-87e9-3f4c2a42edd8, identifier: VA62%20BTY
2026-03-28 22:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542ba8d0>
2026-03-28 22:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f1a744f-dcf7-513c-adf2-49d9ca828470/8f1a744f-dcf7-513c-adf2-49d9ca828470_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD57OLK%252F698965985%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698965985/600 saved to cache
2026-03-28 22:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f1a744f-dcf7-513c-adf2-49d9ca828470
2026-03-28 22:03:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f1a744f-dcf7-513c-adf2-49d9ca828470, skipping ID generation
2026-03-28 22:03:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f1a744f-dcf7-513c-adf2-49d9ca828470 sending to next pipeline
2026-03-28 22:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8f1a744f-dcf7-513c-adf2-49d9ca828470, identifier: BD57%20OLK
2026-03-28 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699032968%27 HTTP/1.1" 200 None
2026-03-28 22:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032968 not downloaded yet
2026-03-28 22:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 44fab252-6185-51e4-87e9-3f4c2a42edd8 with identifier: VA62%20BTY
2026-03-28 22:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 44fab252-6185-51e4-87e9-3f4c2a42edd8 with identifier: VA62%20BTY
2026-03-28 22:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 44fab252-6185-51e4-87e9-3f4c2a42edd8 with identifier: VA62%20BTY to the API
2026-03-28 22:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966008/600>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44fab252-6185-51e4-87e9-3f4c2a42edd8/44fab252-6185-51e4-87e9-3f4c2a42edd8_expert_report_file_94673aa7-642d-46ca-8329-8a567d1592d1.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VA62%20BTY-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '44fab252-6185-51e4-87e9-3f4c2a42edd8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VA62 BTY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VA62%20BTY&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 109013,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44fab252-6185-51e4-87e9-3f4c2a42edd8/44fab252-6185-51e4-87e9-3f4c2a42edd8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38157,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698965988/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44fab252-6185-51e4-87e9-3f4c2a42edd8/44fab252-6185-51e4-87e9-3f4c2a42edd8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37457,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698965995/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44fab252-6185-51e4-87e9-3f4c2a42edd8/44fab252-6185-51e4-87e9-3f4c2a42edd8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36204,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966001/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44fab252-6185-51e4-87e9-3f4c2a42edd8/44fab252-6185-51e4-87e9-3f4c2a42edd8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36226,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966008/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44fab252-6185-51e4-87e9-3f4c2a42edd8/44fab252-6185-51e4-87e9-3f4c2a42edd8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32150,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966012/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44fab252-6185-51e4-87e9-3f4c2a42edd8/44fab252-6185-51e4-87e9-3f4c2a42edd8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31795,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966018/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44fab252-6185-51e4-87e9-3f4c2a42edd8/44fab252-6185-51e4-87e9-3f4c2a42edd8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53384,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966061/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44fab252-6185-51e4-87e9-3f4c2a42edd8/44fab252-6185-51e4-87e9-3f4c2a42edd8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63302,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966068/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44fab252-6185-51e4-87e9-3f4c2a42edd8/44fab252-6185-51e4-87e9-3f4c2a42edd8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75913,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966077/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44fab252-6185-51e4-87e9-3f4c2a42edd8/44fab252-6185-51e4-87e9-3f4c2a42edd8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64649,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA62BTY/698966081/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.6 TDI 105 SE Hatchback',
'transmission': 'manual',
'trim': 'TDI 105 SE',
'vin': 'WVWZZZAUZDP020785',
'year': 2013}
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA62%2520BTY%27 HTTP/1.1" 200 None
2026-03-28 22:03:14 [bca.uk] INFO: Saving data for VA62%20BTY: {'created_time': 1774735394.049766, 'last_price_update_time': 1774735394.049777, 'auction_closing_time': 1774864800.0}
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VA62%2520BTY') HTTP/1.1" 204 0
2026-03-28 22:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8f1a744f-dcf7-513c-adf2-49d9ca828470 with identifier: BD57%20OLK
2026-03-28 22:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8f1a744f-dcf7-513c-adf2-49d9ca828470 with identifier: BD57%20OLK
2026-03-28 22:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8f1a744f-dcf7-513c-adf2-49d9ca828470 with identifier: BD57%20OLK to the API
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698965985/600>
{'auction_title': '',
'c_o_2_emission_value': 183,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f1a744f-dcf7-513c-adf2-49d9ca828470/8f1a744f-dcf7-513c-adf2-49d9ca828470_expert_report_file_6c048fa2-79e2-44e1-a591-6f9d766a8c78.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BD57%20OLK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8f1a744f-dcf7-513c-adf2-49d9ca828470',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BD57 OLK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BD57%20OLK&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'AUDI',
'model': 'TT',
'odometer': 132337,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f1a744f-dcf7-513c-adf2-49d9ca828470/8f1a744f-dcf7-513c-adf2-49d9ca828470_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38501,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698965985/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f1a744f-dcf7-513c-adf2-49d9ca828470/8f1a744f-dcf7-513c-adf2-49d9ca828470_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39325,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698965992/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f1a744f-dcf7-513c-adf2-49d9ca828470/8f1a744f-dcf7-513c-adf2-49d9ca828470_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36536,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698965997/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f1a744f-dcf7-513c-adf2-49d9ca828470/8f1a744f-dcf7-513c-adf2-49d9ca828470_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35372,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966005/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f1a744f-dcf7-513c-adf2-49d9ca828470/8f1a744f-dcf7-513c-adf2-49d9ca828470_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32528,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966013/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f1a744f-dcf7-513c-adf2-49d9ca828470/8f1a744f-dcf7-513c-adf2-49d9ca828470_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32743,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966027/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f1a744f-dcf7-513c-adf2-49d9ca828470/8f1a744f-dcf7-513c-adf2-49d9ca828470_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81414,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966038/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f1a744f-dcf7-513c-adf2-49d9ca828470/8f1a744f-dcf7-513c-adf2-49d9ca828470_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46780,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966045/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f1a744f-dcf7-513c-adf2-49d9ca828470/8f1a744f-dcf7-513c-adf2-49d9ca828470_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74537,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966059/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f1a744f-dcf7-513c-adf2-49d9ca828470/8f1a744f-dcf7-513c-adf2-49d9ca828470_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74595,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD57OLK/698966066/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'AUDI TT 2.0 TFSI S-T Coupe',
'transmission': 'automatic',
'trim': 'TFSI S-T',
'vin': 'TRUZZZ8J881024203',
'year': 2007}
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD57%2520OLK%27 HTTP/1.1" 200 None
2026-03-28 22:03:14 [bca.uk] INFO: Saving data for BD57%20OLK: {'created_time': 1774735394.452872, 'last_price_update_time': 1774735394.452883, 'auction_closing_time': 1774864800.0}
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BD57%2520OLK') HTTP/1.1" 204 0
2026-03-28 22:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699032934/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032934>
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189128%27 HTTP/1.1" 200 None
2026-03-28 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189128 not downloaded yet
2026-03-28 22:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699032950/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032950>
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699032987%27 HTTP/1.1" 200 None
2026-03-28 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032987 not downloaded yet
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189137%27 HTTP/1.1" 200 None
2026-03-28 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189137 not downloaded yet
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699033007%27 HTTP/1.1" 200 None
2026-03-28 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699033007 not downloaded yet
2026-03-28 22:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699032919/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV18WXN/42810969?sv=2020-08-04&st=2026-03-28T22%3A03%3A09Z&se=2026-03-28T22%3A28%3A09Z&sr=b&sp=r&sig=ksrJfTjChZbrk26bNVd0L5y19BjSjpLvc7IT%2FMyTyME%3D)
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189142%27 HTTP/1.1" 200 None
2026-03-28 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189142 not downloaded yet
2026-03-28 22:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189116/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LN07YUR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699033028%27 HTTP/1.1" 200 None
2026-03-28 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699033028 not downloaded yet
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189150%27 HTTP/1.1" 200 None
2026-03-28 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189150 not downloaded yet
2026-03-28 22:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699032950/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV18WXN/42810969?sv=2020-08-04&st=2026-03-28T22%3A03%3A09Z&se=2026-03-28T22%3A28%3A09Z&sr=b&sp=r&sig=ksrJfTjChZbrk26bNVd0L5y19BjSjpLvc7IT%2FMyTyME%3D)
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699033050%27 HTTP/1.1" 200 None
2026-03-28 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699033050 not downloaded yet
2026-03-28 22:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699032961/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032961>
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189161%27 HTTP/1.1" 200 None
2026-03-28 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189161 not downloaded yet
2026-03-28 22:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699032934/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV18WXN/42810969?sv=2020-08-04&st=2026-03-28T22%3A03%3A09Z&se=2026-03-28T22%3A28%3A09Z&sr=b&sp=r&sig=ksrJfTjChZbrk26bNVd0L5y19BjSjpLvc7IT%2FMyTyME%3D)
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699033065%27 HTTP/1.1" 200 None
2026-03-28 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699033065 not downloaded yet
2026-03-28 22:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189128/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189128>
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189174%27 HTTP/1.1" 200 None
2026-03-28 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189174 not downloaded yet
2026-03-28 22:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699032987/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032987>
2026-03-28 22:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189116/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN07YUR/42809458?sv=2020-08-04&st=2026-03-28T22%3A03%3A09Z&se=2026-03-28T22%3A28%3A09Z&sr=b&sp=r&sig=PjRBmghGEeF4nZEPRiNU7FeSxRlVnvjHhXHrBd%2BKkEE%3D)
2026-03-28 22:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189122/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189122>
2026-03-28 22:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699032968/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699032968>
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189189%27 HTTP/1.1" 200 None
2026-03-28 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189189 not downloaded yet
2026-03-28 22:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542ff610>
2026-03-28 22:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9706080c-71c1-5f73-bc14-083fec0112e7/9706080c-71c1-5f73-bc14-083fec0112e7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV18WXN%252F699032919%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699032919/600 saved to cache
2026-03-28 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9706080c-71c1-5f73-bc14-083fec0112e7
2026-03-28 22:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189137/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189137>
2026-03-28 22:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699033007/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699033007>
2026-03-28 22:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189142/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189142>
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189201%27 HTTP/1.1" 200 None
2026-03-28 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189201 not downloaded yet
2026-03-28 22:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477576d0>
2026-03-28 22:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9706080c-71c1-5f73-bc14-083fec0112e7/9706080c-71c1-5f73-bc14-083fec0112e7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV18WXN%252F699032950%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699032950/600 saved to cache
2026-03-28 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9706080c-71c1-5f73-bc14-083fec0112e7
2026-03-28 22:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477ac5d0>
2026-03-28 22:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9706080c-71c1-5f73-bc14-083fec0112e7/9706080c-71c1-5f73-bc14-083fec0112e7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV18WXN%252F699032934%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699032934/600 saved to cache
2026-03-28 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9706080c-71c1-5f73-bc14-083fec0112e7
2026-03-28 22:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699032961/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV18WXN/42810969?sv=2020-08-04&st=2026-03-28T22%3A03%3A09Z&se=2026-03-28T22%3A28%3A09Z&sr=b&sp=r&sig=ksrJfTjChZbrk26bNVd0L5y19BjSjpLvc7IT%2FMyTyME%3D)
2026-03-28 22:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189128/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN07YUR/42809458?sv=2020-08-04&st=2026-03-28T22%3A03%3A09Z&se=2026-03-28T22%3A28%3A09Z&sr=b&sp=r&sig=PjRBmghGEeF4nZEPRiNU7FeSxRlVnvjHhXHrBd%2BKkEE%3D)
2026-03-28 22:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189150/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189150>
2026-03-28 22:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189161/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189161>
2026-03-28 22:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699033028/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699033028>
2026-03-28 22:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189122/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN07YUR/42809458?sv=2020-08-04&st=2026-03-28T22%3A03%3A09Z&se=2026-03-28T22%3A28%3A09Z&sr=b&sp=r&sig=PjRBmghGEeF4nZEPRiNU7FeSxRlVnvjHhXHrBd%2BKkEE%3D)
2026-03-28 22:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699033050/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699033050>
2026-03-28 22:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f96290>
2026-03-28 22:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20c106fd-0836-5717-a42b-17b79fbe25e4/20c106fd-0836-5717-a42b-17b79fbe25e4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN07YUR%252F699189116%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189116/600 saved to cache
2026-03-28 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20c106fd-0836-5717-a42b-17b79fbe25e4
2026-03-28 22:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699032968/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV18WXN/42810969?sv=2020-08-04&st=2026-03-28T22%3A03%3A09Z&se=2026-03-28T22%3A28%3A09Z&sr=b&sp=r&sig=ksrJfTjChZbrk26bNVd0L5y19BjSjpLvc7IT%2FMyTyME%3D)
2026-03-28 22:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189142/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN07YUR/42809458?sv=2020-08-04&st=2026-03-28T22%3A03%3A09Z&se=2026-03-28T22%3A28%3A09Z&sr=b&sp=r&sig=PjRBmghGEeF4nZEPRiNU7FeSxRlVnvjHhXHrBd%2BKkEE%3D)
2026-03-28 22:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189137/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN07YUR/42809458?sv=2020-08-04&st=2026-03-28T22%3A03%3A09Z&se=2026-03-28T22%3A28%3A09Z&sr=b&sp=r&sig=PjRBmghGEeF4nZEPRiNU7FeSxRlVnvjHhXHrBd%2BKkEE%3D)
2026-03-28 22:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699033065/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699033065>
2026-03-28 22:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189174/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189174>
2026-03-28 22:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189189/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189189>
2026-03-28 22:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699032987/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV18WXN/42810969?sv=2020-08-04&st=2026-03-28T22%3A03%3A09Z&se=2026-03-28T22%3A28%3A09Z&sr=b&sp=r&sig=ksrJfTjChZbrk26bNVd0L5y19BjSjpLvc7IT%2FMyTyME%3D)
2026-03-28 22:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699033007/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV18WXN/42810969?sv=2020-08-04&st=2026-03-28T22%3A03%3A09Z&se=2026-03-28T22%3A28%3A09Z&sr=b&sp=r&sig=ksrJfTjChZbrk26bNVd0L5y19BjSjpLvc7IT%2FMyTyME%3D)
2026-03-28 22:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5550304d0>
2026-03-28 22:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9706080c-71c1-5f73-bc14-083fec0112e7/9706080c-71c1-5f73-bc14-083fec0112e7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV18WXN%252F699032961%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699032961/600 saved to cache
2026-03-28 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9706080c-71c1-5f73-bc14-083fec0112e7
2026-03-28 22:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547f5d10>
2026-03-28 22:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20c106fd-0836-5717-a42b-17b79fbe25e4/20c106fd-0836-5717-a42b-17b79fbe25e4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN07YUR%252F699189128%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189128/600 saved to cache
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 20c106fd-0836-5717-a42b-17b79fbe25e4
2026-03-28 22:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189150/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN07YUR/42809458?sv=2020-08-04&st=2026-03-28T22%3A03%3A09Z&se=2026-03-28T22%3A28%3A09Z&sr=b&sp=r&sig=PjRBmghGEeF4nZEPRiNU7FeSxRlVnvjHhXHrBd%2BKkEE%3D)
2026-03-28 22:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699033028/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV18WXN/42810969?sv=2020-08-04&st=2026-03-28T22%3A03%3A09Z&se=2026-03-28T22%3A28%3A09Z&sr=b&sp=r&sig=ksrJfTjChZbrk26bNVd0L5y19BjSjpLvc7IT%2FMyTyME%3D)
2026-03-28 22:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189201/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189201>
2026-03-28 22:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189189/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN07YUR/42809458?sv=2020-08-04&st=2026-03-28T22%3A03%3A09Z&se=2026-03-28T22%3A28%3A09Z&sr=b&sp=r&sig=PjRBmghGEeF4nZEPRiNU7FeSxRlVnvjHhXHrBd%2BKkEE%3D)
2026-03-28 22:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189174/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN07YUR/42809458?sv=2020-08-04&st=2026-03-28T22%3A03%3A09Z&se=2026-03-28T22%3A28%3A09Z&sr=b&sp=r&sig=PjRBmghGEeF4nZEPRiNU7FeSxRlVnvjHhXHrBd%2BKkEE%3D)
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556f7e950>
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20c106fd-0836-5717-a42b-17b79fbe25e4/20c106fd-0836-5717-a42b-17b79fbe25e4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN07YUR%252F699189122%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189122/600 saved to cache
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 20c106fd-0836-5717-a42b-17b79fbe25e4
2026-03-28 22:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699033050/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV18WXN/42810969?sv=2020-08-04&st=2026-03-28T22%3A03%3A09Z&se=2026-03-28T22%3A28%3A09Z&sr=b&sp=r&sig=ksrJfTjChZbrk26bNVd0L5y19BjSjpLvc7IT%2FMyTyME%3D)
2026-03-28 22:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189161/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN07YUR/42809458?sv=2020-08-04&st=2026-03-28T22%3A03%3A09Z&se=2026-03-28T22%3A28%3A09Z&sr=b&sp=r&sig=PjRBmghGEeF4nZEPRiNU7FeSxRlVnvjHhXHrBd%2BKkEE%3D)
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b83d50>
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9706080c-71c1-5f73-bc14-083fec0112e7/9706080c-71c1-5f73-bc14-083fec0112e7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV18WXN%252F699032968%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699032968/600 saved to cache
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9706080c-71c1-5f73-bc14-083fec0112e7
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555e13ed0>
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20c106fd-0836-5717-a42b-17b79fbe25e4/20c106fd-0836-5717-a42b-17b79fbe25e4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN07YUR%252F699189142%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189142/600 saved to cache
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 20c106fd-0836-5717-a42b-17b79fbe25e4
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549649d0>
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20c106fd-0836-5717-a42b-17b79fbe25e4/20c106fd-0836-5717-a42b-17b79fbe25e4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN07YUR%252F699189137%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189137/600 saved to cache
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 20c106fd-0836-5717-a42b-17b79fbe25e4
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549b0750>
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9706080c-71c1-5f73-bc14-083fec0112e7/9706080c-71c1-5f73-bc14-083fec0112e7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV18WXN%252F699032987%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699032987/600 saved to cache
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9706080c-71c1-5f73-bc14-083fec0112e7
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547279390>
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9706080c-71c1-5f73-bc14-083fec0112e7/9706080c-71c1-5f73-bc14-083fec0112e7_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV18WXN%252F699033007%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699033007/600 saved to cache
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9706080c-71c1-5f73-bc14-083fec0112e7
2026-03-28 22:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699033065/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV18WXN/42810969?sv=2020-08-04&st=2026-03-28T22%3A03%3A09Z&se=2026-03-28T22%3A28%3A09Z&sr=b&sp=r&sig=ksrJfTjChZbrk26bNVd0L5y19BjSjpLvc7IT%2FMyTyME%3D)
2026-03-28 22:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189201/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN07YUR/42809458?sv=2020-08-04&st=2026-03-28T22%3A03%3A09Z&se=2026-03-28T22%3A28%3A09Z&sr=b&sp=r&sig=PjRBmghGEeF4nZEPRiNU7FeSxRlVnvjHhXHrBd%2BKkEE%3D)
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54710c650>
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20c106fd-0836-5717-a42b-17b79fbe25e4/20c106fd-0836-5717-a42b-17b79fbe25e4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN07YUR%252F699189150%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189150/600 saved to cache
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 20c106fd-0836-5717-a42b-17b79fbe25e4
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55495d610>
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9706080c-71c1-5f73-bc14-083fec0112e7/9706080c-71c1-5f73-bc14-083fec0112e7_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV18WXN%252F699033028%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699033028/600 saved to cache
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9706080c-71c1-5f73-bc14-083fec0112e7
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547170d10>
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20c106fd-0836-5717-a42b-17b79fbe25e4/20c106fd-0836-5717-a42b-17b79fbe25e4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN07YUR%252F699189189%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189189/600 saved to cache
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 20c106fd-0836-5717-a42b-17b79fbe25e4
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542d4890>
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20c106fd-0836-5717-a42b-17b79fbe25e4/20c106fd-0836-5717-a42b-17b79fbe25e4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN07YUR%252F699189174%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189174/600 saved to cache
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 20c106fd-0836-5717-a42b-17b79fbe25e4
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547170610>
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9706080c-71c1-5f73-bc14-083fec0112e7/9706080c-71c1-5f73-bc14-083fec0112e7_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV18WXN%252F699033050%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699033050/600 saved to cache
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9706080c-71c1-5f73-bc14-083fec0112e7
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54747a850>
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20c106fd-0836-5717-a42b-17b79fbe25e4/20c106fd-0836-5717-a42b-17b79fbe25e4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN07YUR%252F699189161%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189161/600 saved to cache
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 20c106fd-0836-5717-a42b-17b79fbe25e4
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554937390>
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9706080c-71c1-5f73-bc14-083fec0112e7/9706080c-71c1-5f73-bc14-083fec0112e7_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV18WXN%252F699033065%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699033065/600 saved to cache
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9706080c-71c1-5f73-bc14-083fec0112e7
2026-03-28 22:03:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9706080c-71c1-5f73-bc14-083fec0112e7, skipping ID generation
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9706080c-71c1-5f73-bc14-083fec0112e7 sending to next pipeline
2026-03-28 22:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9706080c-71c1-5f73-bc14-083fec0112e7, identifier: WV18%20WXN
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54747b150>
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20c106fd-0836-5717-a42b-17b79fbe25e4/20c106fd-0836-5717-a42b-17b79fbe25e4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN07YUR%252F699189201%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189201/600 saved to cache
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 20c106fd-0836-5717-a42b-17b79fbe25e4
2026-03-28 22:03:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20c106fd-0836-5717-a42b-17b79fbe25e4, skipping ID generation
2026-03-28 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20c106fd-0836-5717-a42b-17b79fbe25e4 sending to next pipeline
2026-03-28 22:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 20c106fd-0836-5717-a42b-17b79fbe25e4, identifier: LN07%20YUR
2026-03-28 22:03:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9706080c-71c1-5f73-bc14-083fec0112e7 with identifier: WV18%20WXN
2026-03-28 22:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9706080c-71c1-5f73-bc14-083fec0112e7 with identifier: WV18%20WXN
2026-03-28 22:03:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9706080c-71c1-5f73-bc14-083fec0112e7 with identifier: WV18%20WXN to the API
2026-03-28 22:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699033065/600>
{'auction_title': '',
'c_o_2_emission_value': 132,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9706080c-71c1-5f73-bc14-083fec0112e7/9706080c-71c1-5f73-bc14-083fec0112e7_expert_report_file_8cc28d7c-6474-4bf5-9cb9-662e7b2407a5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WV18%20WXN-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9706080c-71c1-5f73-bc14-083fec0112e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WV18 WXN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WV18%20WXN&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'MERCEDES-BENZ',
'model': 'A200',
'odometer': 31268,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9706080c-71c1-5f73-bc14-083fec0112e7/9706080c-71c1-5f73-bc14-083fec0112e7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42455,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699032919/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9706080c-71c1-5f73-bc14-083fec0112e7/9706080c-71c1-5f73-bc14-083fec0112e7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42728,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699032934/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9706080c-71c1-5f73-bc14-083fec0112e7/9706080c-71c1-5f73-bc14-083fec0112e7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40167,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699032950/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9706080c-71c1-5f73-bc14-083fec0112e7/9706080c-71c1-5f73-bc14-083fec0112e7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41307,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699032961/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9706080c-71c1-5f73-bc14-083fec0112e7/9706080c-71c1-5f73-bc14-083fec0112e7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37047,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699032968/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9706080c-71c1-5f73-bc14-083fec0112e7/9706080c-71c1-5f73-bc14-083fec0112e7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36680,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699032987/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9706080c-71c1-5f73-bc14-083fec0112e7/9706080c-71c1-5f73-bc14-083fec0112e7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69737,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699033007/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9706080c-71c1-5f73-bc14-083fec0112e7/9706080c-71c1-5f73-bc14-083fec0112e7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60693,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699033028/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9706080c-71c1-5f73-bc14-083fec0112e7/9706080c-71c1-5f73-bc14-083fec0112e7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81120,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699033050/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9706080c-71c1-5f73-bc14-083fec0112e7/9706080c-71c1-5f73-bc14-083fec0112e7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89012,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV18WXN/699033065/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A200 1.6 AMG LINE EXECUTIVE Hatchback',
'transmission': 'manual',
'trim': 'AMG LINE EXECUTIVE',
'vin': 'WDD1760432J768742',
'year': 2018}
2026-03-28 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV18%2520WXN%27 HTTP/1.1" 200 None
2026-03-28 22:03:16 [bca.uk] INFO: Saving data for WV18%20WXN: {'created_time': 1774735396.288996, 'last_price_update_time': 1774735396.289007, 'auction_closing_time': 1774951200.0}
2026-03-28 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WV18%2520WXN') HTTP/1.1" 204 0
2026-03-28 22:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 20c106fd-0836-5717-a42b-17b79fbe25e4 with identifier: LN07%20YUR
2026-03-28 22:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 20c106fd-0836-5717-a42b-17b79fbe25e4 with identifier: LN07%20YUR
2026-03-28 22:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 20c106fd-0836-5717-a42b-17b79fbe25e4 with identifier: LN07%20YUR to the API
2026-03-28 22:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189201/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20c106fd-0836-5717-a42b-17b79fbe25e4/20c106fd-0836-5717-a42b-17b79fbe25e4_expert_report_file_d469847c-94cc-4d7d-bba7-91d3346ee290.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LN07%20YUR-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '20c106fd-0836-5717-a42b-17b79fbe25e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LN07 YUR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LN07%20YUR&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'HONDA',
'model': 'CIVIC',
'odometer': 44068,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20c106fd-0836-5717-a42b-17b79fbe25e4/20c106fd-0836-5717-a42b-17b79fbe25e4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40283,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189116/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20c106fd-0836-5717-a42b-17b79fbe25e4/20c106fd-0836-5717-a42b-17b79fbe25e4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41307,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189122/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20c106fd-0836-5717-a42b-17b79fbe25e4/20c106fd-0836-5717-a42b-17b79fbe25e4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39866,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189128/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20c106fd-0836-5717-a42b-17b79fbe25e4/20c106fd-0836-5717-a42b-17b79fbe25e4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41070,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189137/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20c106fd-0836-5717-a42b-17b79fbe25e4/20c106fd-0836-5717-a42b-17b79fbe25e4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37432,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189142/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20c106fd-0836-5717-a42b-17b79fbe25e4/20c106fd-0836-5717-a42b-17b79fbe25e4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37647,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189150/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20c106fd-0836-5717-a42b-17b79fbe25e4/20c106fd-0836-5717-a42b-17b79fbe25e4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72293,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189161/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20c106fd-0836-5717-a42b-17b79fbe25e4/20c106fd-0836-5717-a42b-17b79fbe25e4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73110,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189174/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20c106fd-0836-5717-a42b-17b79fbe25e4/20c106fd-0836-5717-a42b-17b79fbe25e4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87163,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189189/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20c106fd-0836-5717-a42b-17b79fbe25e4/20c106fd-0836-5717-a42b-17b79fbe25e4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82740,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN07YUR/699189201/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'HONDA CIVIC 1.4 I-DSI SE I-SHIFT Hatchback',
'transmission': 'automatic',
'trim': 'I-DSI SE I-SHIFT',
'vin': 'SHHFK18407U008788',
'year': 2007}
2026-03-28 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN07%2520YUR%27 HTTP/1.1" 200 None
2026-03-28 22:03:16 [bca.uk] INFO: Saving data for LN07%20YUR: {'created_time': 1774735396.675031, 'last_price_update_time': 1774735396.675041, 'auction_closing_time': 1774951200.0}
2026-03-28 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LN07%2520YUR') HTTP/1.1" 204 0
2026-03-28 22:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 22:03:20 [bca.uk] INFO: Total items found: 100
2026-03-28 22:03:20 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded
2026-03-28 22:03:20 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 22:03:20 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: LY64%20DTU
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY64%2520DTU%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for LY64%20DTU: 1
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 782aa18e-a0c9-5c10-9106-d797127b5b2a with identifier: LY64%20DTU
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 782aa18e-a0c9-5c10-9106-d797127b5b2a
2026-03-28 22:03:20 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 22:03:20 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 22:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: DV14%20VNO
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV14%2520VNO%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for DV14%20VNO: 1
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef7b6294-9845-5eb5-8c1d-a1f98760f95e with identifier: DV14%20VNO
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ef7b6294-9845-5eb5-8c1d-a1f98760f95e
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: LM61%20DYD
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM61%2520DYD%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for LM61%20DYD: 1
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a59b1b92-68f6-5af6-ad88-8517ad8fae07 with identifier: LM61%20DYD
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a59b1b92-68f6-5af6-ad88-8517ad8fae07
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: YK11%20VUF
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK11%2520VUF%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for YK11%20VUF: 1
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3db8298e-1099-5db2-81d1-5141138419a2 with identifier: YK11%20VUF
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3db8298e-1099-5db2-81d1-5141138419a2
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: RK12%20WBW
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK12%2520WBW%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for RK12%20WBW: 1
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5057cc2-c58a-5e78-ab90-b97e6edb6582 with identifier: RK12%20WBW
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c5057cc2-c58a-5e78-ab90-b97e6edb6582
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: SL62%20VWY
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL62%2520VWY%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for SL62%20VWY: 1
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de1b1d7c-0af9-5140-a37d-505dea797715 with identifier: SL62%20VWY
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item de1b1d7c-0af9-5140-a37d-505dea797715
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: YE63%20EHG
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE63%2520EHG%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for YE63%20EHG: 0
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: CU63%20NGZ
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU63%2520NGZ%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for CU63%20NGZ: 0
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: CV55%20OPY
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV55%2520OPY%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for CV55%20OPY: 0
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: EJ63%20EXO
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ63%2520EXO%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for EJ63%20EXO: 1
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac2cb512-acf6-577f-a0f2-2fe21a625645 with identifier: EJ63%20EXO
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ac2cb512-acf6-577f-a0f2-2fe21a625645
2026-03-28 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DV14VNO/42811439?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=AJzvLw0izZRKfov%2BeUrE5UmVQvMJLyUVerbX0NanFzs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DV14%20VNO-GB>
2026-03-28 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK11VUF/42811158?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=l8QAasE0E%2FzQR5QTuF2laotj8hcmBnHx0u13mVzzHt8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YK11%20VUF-GB>
2026-03-28 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LY64DTU/42811373?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=nlvyE6o%2BjOSTCR6ZUHB9E%2BOFaaB84Hiq02HBTHcoq8g%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LY64%20DTU-GB>
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: EY14%20HKC
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY14%2520HKC%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for EY14%20HKC: 1
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4878bd96-ecc6-5172-b9f4-32abbb9ae940 with identifier: EY14%20HKC
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4878bd96-ecc6-5172-b9f4-32abbb9ae940
2026-03-28 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM61DYD/42811410?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=bDvqRxwLzIpEHYLUXTs40ur1RioMfasSNgu0Yug2sj4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM61%20DYD-GB>
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: HY10%20UJL
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY10%2520UJL%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for HY10%20UJL: 0
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: HY58%20NPG
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY58%2520NPG%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for HY58%20NPG: 1
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65 with identifier: HY58%20NPG
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: YF07%20CJE
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF07%2520CJE%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for YF07%20CJE: 1
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56b77897-c825-556b-ba96-284dc5a81572 with identifier: YF07%20CJE
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 56b77897-c825-556b-ba96-284dc5a81572
2026-03-28 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK12WBW/42811322?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=zrDQXpGJ59OXDPhU47QBcrd8BHKRhOWFkFPoLF1d7pk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RK12%20WBW-GB>
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: DS61%20FOF
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS61%2520FOF%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for DS61%20FOF: 1
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6 with identifier: DS61%20FOF
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: LT64%20JYY
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT64%2520JYY%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for LT64%20JYY: 1
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e23659de-a271-571f-ad29-745e3ce94452 with identifier: LT64%20JYY
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e23659de-a271-571f-ad29-745e3ce94452
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: MA61%20BFY
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA61%2520BFY%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for MA61%20BFY: 1
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a with identifier: MA61%20BFY
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: MT12%20LJZ
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT12%2520LJZ%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for MT12%20LJZ: 1
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2a7ebc8-3779-5484-8073-7a1c6fb87969 with identifier: MT12%20LJZ
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c2a7ebc8-3779-5484-8073-7a1c6fb87969
2026-03-28 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY14HKC/42811403?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=%2BYxeffQ4HY6floQPvp5Yr65sra111z9jxOTYy7mtf%2FU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EY14%20HKC-GB>
2026-03-28 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ63EXO/42810870?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=wLoUguMiGeygfSRIZDr4SROlj4YBVqcY7mSaCT7eFDc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EJ63%20EXO-GB>
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: YP11%20SXG
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP11%2520SXG%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for YP11%20SXG: 1
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13188273-241e-5122-a324-f170682054c3 with identifier: YP11%20SXG
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 13188273-241e-5122-a324-f170682054c3
2026-03-28 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY58NPG/42810706?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=m%2BjvjS4%2BeJxyPZhfktFet4Bo%2BpsamHOTjBnjcUc644A%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HY58%20NPG-GB>
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: B10%20PGJ
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27B10%2520PGJ%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for B10%20PGJ: 1
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 414fda2b-7a8b-5d29-ad43-b0e99521f4d6 with identifier: B10%20PGJ
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 414fda2b-7a8b-5d29-ad43-b0e99521f4d6
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: DK23%20XXL
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK23%2520XXL%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for DK23%20XXL: 1
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47f78646-9cef-5fc7-bd80-803ea7a167c9 with identifier: DK23%20XXL
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 47f78646-9cef-5fc7-bd80-803ea7a167c9
2026-03-28 22:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK11VUF/42811158?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=l8QAasE0E%2FzQR5QTuF2laotj8hcmBnHx0u13mVzzHt8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DV14VNO/42811439?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=AJzvLw0izZRKfov%2BeUrE5UmVQvMJLyUVerbX0NanFzs%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: DT69%20OUG
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT69%2520OUG%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for DT69%20OUG: 1
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1f5ee4c-4910-54f2-806e-fcee61f2b886 with identifier: DT69%20OUG
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b1f5ee4c-4910-54f2-806e-fcee61f2b886
2026-03-28 22:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM61DYD/42811410?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=bDvqRxwLzIpEHYLUXTs40ur1RioMfasSNgu0Yug2sj4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LY64DTU/42811373?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=nlvyE6o%2BjOSTCR6ZUHB9E%2BOFaaB84Hiq02HBTHcoq8g%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YF07CJE/42784457?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=oeSdikiuOHhGcviJbgYya0Q8LTDoZVmeFjwoPj3o2js%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YF07%20CJE-GB>
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: MF19%20KHM
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF19%2520KHM%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for MF19%20KHM: 1
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4ba462d-c70d-5156-b443-d7d5e76250e2 with identifier: MF19%20KHM
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a4ba462d-c70d-5156-b443-d7d5e76250e2
2026-03-28 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL62VWY/42810894?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=DJfJtw6KwyhBPhnAY9QJ%2FtOYYSvRRaWGTAGIk0DU%2F%2BA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SL62%20VWY-GB>
2026-03-28 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS61FOF/42810605?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=CkwC%2BSn%2FHa5pvfLJnieo5YJn96MqgCZnNQ9bJG2t2ik%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DS61%20FOF-GB>
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: YT69%20LRX
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT69%2520LRX%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for YT69%20LRX: 1
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01670b58-a63c-5bbc-b764-269e297cd699 with identifier: YT69%20LRX
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 01670b58-a63c-5bbc-b764-269e297cd699
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: LY69%20GMG
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY69%2520GMG%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for LY69%20GMG: 1
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c46e0b3-fe77-5881-ab60-346741749047 with identifier: LY69%20GMG
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4c46e0b3-fe77-5881-ab60-346741749047
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: DX68%20ZHP
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX68%2520ZHP%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for DX68%20ZHP: 1
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 423a16e7-0aa7-505e-9fca-30afcd20041f with identifier: DX68%20ZHP
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 423a16e7-0aa7-505e-9fca-30afcd20041f
2026-03-28 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT64JYY/42807297?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=H09NJ6PkIwPyWfxNOYCddSHeDmQxr4Xr%2FaIklrKjYWY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT64%20JYY-GB>
2026-03-28 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA61BFY/42810775?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=tQax5P6adI54twzyoqdok6iIUxSzHDcLDwBb4%2BMoMFw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MA61%20BFY-GB>
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: GP19%20AEE
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GP19%2520AEE%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for GP19%20AEE: 1
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb674af7-fcd3-5648-bd02-bf57f2b6d8c9 with identifier: GP19%20AEE
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cb674af7-fcd3-5648-bd02-bf57f2b6d8c9
2026-03-28 22:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474a8490>
2026-03-28 22:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db8298e-1099-5db2-81d1-5141138419a2/3db8298e-1099-5db2-81d1-5141138419a2_expert_report_file_febde9ad-e343-44ee-891c-3c76d3118f59.pdf HTTP/1.1" 201 0
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3db8298e-1099-5db2-81d1-5141138419a2
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3db8298e-1099-5db2-81d1-5141138419a2, skipping ID generation
2026-03-28 22:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3db8298e-1099-5db2-81d1-5141138419a2
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYK11VUF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YK11VUF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543dbb50>
2026-03-28 22:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b6294-9845-5eb5-8c1d-a1f98760f95e/ef7b6294-9845-5eb5-8c1d-a1f98760f95e_expert_report_file_208a02d9-db28-4753-888b-245dc2600b33.pdf HTTP/1.1" 201 0
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ef7b6294-9845-5eb5-8c1d-a1f98760f95e
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef7b6294-9845-5eb5-8c1d-a1f98760f95e, skipping ID generation
2026-03-28 22:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ef7b6294-9845-5eb5-8c1d-a1f98760f95e
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDV14VNO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DV14VNO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT12LJZ/42809616?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=ZCqeg%2BtAkN7zfvr8I5qdCyvEoyksA32%2Fdc9lEzPe%2BbI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT12%20LJZ-GB>
2026-03-28 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP11SXG/42810463?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=qkkbLatUiKU%2BsinzgsPhauDtkraDtbwZc7leOW58DOU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YP11%20SXG-GB>
2026-03-28 22:03:20 [bca.uk] INFO: Found listing with ID: PK20%20LVZ
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK20%2520LVZ%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [bca.uk] INFO: Scrape type for PK20%20LVZ: 1
2026-03-28 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 672f5a9d-28c4-530d-bba8-ceb046fc83e2 with identifier: PK20%20LVZ
2026-03-28 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 672f5a9d-28c4-530d-bba8-ceb046fc83e2
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147108%27 HTTP/1.1" 200 None
2026-03-28 22:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147108 not downloaded yet
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143151%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143151 not downloaded yet
2026-03-28 22:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fc4750>
2026-03-28 22:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a59b1b92-68f6-5af6-ad88-8517ad8fae07/a59b1b92-68f6-5af6-ad88-8517ad8fae07_expert_report_file_356850cf-139b-4931-8a7a-b4e8a4fb2760.pdf HTTP/1.1" 201 0
2026-03-28 22:03:21 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a59b1b92-68f6-5af6-ad88-8517ad8fae07
2026-03-28 22:03:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a59b1b92-68f6-5af6-ad88-8517ad8fae07, skipping ID generation
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a59b1b92-68f6-5af6-ad88-8517ad8fae07
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLM61DYD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LM61DYD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a62ed0>
2026-03-28 22:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_782aa18e-a0c9-5c10-9106-d797127b5b2a/782aa18e-a0c9-5c10-9106-d797127b5b2a_expert_report_file_43477cc5-7f0c-4e37-a1ab-d82dbb508493.pdf HTTP/1.1" 201 0
2026-03-28 22:03:21 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 782aa18e-a0c9-5c10-9106-d797127b5b2a
2026-03-28 22:03:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 782aa18e-a0c9-5c10-9106-d797127b5b2a, skipping ID generation
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 782aa18e-a0c9-5c10-9106-d797127b5b2a
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLY64DTU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LY64DTU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:21 [bca.uk] INFO: Found listing with ID: YT70%20LPK
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT70%2520LPK%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [bca.uk] INFO: Scrape type for YT70%20LPK: 1
2026-03-28 22:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c56c1109-0372-5f69-97bc-e780b3d8ac65 with identifier: YT70%20LPK
2026-03-28 22:03:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c56c1109-0372-5f69-97bc-e780b3d8ac65
2026-03-28 22:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK12WBW/42811322?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=zrDQXpGJ59OXDPhU47QBcrd8BHKRhOWFkFPoLF1d7pk%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY14HKC/42811403?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=%2BYxeffQ4HY6floQPvp5Yr65sra111z9jxOTYy7mtf%2FU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY58NPG/42810706?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=m%2BjvjS4%2BeJxyPZhfktFet4Bo%2BpsamHOTjBnjcUc644A%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/B10PGJ/42811203?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=EuD%2Bp1HvVP2JXHqKU%2B8jitx6XlktdJcPsUn2sF2sJ6k%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=B10%20PGJ-GB>
2026-03-28 22:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK23XXL/42810961?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=HIraPhBD5waa9seHUB8yTzip4V%2BkelIT5vdZTBzO1L4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DK23%20XXL-GB>
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147113%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147113 not downloaded yet
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143166%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143166 not downloaded yet
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145283%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145283 not downloaded yet
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145540%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145540 not downloaded yet
2026-03-28 22:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ63EXO/42810870?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=wLoUguMiGeygfSRIZDr4SROlj4YBVqcY7mSaCT7eFDc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:21 [bca.uk] INFO: Found listing with ID: DT18%20GME
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT18%2520GME%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [bca.uk] INFO: Scrape type for DT18%20GME: 1
2026-03-28 22:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfa1c404-6451-54cd-8c9e-13c4279fa00e with identifier: DT18%20GME
2026-03-28 22:03:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item bfa1c404-6451-54cd-8c9e-13c4279fa00e
2026-03-28 22:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT69OUG/42810791?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=Rkj%2FxkM1%2BIIgVTIeJOHfQd43I%2FeKECKsCGXnmowEFQk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DT69%20OUG-GB>
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147122%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147122 not downloaded yet
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143172%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143172 not downloaded yet
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145293%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145293 not downloaded yet
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145542%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145542 not downloaded yet
2026-03-28 22:03:21 [bca.uk] INFO: Found listing with ID: MM67%20RNV
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM67%2520RNV%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [bca.uk] INFO: Scrape type for MM67%20RNV: 1
2026-03-28 22:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2aaf8e0-6656-5ea0-a55c-8214d714b81c with identifier: MM67%20RNV
2026-03-28 22:03:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a2aaf8e0-6656-5ea0-a55c-8214d714b81c
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147129%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147129 not downloaded yet
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143186%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143186 not downloaded yet
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145298%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145298 not downloaded yet
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145548%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145548 not downloaded yet
2026-03-28 22:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF19KHM/42806820?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=sr8AUvzfzyG0aLirfPlv3wY7sqotPL2UPVrzrL33HII%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF19%20KHM-GB>
2026-03-28 22:03:21 [bca.uk] INFO: Found listing with ID: AE58%20YDD
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE58%2520YDD%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [bca.uk] INFO: Scrape type for AE58%20YDD: 1
2026-03-28 22:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8291a8f-ab36-539f-839d-bb424053b7c9 with identifier: AE58%20YDD
2026-03-28 22:03:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a8291a8f-ab36-539f-839d-bb424053b7c9
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147135%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147135 not downloaded yet
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143201%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143201 not downloaded yet
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145309%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145309 not downloaded yet
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145552%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145552 not downloaded yet
2026-03-28 22:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477e5110>
2026-03-28 22:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5057cc2-c58a-5e78-ab90-b97e6edb6582/c5057cc2-c58a-5e78-ab90-b97e6edb6582_expert_report_file_3f97b53c-6504-44bd-96e8-397bf57e0ce7.pdf HTTP/1.1" 201 0
2026-03-28 22:03:21 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c5057cc2-c58a-5e78-ab90-b97e6edb6582
2026-03-28 22:03:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5057cc2-c58a-5e78-ab90-b97e6edb6582, skipping ID generation
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5057cc2-c58a-5e78-ab90-b97e6edb6582
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRK12WBW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RK12WBW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a60350>
2026-03-28 22:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4878bd96-ecc6-5172-b9f4-32abbb9ae940/4878bd96-ecc6-5172-b9f4-32abbb9ae940_expert_report_file_cb991dfc-6fc9-43c0-96ff-9e2a0a19feca.pdf HTTP/1.1" 201 0
2026-03-28 22:03:21 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4878bd96-ecc6-5172-b9f4-32abbb9ae940
2026-03-28 22:03:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4878bd96-ecc6-5172-b9f4-32abbb9ae940, skipping ID generation
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4878bd96-ecc6-5172-b9f4-32abbb9ae940
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEY14HKC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EY14HKC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547149fd0>
2026-03-28 22:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96f4e7fc-b83e-5062-87d7-e0a26a3eaa65/96f4e7fc-b83e-5062-87d7-e0a26a3eaa65_expert_report_file_53a8077b-b695-478e-a52d-0bce4948ff90.pdf HTTP/1.1" 201 0
2026-03-28 22:03:21 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65
2026-03-28 22:03:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65, skipping ID generation
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHY58NPG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HY58NPG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472c1bd0>
2026-03-28 22:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac2cb512-acf6-577f-a0f2-2fe21a625645/ac2cb512-acf6-577f-a0f2-2fe21a625645_expert_report_file_976cecb9-9151-468e-9693-ae3ad804f9d3.pdf HTTP/1.1" 201 0
2026-03-28 22:03:21 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ac2cb512-acf6-577f-a0f2-2fe21a625645
2026-03-28 22:03:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac2cb512-acf6-577f-a0f2-2fe21a625645, skipping ID generation
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac2cb512-acf6-577f-a0f2-2fe21a625645
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEJ63EXO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EJ63EXO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YF07CJE/42784457?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=oeSdikiuOHhGcviJbgYya0Q8LTDoZVmeFjwoPj3o2js%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL62VWY/42810894?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=DJfJtw6KwyhBPhnAY9QJ%2FtOYYSvRRaWGTAGIk0DU%2F%2BA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA61BFY/42810775?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=tQax5P6adI54twzyoqdok6iIUxSzHDcLDwBb4%2BMoMFw%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT64JYY/42807297?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=H09NJ6PkIwPyWfxNOYCddSHeDmQxr4Xr%2FaIklrKjYWY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:21 [bca.uk] INFO: Found listing with ID: KK07%20YAO
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KK07%2520YAO%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [bca.uk] INFO: Scrape type for KK07%20YAO: 1
2026-03-28 22:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5f9f14f-130c-5d1a-99c0-15c1239aa436 with identifier: KK07%20YAO
2026-03-28 22:03:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d5f9f14f-130c-5d1a-99c0-15c1239aa436
2026-03-28 22:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS61FOF/42810605?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=CkwC%2BSn%2FHa5pvfLJnieo5YJn96MqgCZnNQ9bJG2t2ik%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT12LJZ/42809616?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=ZCqeg%2BtAkN7zfvr8I5qdCyvEoyksA32%2Fdc9lEzPe%2BbI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147148%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147148 not downloaded yet
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143221%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143221 not downloaded yet
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145316%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145316 not downloaded yet
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145558%27 HTTP/1.1" 200 None
2026-03-28 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145558 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146268%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146268 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143452%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143452 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976336%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976336 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143325%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143325 not downloaded yet
2026-03-28 22:03:22 [bca.uk] INFO: Found listing with ID: M5%20SNV
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M5%2520SNV%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [bca.uk] INFO: Scrape type for M5%20SNV: 0
2026-03-28 22:03:22 [bca.uk] INFO: Found listing with ID: VF15%20KKY
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VF15%2520KKY%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [bca.uk] INFO: Scrape type for VF15%20KKY: 1
2026-03-28 22:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3a29049-d0cb-5ad0-80d6-fe24d9cb8763 with identifier: VF15%20KKY
2026-03-28 22:03:22 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a3a29049-d0cb-5ad0-80d6-fe24d9cb8763
2026-03-28 22:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP11SXG/42810463?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=qkkbLatUiKU%2BsinzgsPhauDtkraDtbwZc7leOW58DOU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147158%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147158 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143238%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143238 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145325%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145325 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145565%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145565 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146276%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146276 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143458%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143458 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976355%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976355 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143332%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143332 not downloaded yet
2026-03-28 22:03:22 [bca.uk] INFO: Found listing with ID: WN16%20MXA
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN16%2520MXA%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [bca.uk] INFO: Scrape type for WN16%20MXA: 1
2026-03-28 22:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4011303-c936-5ad4-909d-9af520e69082 with identifier: WN16%20MXA
2026-03-28 22:03:22 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c4011303-c936-5ad4-909d-9af520e69082
2026-03-28 22:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143151/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143151>
2026-03-28 22:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145274/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LM61DYD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145540/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145540>
2026-03-28 22:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145534/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LY64DTU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147174%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147174 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143255%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143255 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145335%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145335 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145575%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145575 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146285%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146285 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143465%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143465 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976368%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976368 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143336%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143336 not downloaded yet
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547449c10>
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b77897-c825-556b-ba96-284dc5a81572/56b77897-c825-556b-ba96-284dc5a81572_expert_report_file_84bd16d0-4df1-4ce7-a6c9-eb1aa76729c4.pdf HTTP/1.1" 201 0
2026-03-28 22:03:22 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 56b77897-c825-556b-ba96-284dc5a81572
2026-03-28 22:03:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 56b77897-c825-556b-ba96-284dc5a81572, skipping ID generation
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 56b77897-c825-556b-ba96-284dc5a81572
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYF07CJE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YF07CJE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554abf990>
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de1b1d7c-0af9-5140-a37d-505dea797715/de1b1d7c-0af9-5140-a37d-505dea797715_expert_report_file_758170ab-e171-4c58-aa9e-bbcdceec9b5b.pdf HTTP/1.1" 201 0
2026-03-28 22:03:22 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item de1b1d7c-0af9-5140-a37d-505dea797715
2026-03-28 22:03:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de1b1d7c-0af9-5140-a37d-505dea797715, skipping ID generation
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item de1b1d7c-0af9-5140-a37d-505dea797715
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSL62VWY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SL62VWY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554acd510>
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4baa05ed-fc6d-5ddf-8f83-9a745e89a05a/4baa05ed-fc6d-5ddf-8f83-9a745e89a05a_expert_report_file_46ae7f81-d4f7-420b-9619-054acef293e3.pdf HTTP/1.1" 201 0
2026-03-28 22:03:22 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a
2026-03-28 22:03:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a, skipping ID generation
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMA61BFY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MA61BFY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554abe410>
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e23659de-a271-571f-ad29-745e3ce94452/e23659de-a271-571f-ad29-745e3ce94452_expert_report_file_4d71fd10-de23-495f-a464-a1b2ba4a8582.pdf HTTP/1.1" 201 0
2026-03-28 22:03:22 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e23659de-a271-571f-ad29-745e3ce94452
2026-03-28 22:03:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e23659de-a271-571f-ad29-745e3ce94452, skipping ID generation
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e23659de-a271-571f-ad29-745e3ce94452
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLT64JYY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LT64JYY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554ad8e50>
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c3dd07d-5304-5ac0-80dc-e30cb298b7d6/5c3dd07d-5304-5ac0-80dc-e30cb298b7d6_expert_report_file_917fb746-68f4-44f0-81eb-6068400ee615.pdf HTTP/1.1" 201 0
2026-03-28 22:03:22 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6
2026-03-28 22:03:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6, skipping ID generation
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDS61FOF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DS61FOF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554ac0b90>
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2a7ebc8-3779-5484-8073-7a1c6fb87969/c2a7ebc8-3779-5484-8073-7a1c6fb87969_expert_report_file_4f4ff5c8-ab44-4553-8622-ec44cc3ba915.pdf HTTP/1.1" 201 0
2026-03-28 22:03:22 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c2a7ebc8-3779-5484-8073-7a1c6fb87969
2026-03-28 22:03:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2a7ebc8-3779-5484-8073-7a1c6fb87969, skipping ID generation
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c2a7ebc8-3779-5484-8073-7a1c6fb87969
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMT12LJZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MT12LJZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:22 [bca.uk] INFO: Found listing with ID: GH15%20HTD
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GH15%2520HTD%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [bca.uk] INFO: Scrape type for GH15%20HTD: 0
2026-03-28 22:03:22 [bca.uk] INFO: Found listing with ID: LT66%20HCJ
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT66%2520HCJ%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [bca.uk] INFO: Scrape type for LT66%20HCJ: 1
2026-03-28 22:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c346eec4-40ba-53d7-bb4d-ada017b4776d with identifier: LT66%20HCJ
2026-03-28 22:03:22 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c346eec4-40ba-53d7-bb4d-ada017b4776d
2026-03-28 22:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT69OUG/42810791?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=Rkj%2FxkM1%2BIIgVTIeJOHfQd43I%2FeKECKsCGXnmowEFQk%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147190%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147190 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143271%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143271 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145344%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145344 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145581%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145581 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146292%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146292 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143476%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143476 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976387%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976387 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143345%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143345 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253665%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253665 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146513%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146513 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015685%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015685 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251842%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251842 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994354%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994354 not downloaded yet
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252295%27 HTTP/1.1" 200 None
2026-03-28 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252295 not downloaded yet
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554adf090>
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13188273-241e-5122-a324-f170682054c3/13188273-241e-5122-a324-f170682054c3_expert_report_file_46e10367-830c-4fcc-88b0-f523a29b8bcc.pdf HTTP/1.1" 201 0
2026-03-28 22:03:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 13188273-241e-5122-a324-f170682054c3
2026-03-28 22:03:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13188273-241e-5122-a324-f170682054c3, skipping ID generation
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 13188273-241e-5122-a324-f170682054c3
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYP11SXG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YP11SXG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/B10PGJ/42811203?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=EuD%2Bp1HvVP2JXHqKU%2B8jitx6XlktdJcPsUn2sF2sJ6k%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:23 [bca.uk] INFO: Found listing with ID: SJ16%20SYV
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ16%2520SYV%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [bca.uk] INFO: Scrape type for SJ16%20SYV: 1
2026-03-28 22:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15f02d0f-7d6c-5628-aec2-1916af416587 with identifier: SJ16%20SYV
2026-03-28 22:03:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 15f02d0f-7d6c-5628-aec2-1916af416587
2026-03-28 22:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146260/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RK12WBW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976330/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HY58NPG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143445/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EY14HKC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143318/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EJ63EXO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145354%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145354 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145592%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145592 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146298%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146298 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143481%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143481 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976406%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976406 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143353%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143353 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253672%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253672 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146523%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146523 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015693%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015693 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251849%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251849 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994369%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994369 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252304%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252304 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253881%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253881 not downloaded yet
2026-03-28 22:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 22:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF19KHM/42806820?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=sr8AUvzfzyG0aLirfPlv3wY7sqotPL2UPVrzrL33HII%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:23 [bca.uk] INFO: Found listing with ID: BU67%20KTN
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU67%2520KTN%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [bca.uk] INFO: Scrape type for BU67%20KTN: 1
2026-03-28 22:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a8934b9-4045-555c-b8d3-812b6cc9a1e0 with identifier: BU67%20KTN
2026-03-28 22:03:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1a8934b9-4045-555c-b8d3-812b6cc9a1e0
2026-03-28 22:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145552/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145552>
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146306%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146306 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143490%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143490 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976442%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976442 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143370%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143370 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253681%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253681 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146529%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146529 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015697%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015697 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251857%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251857 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994383%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994383 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252310%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252310 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253885%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253885 not downloaded yet
2026-03-28 22:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54776ea90>
2026-03-28 22:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1f5ee4c-4910-54f2-806e-fcee61f2b886/b1f5ee4c-4910-54f2-806e-fcee61f2b886_expert_report_file_72511c2a-952c-4ddc-95fa-c42d782d1d5a.pdf HTTP/1.1" 201 0
2026-03-28 22:03:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b1f5ee4c-4910-54f2-806e-fcee61f2b886
2026-03-28 22:03:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1f5ee4c-4910-54f2-806e-fcee61f2b886, skipping ID generation
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b1f5ee4c-4910-54f2-806e-fcee61f2b886
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDT69OUG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DT69OUG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:23 [bca.uk] INFO: Found listing with ID: WM66%20HPY
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM66%2520HPY%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [bca.uk] INFO: Scrape type for WM66%20HPY: 1
2026-03-28 22:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe with identifier: WM66%20HPY
2026-03-28 22:03:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe
2026-03-28 22:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145534/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LY64DTU/42811373?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=nlvyE6o%2BjOSTCR6ZUHB9E%2BOFaaB84Hiq02HBTHcoq8g%3D)
2026-03-28 22:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145274/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM61DYD/42811410?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=bDvqRxwLzIpEHYLUXTs40ur1RioMfasSNgu0Yug2sj4%3D)
2026-03-28 22:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145540/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LY64DTU/42811373?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=nlvyE6o%2BjOSTCR6ZUHB9E%2BOFaaB84Hiq02HBTHcoq8g%3D)
2026-03-28 22:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145309/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145309>
2026-03-28 22:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143325/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143325>
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146324%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146324 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143507%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143507 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976472%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976472 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143387%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143387 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253692%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253692 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146536%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146536 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015705%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015705 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251864%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251864 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994396%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994396 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252318%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252318 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253898%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253898 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023352%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023352 not downloaded yet
2026-03-28 22:03:23 [bca.uk] INFO: Found listing with ID: SV13%20XGW
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV13%2520XGW%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [bca.uk] INFO: Scrape type for SV13%20XGW: 1
2026-03-28 22:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4e4f996-7647-5f09-9c47-a666d700954d with identifier: SV13%20XGW
2026-03-28 22:03:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e4e4f996-7647-5f09-9c47-a666d700954d
2026-03-28 22:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547789650>
2026-03-28 22:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414fda2b-7a8b-5d29-ad43-b0e99521f4d6/414fda2b-7a8b-5d29-ad43-b0e99521f4d6_expert_report_file_2b2e7990-5f6e-4969-bbf9-870d1bcf9958.pdf HTTP/1.1" 201 0
2026-03-28 22:03:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 414fda2b-7a8b-5d29-ad43-b0e99521f4d6
2026-03-28 22:03:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 414fda2b-7a8b-5d29-ad43-b0e99521f4d6, skipping ID generation
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 414fda2b-7a8b-5d29-ad43-b0e99521f4d6
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DB10PGJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=B10PGJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:23 [bca.uk] INFO: Total items found: 100
2026-03-28 22:03:23 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded
2026-03-28 22:03:23 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 22:03:23 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 22:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477d32d0>
2026-03-28 22:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ba462d-c70d-5156-b443-d7d5e76250e2/a4ba462d-c70d-5156-b443-d7d5e76250e2_expert_report_file_69e7a85c-745b-4982-9e83-04129b7b9155.pdf HTTP/1.1" 201 0
2026-03-28 22:03:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a4ba462d-c70d-5156-b443-d7d5e76250e2
2026-03-28 22:03:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a4ba462d-c70d-5156-b443-d7d5e76250e2, skipping ID generation
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a4ba462d-c70d-5156-b443-d7d5e76250e2
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMF19KHM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MF19KHM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252289/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MT12LJZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143151/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DV14VNO/42811439?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=AJzvLw0izZRKfov%2BeUrE5UmVQvMJLyUVerbX0NanFzs%3D)
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146339%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146339 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143527%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143527 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976491%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976491 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143401%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143401 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253698%27 HTTP/1.1" 200 None
2026-03-28 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253698 not downloaded yet
2026-03-28 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146542%27 HTTP/1.1" 200 None
2026-03-28 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146542 not downloaded yet
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015712%27 HTTP/1.1" 200 None
2026-03-28 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015712 not downloaded yet
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251871%27 HTTP/1.1" 200 None
2026-03-28 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251871 not downloaded yet
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994412%27 HTTP/1.1" 200 None
2026-03-28 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994412 not downloaded yet
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252326%27 HTTP/1.1" 200 None
2026-03-28 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252326 not downloaded yet
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253902%27 HTTP/1.1" 200 None
2026-03-28 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253902 not downloaded yet
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023358%27 HTTP/1.1" 200 None
2026-03-28 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023358 not downloaded yet
2026-03-28 22:03:24 [bca.uk] INFO: Found listing with ID: AE15%20URC
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE15%2520URC%27 HTTP/1.1" 200 None
2026-03-28 22:03:24 [bca.uk] INFO: Scrape type for AE15%20URC: 1
2026-03-28 22:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7208558-825f-54e8-9356-5e2af34b2242 with identifier: AE15%20URC
2026-03-28 22:03:24 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d7208558-825f-54e8-9356-5e2af34b2242
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110813%27 HTTP/1.1" 200 None
2026-03-28 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110813 not downloaded yet
2026-03-28 22:03:24 [bca.uk] INFO: Found listing with ID: GJ68%20DWO
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ68%2520DWO%27 HTTP/1.1" 200 None
2026-03-28 22:03:24 [bca.uk] INFO: Scrape type for GJ68%20DWO: 0
2026-03-28 22:03:24 [bca.uk] INFO: Found listing with ID: SB64%20PPZ
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB64%2520PPZ%27 HTTP/1.1" 200 None
2026-03-28 22:03:24 [bca.uk] INFO: Scrape type for SB64%20PPZ: 0
2026-03-28 22:03:24 [bca.uk] INFO: Found listing with ID: SF15%20TPC
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF15%2520TPC%27 HTTP/1.1" 200 None
2026-03-28 22:03:24 [bca.uk] INFO: Scrape type for SF15%20TPC: 0
2026-03-28 22:03:24 [bca.uk] INFO: Found listing with ID: SK67%20UUF
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK67%2520UUF%27 HTTP/1.1" 200 None
2026-03-28 22:03:24 [bca.uk] INFO: Scrape type for SK67%20UUF: 0
2026-03-28 22:03:24 [bca.uk] INFO: Found listing with ID: SM65%20WDL
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM65%2520WDL%27 HTTP/1.1" 200 None
2026-03-28 22:03:24 [bca.uk] INFO: Scrape type for SM65%20WDL: 2
2026-03-28 22:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 876bf807-40e7-5fcc-95fc-54f8c76e1e78 with identifier: SM65%20WDL
2026-03-28 22:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 876bf807-40e7-5fcc-95fc-54f8c76e1e78 with scrape type 2
2026-03-28 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 876bf807-40e7-5fcc-95fc-54f8c76e1e78 with scrape type 2
2026-03-28 22:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 876bf807-40e7-5fcc-95fc-54f8c76e1e78, identifier: SM65%20WDL
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252101%27 HTTP/1.1" 200 None
2026-03-28 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252101 not downloaded yet
2026-03-28 22:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5545afe90>
2026-03-28 22:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_782aa18e-a0c9-5c10-9106-d797127b5b2a/782aa18e-a0c9-5c10-9106-d797127b5b2a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLY64DTU%252F699145534%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145534/600 saved to cache
2026-03-28 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 782aa18e-a0c9-5c10-9106-d797127b5b2a
2026-03-28 22:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547453250>
2026-03-28 22:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a59b1b92-68f6-5af6-ad88-8517ad8fae07/a59b1b92-68f6-5af6-ad88-8517ad8fae07_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM61DYD%252F699145274%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145274/600 saved to cache
2026-03-28 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a59b1b92-68f6-5af6-ad88-8517ad8fae07
2026-03-28 22:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54744f950>
2026-03-28 22:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_782aa18e-a0c9-5c10-9106-d797127b5b2a/782aa18e-a0c9-5c10-9106-d797127b5b2a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLY64DTU%252F699145540%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145540/600 saved to cache
2026-03-28 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 782aa18e-a0c9-5c10-9106-d797127b5b2a
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146354%27 HTTP/1.1" 200 None
2026-03-28 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146354 not downloaded yet
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143551%27 HTTP/1.1" 200 None
2026-03-28 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143551 not downloaded yet
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976518%27 HTTP/1.1" 200 None
2026-03-28 22:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976518 not downloaded yet
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143413%27 HTTP/1.1" 200 None
2026-03-28 22:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143413 not downloaded yet
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253711%27 HTTP/1.1" 200 None
2026-03-28 22:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253711 not downloaded yet
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146547%27 HTTP/1.1" 200 None
2026-03-28 22:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146547 not downloaded yet
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015743%27 HTTP/1.1" 200 None
2026-03-28 22:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015743 not downloaded yet
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251884%27 HTTP/1.1" 200 None
2026-03-28 22:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251884 not downloaded yet
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994443%27 HTTP/1.1" 200 None
2026-03-28 22:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994443 not downloaded yet
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252339%27 HTTP/1.1" 200 None
2026-03-28 22:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252339 not downloaded yet
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253913%27 HTTP/1.1" 200 None
2026-03-28 22:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253913 not downloaded yet
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023373%27 HTTP/1.1" 200 None
2026-03-28 22:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023373 not downloaded yet
2026-03-28 22:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 876bf807-40e7-5fcc-95fc-54f8c76e1e78 with identifier: SM65%20WDL
2026-03-28 22:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 876bf807-40e7-5fcc-95fc-54f8c76e1e78 with identifier: SM65%20WDL
2026-03-28 22:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 876bf807-40e7-5fcc-95fc-54f8c76e1e78 with identifier: SM65%20WDL to the API
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SM65%20WDL-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '876bf807-40e7-5fcc-95fc-54f8c76e1e78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SM65 WDL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SM65%20WDL&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'FORD',
'model': 'GRAND C-MAX',
'odometer': 107710,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FORD GRAND C-MAX 1.5 TDCI 120 TITANIUM MPV',
'transmission': 'manual',
'trim': 'TDCI 120 TITANIUM',
'vin': 'WF0WXXGCEWFT53809',
'year': 2016}
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM65%2520WDL%27 HTTP/1.1" 200 None
2026-03-28 22:03:25 [bca.uk] INFO: Saving data for SM65%20WDL: {'auction_closing_time': 1774778400.0, 'created_time': 1774620770.013383, 'last_price_update_time': 1774735405.583837}
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SM65%2520WDL') HTTP/1.1" 204 0
2026-03-28 22:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK23XXL/42810961?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=HIraPhBD5waa9seHUB8yTzip4V%2BkelIT5vdZTBzO1L4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:25 [bca.uk] INFO: Found listing with ID: KJ19%20ZRG
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ19%2520ZRG%27 HTTP/1.1" 200 None
2026-03-28 22:03:25 [bca.uk] INFO: Scrape type for KJ19%20ZRG: 1
2026-03-28 22:03:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e094926b-3a83-59ef-883a-320713cabb3c with identifier: KJ19%20ZRG
2026-03-28 22:03:25 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e094926b-3a83-59ef-883a-320713cabb3c
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110820%27 HTTP/1.1" 200 None
2026-03-28 22:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110820 not downloaded yet
2026-03-28 22:03:25 [bca.uk] INFO: Found listing with ID: DG16%20ZDM
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG16%2520ZDM%27 HTTP/1.1" 200 None
2026-03-28 22:03:25 [bca.uk] INFO: Scrape type for DG16%20ZDM: 0
2026-03-28 22:03:25 [bca.uk] INFO: Found listing with ID: DL14%20OCO
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL14%2520OCO%27 HTTP/1.1" 200 None
2026-03-28 22:03:25 [bca.uk] INFO: Scrape type for DL14%20OCO: 2
2026-03-28 22:03:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cbda9c6-fd91-5ee4-818a-9a09794168a0 with identifier: DL14%20OCO
2026-03-28 22:03:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cbda9c6-fd91-5ee4-818a-9a09794168a0 with scrape type 2
2026-03-28 22:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cbda9c6-fd91-5ee4-818a-9a09794168a0 with scrape type 2
2026-03-28 22:03:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3cbda9c6-fd91-5ee4-818a-9a09794168a0, identifier: DL14%20OCO
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252107%27 HTTP/1.1" 200 None
2026-03-28 22:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252107 not downloaded yet
2026-03-28 22:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547686c10>
2026-03-28 22:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b6294-9845-5eb5-8c1d-a1f98760f95e/ef7b6294-9845-5eb5-8c1d-a1f98760f95e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDV14VNO%252F699143151%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143151/600 saved to cache
2026-03-28 22:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ef7b6294-9845-5eb5-8c1d-a1f98760f95e
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253726%27 HTTP/1.1" 200 None
2026-03-28 22:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253726 not downloaded yet
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146556%27 HTTP/1.1" 200 None
2026-03-28 22:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146556 not downloaded yet
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015770%27 HTTP/1.1" 200 None
2026-03-28 22:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015770 not downloaded yet
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251899%27 HTTP/1.1" 200 None
2026-03-28 22:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251899 not downloaded yet
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994470%27 HTTP/1.1" 200 None
2026-03-28 22:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994470 not downloaded yet
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252353%27 HTTP/1.1" 200 None
2026-03-28 22:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252353 not downloaded yet
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253924%27 HTTP/1.1" 200 None
2026-03-28 22:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253924 not downloaded yet
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023391%27 HTTP/1.1" 200 None
2026-03-28 22:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023391 not downloaded yet
2026-03-28 22:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3cbda9c6-fd91-5ee4-818a-9a09794168a0 with identifier: DL14%20OCO
2026-03-28 22:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3cbda9c6-fd91-5ee4-818a-9a09794168a0 with identifier: DL14%20OCO
2026-03-28 22:03:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3cbda9c6-fd91-5ee4-818a-9a09794168a0 with identifier: DL14%20OCO to the API
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DL14%20OCO-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3cbda9c6-fd91-5ee4-818a-9a09794168a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DL14 OCO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DL14%20OCO&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 67865,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 VVT S Hatchback',
'transmission': 'manual',
'trim': 'VVT S',
'vin': 'W0L0SDL68E4240685',
'year': 2014}
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL14%2520OCO%27 HTTP/1.1" 200 None
2026-03-28 22:03:26 [bca.uk] INFO: Saving data for DL14%20OCO: {'auction_closing_time': 1774778400.0, 'created_time': 1774621417.095292, 'last_price_update_time': 1774735406.477004}
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DL14%2520OCO') HTTP/1.1" 204 0
2026-03-28 22:03:26 [bca.uk] INFO: Found listing with ID: KN68%20YYB
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN68%2520YYB%27 HTTP/1.1" 200 None
2026-03-28 22:03:26 [bca.uk] INFO: Scrape type for KN68%20YYB: 1
2026-03-28 22:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37980901-da86-559d-83e6-c8f73f7f2265 with identifier: KN68%20YYB
2026-03-28 22:03:26 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 37980901-da86-559d-83e6-c8f73f7f2265
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110834%27 HTTP/1.1" 200 None
2026-03-28 22:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110834 not downloaded yet
2026-03-28 22:03:26 [bca.uk] INFO: Found listing with ID: MT67%20JTY
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT67%2520JTY%27 HTTP/1.1" 200 None
2026-03-28 22:03:26 [bca.uk] INFO: Scrape type for MT67%20JTY: 0
2026-03-28 22:03:26 [bca.uk] INFO: Found listing with ID: MX66%20VHW
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX66%2520VHW%27 HTTP/1.1" 200 None
2026-03-28 22:03:26 [bca.uk] INFO: Scrape type for MX66%20VHW: 2
2026-03-28 22:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dd2298d-ebbc-515d-9de4-f7cd13970974 with identifier: MX66%20VHW
2026-03-28 22:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dd2298d-ebbc-515d-9de4-f7cd13970974 with scrape type 2
2026-03-28 22:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dd2298d-ebbc-515d-9de4-f7cd13970974 with scrape type 2
2026-03-28 22:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9dd2298d-ebbc-515d-9de4-f7cd13970974, identifier: MX66%20VHW
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252112%27 HTTP/1.1" 200 None
2026-03-28 22:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252112 not downloaded yet
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253742%27 HTTP/1.1" 200 None
2026-03-28 22:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253742 not downloaded yet
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146563%27 HTTP/1.1" 200 None
2026-03-28 22:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146563 not downloaded yet
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015804%27 HTTP/1.1" 200 None
2026-03-28 22:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015804 not downloaded yet
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251911%27 HTTP/1.1" 200 None
2026-03-28 22:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251911 not downloaded yet
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994500%27 HTTP/1.1" 200 None
2026-03-28 22:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994500 not downloaded yet
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252369%27 HTTP/1.1" 200 None
2026-03-28 22:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252369 not downloaded yet
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253940%27 HTTP/1.1" 200 None
2026-03-28 22:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253940 not downloaded yet
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023402%27 HTTP/1.1" 200 None
2026-03-28 22:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023402 not downloaded yet
2026-03-28 22:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9dd2298d-ebbc-515d-9de4-f7cd13970974 with identifier: MX66%20VHW
2026-03-28 22:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9dd2298d-ebbc-515d-9de4-f7cd13970974 with identifier: MX66%20VHW
2026-03-28 22:03:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9dd2298d-ebbc-515d-9de4-f7cd13970974 with identifier: MX66%20VHW to the API
2026-03-28 22:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 87,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MX66%20VHW-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9dd2298d-ebbc-515d-9de4-f7cd13970974',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MX66 VHW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MX66%20VHW&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'DS AUTOMOBILES',
'model': 'DS 3',
'odometer': 76015,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'DS AUTOMOBILES DS 3 1.6 BLUEHDI 100 ELEGANCE Hatchback',
'transmission': 'manual',
'trim': 'BLUEHDI 100 ELEGANCE',
'vin': 'VF7SABHY6GW622144',
'year': 2016}
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX66%2520VHW%27 HTTP/1.1" 200 None
2026-03-28 22:03:27 [bca.uk] INFO: Saving data for MX66%20VHW: {'auction_closing_time': 1774778400.0, 'created_time': 1774621393.280631, 'last_price_update_time': 1774735407.227077}
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MX66%2520VHW') HTTP/1.1" 204 0
2026-03-28 22:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55433be50>
2026-03-28 22:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f78646-9cef-5fc7-bd80-803ea7a167c9/47f78646-9cef-5fc7-bd80-803ea7a167c9_expert_report_file_34a84151-9719-4100-8015-a043dc9732cf.pdf HTTP/1.1" 201 0
2026-03-28 22:03:27 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 47f78646-9cef-5fc7-bd80-803ea7a167c9
2026-03-28 22:03:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47f78646-9cef-5fc7-bd80-803ea7a167c9, skipping ID generation
2026-03-28 22:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 47f78646-9cef-5fc7-bd80-803ea7a167c9
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDK23XXL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DK23XXL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:27 [bca.uk] INFO: Found listing with ID: AU02%20VYG
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU02%2520VYG%27 HTTP/1.1" 200 None
2026-03-28 22:03:27 [bca.uk] INFO: Scrape type for AU02%20VYG: 1
2026-03-28 22:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f00ae92-c3a1-5f36-b822-faa77c54fc81 with identifier: AU02%20VYG
2026-03-28 22:03:27 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1f00ae92-c3a1-5f36-b822-faa77c54fc81
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110840%27 HTTP/1.1" 200 None
2026-03-28 22:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110840 not downloaded yet
2026-03-28 22:03:27 [bca.uk] INFO: Found listing with ID: MF68%20OCS
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF68%2520OCS%27 HTTP/1.1" 200 None
2026-03-28 22:03:27 [bca.uk] INFO: Scrape type for MF68%20OCS: 0
2026-03-28 22:03:27 [bca.uk] INFO: Found listing with ID: BU65%20UXW
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU65%2520UXW%27 HTTP/1.1" 200 None
2026-03-28 22:03:27 [bca.uk] INFO: Scrape type for BU65%20UXW: 2
2026-03-28 22:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 015922ec-b3dc-5d28-aa34-56a167f4152c with identifier: BU65%20UXW
2026-03-28 22:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 015922ec-b3dc-5d28-aa34-56a167f4152c with scrape type 2
2026-03-28 22:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 015922ec-b3dc-5d28-aa34-56a167f4152c with scrape type 2
2026-03-28 22:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 015922ec-b3dc-5d28-aa34-56a167f4152c, identifier: BU65%20UXW
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252120%27 HTTP/1.1" 200 None
2026-03-28 22:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252120 not downloaded yet
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253754%27 HTTP/1.1" 200 None
2026-03-28 22:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253754 not downloaded yet
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146573%27 HTTP/1.1" 200 None
2026-03-28 22:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146573 not downloaded yet
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015821%27 HTTP/1.1" 200 None
2026-03-28 22:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015821 not downloaded yet
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251924%27 HTTP/1.1" 200 None
2026-03-28 22:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251924 not downloaded yet
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994521%27 HTTP/1.1" 200 None
2026-03-28 22:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994521 not downloaded yet
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252387%27 HTTP/1.1" 200 None
2026-03-28 22:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252387 not downloaded yet
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253951%27 HTTP/1.1" 200 None
2026-03-28 22:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253951 not downloaded yet
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023424%27 HTTP/1.1" 200 None
2026-03-28 22:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023424 not downloaded yet
2026-03-28 22:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 015922ec-b3dc-5d28-aa34-56a167f4152c with identifier: BU65%20UXW
2026-03-28 22:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 015922ec-b3dc-5d28-aa34-56a167f4152c with identifier: BU65%20UXW
2026-03-28 22:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 015922ec-b3dc-5d28-aa34-56a167f4152c with identifier: BU65%20UXW to the API
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BU65%20UXW-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '015922ec-b3dc-5d28-aa34-56a167f4152c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BU65 UXW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BU65%20UXW&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 76066,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.4 T 16V 125 DESIGN Hatchback',
'transmission': 'manual',
'trim': 'T 16V 125 DESIGN',
'vin': 'W0LBD6EB7G8047143',
'year': 2016}
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU65%2520UXW%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [bca.uk] INFO: Saving data for BU65%20UXW: {'auction_closing_time': 1774778400.0, 'created_time': 1774621666.75748, 'last_price_update_time': 1774735408.014254}
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BU65%2520UXW') HTTP/1.1" 204 0
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038141%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038141 not downloaded yet
2026-03-28 22:03:28 [bca.uk] INFO: Found listing with ID: BF18%20GZO
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF18%2520GZO%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [bca.uk] INFO: Scrape type for BF18%20GZO: 0
2026-03-28 22:03:28 [bca.uk] INFO: Found listing with ID: RF61%20EUB
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF61%2520EUB%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [bca.uk] INFO: Scrape type for RF61%20EUB: 0
2026-03-28 22:03:28 [bca.uk] INFO: Found listing with ID: FE68%20XBZ
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE68%2520XBZ%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [bca.uk] INFO: Scrape type for FE68%20XBZ: 0
2026-03-28 22:03:28 [bca.uk] INFO: Found listing with ID: SP15%20VFV
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP15%2520VFV%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [bca.uk] INFO: Scrape type for SP15%20VFV: 1
2026-03-28 22:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74bb0eb2-42f3-5cb2-b21b-580137f2554b with identifier: SP15%20VFV
2026-03-28 22:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74bb0eb2-42f3-5cb2-b21b-580137f2554b with scrape type 1
2026-03-28 22:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 74bb0eb2-42f3-5cb2-b21b-580137f2554b
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSP15VFV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SP15VFV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110851%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110851 not downloaded yet
2026-03-28 22:03:28 [bca.uk] INFO: Found listing with ID: EA65%20ZNP
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA65%2520ZNP%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [bca.uk] INFO: Scrape type for EA65%20ZNP: 0
2026-03-28 22:03:28 [bca.uk] INFO: Found listing with ID: LC66%20FZS
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC66%2520FZS%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [bca.uk] INFO: Scrape type for LC66%20FZS: 0
2026-03-28 22:03:28 [bca.uk] INFO: Found listing with ID: YD18%20PGR
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD18%2520PGR%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [bca.uk] INFO: Scrape type for YD18%20PGR: 0
2026-03-28 22:03:28 [bca.uk] INFO: Found listing with ID: FE15%20XBZ
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE15%2520XBZ%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [bca.uk] INFO: Scrape type for FE15%20XBZ: 2
2026-03-28 22:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de8c0210-2d5f-55b5-a43b-f80b2fbf099e with identifier: FE15%20XBZ
2026-03-28 22:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de8c0210-2d5f-55b5-a43b-f80b2fbf099e with scrape type 2
2026-03-28 22:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de8c0210-2d5f-55b5-a43b-f80b2fbf099e with scrape type 2
2026-03-28 22:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: de8c0210-2d5f-55b5-a43b-f80b2fbf099e, identifier: FE15%20XBZ
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252126%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252126 not downloaded yet
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253965%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253965 not downloaded yet
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023451%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023451 not downloaded yet
2026-03-28 22:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: de8c0210-2d5f-55b5-a43b-f80b2fbf099e with identifier: FE15%20XBZ
2026-03-28 22:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: de8c0210-2d5f-55b5-a43b-f80b2fbf099e with identifier: FE15%20XBZ
2026-03-28 22:03:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: de8c0210-2d5f-55b5-a43b-f80b2fbf099e with identifier: FE15%20XBZ to the API
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 95,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FE15%20XBZ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'de8c0210-2d5f-55b5-a43b-f80b2fbf099e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FE15 XBZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FE15%20XBZ&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'TOYOTA',
'model': 'AYGO',
'odometer': 102466,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'TOYOTA AYGO 1.0 VVT-I X-PRESSION Hatchback',
'transmission': 'manual',
'trim': 'VVT-I X-PRESSION',
'vin': 'JTDKGNEC70N059585',
'year': 2015}
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE15%2520XBZ%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [bca.uk] INFO: Saving data for FE15%20XBZ: {'auction_closing_time': 1774778400.0, 'created_time': 1774621652.980594, 'last_price_update_time': 1774735408.694495}
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FE15%2520XBZ') HTTP/1.1" 204 0
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038160%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038160 not downloaded yet
2026-03-28 22:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252289/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT12LJZ/42809616?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=ZCqeg%2BtAkN7zfvr8I5qdCyvEoyksA32%2Fdc9lEzPe%2BbI%3D)
2026-03-28 22:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145552/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LY64DTU/42811373?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=nlvyE6o%2BjOSTCR6ZUHB9E%2BOFaaB84Hiq02HBTHcoq8g%3D)
2026-03-28 22:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145309/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM61DYD/42811410?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=bDvqRxwLzIpEHYLUXTs40ur1RioMfasSNgu0Yug2sj4%3D)
2026-03-28 22:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143445/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY14HKC/42811403?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=%2BYxeffQ4HY6floQPvp5Yr65sra111z9jxOTYy7mtf%2FU%3D)
2026-03-28 22:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146260/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK12WBW/42811322?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=zrDQXpGJ59OXDPhU47QBcrd8BHKRhOWFkFPoLF1d7pk%3D)
2026-03-28 22:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143318/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ63EXO/42810870?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=wLoUguMiGeygfSRIZDr4SROlj4YBVqcY7mSaCT7eFDc%3D)
2026-03-28 22:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976330/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY58NPG/42810706?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=m%2BjvjS4%2BeJxyPZhfktFet4Bo%2BpsamHOTjBnjcUc644A%3D)
2026-03-28 22:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143325/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ63EXO/42810870?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=wLoUguMiGeygfSRIZDr4SROlj4YBVqcY7mSaCT7eFDc%3D)
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D689039783%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689039783 not downloaded yet
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110872%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110872 not downloaded yet
2026-03-28 22:03:28 [bca.uk] INFO: Found listing with ID: SC64%20XUW
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC64%2520XUW%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [bca.uk] INFO: Scrape type for SC64%20XUW: 0
2026-03-28 22:03:28 [bca.uk] INFO: Found listing with ID: SV65%20UOS
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV65%2520UOS%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [bca.uk] INFO: Scrape type for SV65%20UOS: 0
2026-03-28 22:03:28 [bca.uk] INFO: Found listing with ID: CF18%20AYX
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF18%2520AYX%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [bca.uk] INFO: Scrape type for CF18%20AYX: 0
2026-03-28 22:03:28 [bca.uk] INFO: Found listing with ID: WJ68%20ONK
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ68%2520ONK%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [bca.uk] INFO: Scrape type for WJ68%20ONK: 1
2026-03-28 22:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0 with identifier: WJ68%20ONK
2026-03-28 22:03:28 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252137%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252137 not downloaded yet
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023479%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023479 not downloaded yet
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038177%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038177 not downloaded yet
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D689039789%27 HTTP/1.1" 200 None
2026-03-28 22:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689039789 not downloaded yet
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110888%27 HTTP/1.1" 200 None
2026-03-28 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110888 not downloaded yet
2026-03-28 22:03:29 [bca.uk] INFO: Found listing with ID: GK64%20GZJ
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK64%2520GZJ%27 HTTP/1.1" 200 None
2026-03-28 22:03:29 [bca.uk] INFO: Scrape type for GK64%20GZJ: 0
2026-03-28 22:03:29 [bca.uk] INFO: Found listing with ID: SB64%20NFX
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB64%2520NFX%27 HTTP/1.1" 200 None
2026-03-28 22:03:29 [bca.uk] INFO: Scrape type for SB64%20NFX: 2
2026-03-28 22:03:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26f2350d-f6f7-5953-a75c-b4b09dd04a52 with identifier: SB64%20NFX
2026-03-28 22:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26f2350d-f6f7-5953-a75c-b4b09dd04a52 with scrape type 2
2026-03-28 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26f2350d-f6f7-5953-a75c-b4b09dd04a52 with scrape type 2
2026-03-28 22:03:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 26f2350d-f6f7-5953-a75c-b4b09dd04a52, identifier: SB64%20NFX
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252150%27 HTTP/1.1" 200 None
2026-03-28 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252150 not downloaded yet
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023499%27 HTTP/1.1" 200 None
2026-03-28 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023499 not downloaded yet
2026-03-28 22:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 26f2350d-f6f7-5953-a75c-b4b09dd04a52 with identifier: SB64%20NFX
2026-03-28 22:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 26f2350d-f6f7-5953-a75c-b4b09dd04a52 with identifier: SB64%20NFX
2026-03-28 22:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 26f2350d-f6f7-5953-a75c-b4b09dd04a52 with identifier: SB64%20NFX to the API
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SB64%20NFX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '26f2350d-f6f7-5953-a75c-b4b09dd04a52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SB64 NFX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SB64%20NFX&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VOLVO',
'model': 'XC60',
'odometer': 75862,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VOLVO XC60 2.0 D4 181 2WD SE LUX Estate',
'transmission': 'manual',
'trim': 'D4 181 2WD SE LUX',
'vin': 'YV1DZ73C1F2699821',
'year': 2014}
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB64%2520NFX%27 HTTP/1.1" 200 None
2026-03-28 22:03:29 [bca.uk] INFO: Saving data for SB64%20NFX: {'auction_closing_time': 1774778400.0, 'created_time': 1774621630.343655, 'last_price_update_time': 1774735409.52266}
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SB64%2520NFX') HTTP/1.1" 204 0
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038193%27 HTTP/1.1" 200 None
2026-03-28 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038193 not downloaded yet
2026-03-28 22:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253924/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253924>
2026-03-28 22:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251899/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251899>
2026-03-28 22:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994470/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994470>
2026-03-28 22:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252112/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252112>
2026-03-28 22:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN68YYB/42810746?sv=2020-08-04&st=2026-03-28T22%3A03%3A29Z&se=2026-03-28T22%3A28%3A29Z&sr=b&sp=r&sig=wILsmg9cR%2BC5ELYsaDqFarEwRxBfh8Z9P1%2FXmbnSdGw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KN68%20YYB-GB>
2026-03-28 22:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252353/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252353>
2026-03-28 22:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110834/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110834>
2026-03-28 22:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023391/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023391>
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D689039793%27 HTTP/1.1" 200 None
2026-03-28 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689039793 not downloaded yet
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110906%27 HTTP/1.1" 200 None
2026-03-28 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110906 not downloaded yet
2026-03-28 22:03:29 [bca.uk] INFO: Found listing with ID: YG64%20FFB
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG64%2520FFB%27 HTTP/1.1" 200 None
2026-03-28 22:03:29 [bca.uk] INFO: Scrape type for YG64%20FFB: 0
2026-03-28 22:03:29 [bca.uk] INFO: Found listing with ID: DG65%20SWK
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG65%2520SWK%27 HTTP/1.1" 200 None
2026-03-28 22:03:29 [bca.uk] INFO: Scrape type for DG65%20SWK: 1
2026-03-28 22:03:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30d6d7c3-a2c7-5054-9780-fec8ad872fbe with identifier: DG65%20SWK
2026-03-28 22:03:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 30d6d7c3-a2c7-5054-9780-fec8ad872fbe
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252161%27 HTTP/1.1" 200 None
2026-03-28 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252161 not downloaded yet
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554317dd0>
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2a7ebc8-3779-5484-8073-7a1c6fb87969/c2a7ebc8-3779-5484-8073-7a1c6fb87969_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT12LJZ%252F699252289%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252289/600 saved to cache
2026-03-28 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2a7ebc8-3779-5484-8073-7a1c6fb87969
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547600c10>
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_782aa18e-a0c9-5c10-9106-d797127b5b2a/782aa18e-a0c9-5c10-9106-d797127b5b2a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLY64DTU%252F699145552%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145552/600 saved to cache
2026-03-28 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 782aa18e-a0c9-5c10-9106-d797127b5b2a
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554ace890>
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a59b1b92-68f6-5af6-ad88-8517ad8fae07/a59b1b92-68f6-5af6-ad88-8517ad8fae07_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM61DYD%252F699145309%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145309/600 saved to cache
2026-03-28 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a59b1b92-68f6-5af6-ad88-8517ad8fae07
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471bb690>
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4878bd96-ecc6-5172-b9f4-32abbb9ae940/4878bd96-ecc6-5172-b9f4-32abbb9ae940_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY14HKC%252F699143445%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143445/600 saved to cache
2026-03-28 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4878bd96-ecc6-5172-b9f4-32abbb9ae940
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547444a10>
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5057cc2-c58a-5e78-ab90-b97e6edb6582/c5057cc2-c58a-5e78-ab90-b97e6edb6582_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK12WBW%252F699146260%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146260/600 saved to cache
2026-03-28 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5057cc2-c58a-5e78-ab90-b97e6edb6582
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471ea810>
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac2cb512-acf6-577f-a0f2-2fe21a625645/ac2cb512-acf6-577f-a0f2-2fe21a625645_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ63EXO%252F699143318%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143318/600 saved to cache
2026-03-28 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac2cb512-acf6-577f-a0f2-2fe21a625645
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5541fe990>
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96f4e7fc-b83e-5062-87d7-e0a26a3eaa65/96f4e7fc-b83e-5062-87d7-e0a26a3eaa65_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY58NPG%252F698976330%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976330/600 saved to cache
2026-03-28 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549792d0>
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac2cb512-acf6-577f-a0f2-2fe21a625645/ac2cb512-acf6-577f-a0f2-2fe21a625645_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ63EXO%252F699143325%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143325/600 saved to cache
2026-03-28 22:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac2cb512-acf6-577f-a0f2-2fe21a625645
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038208%27 HTTP/1.1" 200 None
2026-03-28 22:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038208 not downloaded yet
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D689039795%27 HTTP/1.1" 200 None
2026-03-28 22:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689039795 not downloaded yet
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110927%27 HTTP/1.1" 200 None
2026-03-28 22:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110927 not downloaded yet
2026-03-28 22:03:30 [bca.uk] INFO: Found listing with ID: OU64%20UPA
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU64%2520UPA%27 HTTP/1.1" 200 None
2026-03-28 22:03:30 [bca.uk] INFO: Scrape type for OU64%20UPA: 1
2026-03-28 22:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4f2d0a0-2885-57c7-ae21-ea61c25273d9 with identifier: OU64%20UPA
2026-03-28 22:03:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d4f2d0a0-2885-57c7-ae21-ea61c25273d9
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252171%27 HTTP/1.1" 200 None
2026-03-28 22:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252171 not downloaded yet
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038232%27 HTTP/1.1" 200 None
2026-03-28 22:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038232 not downloaded yet
2026-03-28 22:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038160/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038160>
2026-03-28 22:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023424/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023424>
2026-03-28 22:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023451/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023451>
2026-03-28 22:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253965/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253965>
2026-03-28 22:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038141/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038141>
2026-03-28 22:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252126/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252126>
2026-03-28 22:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039779/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SP15VFV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110851/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110851>
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D689039798%27 HTTP/1.1" 200 None
2026-03-28 22:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689039798 not downloaded yet
2026-03-28 22:03:30 [bca.uk] INFO: Found listing with ID: BP18%20KJN
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP18%2520KJN%27 HTTP/1.1" 200 None
2026-03-28 22:03:30 [bca.uk] INFO: Scrape type for BP18%20KJN: 0
2026-03-28 22:03:30 [bca.uk] INFO: Found listing with ID: RRZ%209472
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RRZ%25209472%27 HTTP/1.1" 200 None
2026-03-28 22:03:30 [bca.uk] INFO: Scrape type for RRZ%209472: 0
2026-03-28 22:03:30 [bca.uk] INFO: Found listing with ID: BJ66%20UKZ
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ66%2520UKZ%27 HTTP/1.1" 200 None
2026-03-28 22:03:30 [bca.uk] INFO: Scrape type for BJ66%20UKZ: 0
2026-03-28 22:03:30 [bca.uk] INFO: Found listing with ID: DE64%20TVD
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE64%2520TVD%27 HTTP/1.1" 200 None
2026-03-28 22:03:30 [bca.uk] INFO: Scrape type for DE64%20TVD: 0
2026-03-28 22:03:30 [bca.uk] INFO: Found listing with ID: YC17%20PKX
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC17%2520PKX%27 HTTP/1.1" 200 None
2026-03-28 22:03:30 [bca.uk] INFO: Scrape type for YC17%20PKX: 0
2026-03-28 22:03:30 [bca.uk] INFO: Found listing with ID: YH66%20USG
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH66%2520USG%27 HTTP/1.1" 200 None
2026-03-28 22:03:30 [bca.uk] INFO: Scrape type for YH66%20USG: 2
2026-03-28 22:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7275d163-66a7-5597-87e1-7ec9832d6465 with identifier: YH66%20USG
2026-03-28 22:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7275d163-66a7-5597-87e1-7ec9832d6465 with scrape type 2
2026-03-28 22:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7275d163-66a7-5597-87e1-7ec9832d6465 with scrape type 2
2026-03-28 22:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7275d163-66a7-5597-87e1-7ec9832d6465, identifier: YH66%20USG
2026-03-28 22:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7275d163-66a7-5597-87e1-7ec9832d6465 with identifier: YH66%20USG
2026-03-28 22:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7275d163-66a7-5597-87e1-7ec9832d6465 with identifier: YH66%20USG
2026-03-28 22:03:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7275d163-66a7-5597-87e1-7ec9832d6465 with identifier: YH66%20USG to the API
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YH66%20USG-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7275d163-66a7-5597-87e1-7ec9832d6465',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YH66 USG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YH66%20USG&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'ADAM',
'odometer': 61842,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VAUXHALL ADAM 1.2 VVT 70 JAM Hatchback',
'transmission': 'manual',
'trim': 'VVT 70 JAM',
'vin': 'W0L0MAP08G6122230',
'year': 2016}
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH66%2520USG%27 HTTP/1.1" 200 None
2026-03-28 22:03:30 [bca.uk] INFO: Saving data for YH66%20USG: {'auction_closing_time': 1774778400.0, 'created_time': 1774622387.402745, 'last_price_update_time': 1774735410.707361}
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YH66%2520USG') HTTP/1.1" 204 0
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038250%27 HTTP/1.1" 200 None
2026-03-28 22:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038250 not downloaded yet
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D689039802%27 HTTP/1.1" 200 None
2026-03-28 22:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689039802 not downloaded yet
2026-03-28 22:03:30 [bca.uk] INFO: Found listing with ID: YR15%20BJV
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR15%2520BJV%27 HTTP/1.1" 200 None
2026-03-28 22:03:30 [bca.uk] INFO: Scrape type for YR15%20BJV: 0
2026-03-28 22:03:30 [bca.uk] INFO: Found listing with ID: YR64%20ZFO
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR64%2520ZFO%27 HTTP/1.1" 200 None
2026-03-28 22:03:30 [bca.uk] INFO: Scrape type for YR64%20ZFO: 0
2026-03-28 22:03:30 [bca.uk] INFO: Found listing with ID: OV65%20GFU
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV65%2520GFU%27 HTTP/1.1" 200 None
2026-03-28 22:03:30 [bca.uk] INFO: Scrape type for OV65%20GFU: 1
2026-03-28 22:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63a9213b-9753-5663-b464-16226cca8eb4 with identifier: OV65%20GFU
2026-03-28 22:03:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 63a9213b-9753-5663-b464-16226cca8eb4
2026-03-28 22:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110834/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/B10PGJ/42811203?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=EuD%2Bp1HvVP2JXHqKU%2B8jitx6XlktdJcPsUn2sF2sJ6k%3D)
2026-03-28 22:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252353/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT12LJZ/42809616?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=ZCqeg%2BtAkN7zfvr8I5qdCyvEoyksA32%2Fdc9lEzPe%2BbI%3D)
2026-03-28 22:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252112/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF19KHM/42806820?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=sr8AUvzfzyG0aLirfPlv3wY7sqotPL2UPVrzrL33HII%3D)
2026-03-28 22:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023391/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT69OUG/42810791?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=Rkj%2FxkM1%2BIIgVTIeJOHfQd43I%2FeKECKsCGXnmowEFQk%3D)
2026-03-28 22:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251899/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT64JYY/42807297?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=H09NJ6PkIwPyWfxNOYCddSHeDmQxr4Xr%2FaIklrKjYWY%3D)
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038268%27 HTTP/1.1" 200 None
2026-03-28 22:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038268 not downloaded yet
2026-03-28 22:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994470/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS61FOF/42810605?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=CkwC%2BSn%2FHa5pvfLJnieo5YJn96MqgCZnNQ9bJG2t2ik%3D)
2026-03-28 22:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253924/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP11SXG/42810463?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=qkkbLatUiKU%2BsinzgsPhauDtkraDtbwZc7leOW58DOU%3D)
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D689039804%27 HTTP/1.1" 200 None
2026-03-28 22:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689039804 not downloaded yet
2026-03-28 22:03:30 [bca.uk] INFO: Found listing with ID: KW67%20HUY
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW67%2520HUY%27 HTTP/1.1" 200 None
2026-03-28 22:03:30 [bca.uk] INFO: Scrape type for KW67%20HUY: 1
2026-03-28 22:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3649b9f8-64ee-584f-9d2b-f46b1db86e38 with identifier: KW67%20HUY
2026-03-28 22:03:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3649b9f8-64ee-584f-9d2b-f46b1db86e38
2026-03-28 22:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN68YYB/42810746?sv=2020-08-04&st=2026-03-28T22%3A03%3A29Z&se=2026-03-28T22%3A28%3A29Z&sr=b&sp=r&sig=wILsmg9cR%2BC5ELYsaDqFarEwRxBfh8Z9P1%2FXmbnSdGw%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038288%27 HTTP/1.1" 200 None
2026-03-28 22:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038288 not downloaded yet
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D689039806%27 HTTP/1.1" 200 None
2026-03-28 22:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689039806 not downloaded yet
2026-03-28 22:03:30 [bca.uk] INFO: Found listing with ID: NU67%20EBV
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU67%2520EBV%27 HTTP/1.1" 200 None
2026-03-28 22:03:31 [bca.uk] INFO: Scrape type for NU67%20EBV: 1
2026-03-28 22:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d00f4d6-3827-55c1-a06a-583364af76a6 with identifier: NU67%20EBV
2026-03-28 22:03:31 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2d00f4d6-3827-55c1-a06a-583364af76a6
2026-03-28 22:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110851/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/B10PGJ/42811203?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=EuD%2Bp1HvVP2JXHqKU%2B8jitx6XlktdJcPsUn2sF2sJ6k%3D)
2026-03-28 22:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039779/600> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252126/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF19KHM/42806820?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=sr8AUvzfzyG0aLirfPlv3wY7sqotPL2UPVrzrL33HII%3D)
2026-03-28 22:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253965/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP11SXG/42810463?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=qkkbLatUiKU%2BsinzgsPhauDtkraDtbwZc7leOW58DOU%3D)
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D689039807%27 HTTP/1.1" 200 None
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689039807 not downloaded yet
2026-03-28 22:03:31 [bca.uk] INFO: Found listing with ID: KY66%20XSJ
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY66%2520XSJ%27 HTTP/1.1" 200 None
2026-03-28 22:03:31 [bca.uk] INFO: Scrape type for KY66%20XSJ: 1
2026-03-28 22:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43b40829-d997-5432-a0e4-0fd30767ce9e with identifier: KY66%20XSJ
2026-03-28 22:03:31 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 43b40829-d997-5432-a0e4-0fd30767ce9e
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54779eb10>
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414fda2b-7a8b-5d29-ad43-b0e99521f4d6/414fda2b-7a8b-5d29-ad43-b0e99521f4d6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FB10PGJ%252F699110834%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110834/600 saved to cache
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 414fda2b-7a8b-5d29-ad43-b0e99521f4d6
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547c5d90>
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2a7ebc8-3779-5484-8073-7a1c6fb87969/c2a7ebc8-3779-5484-8073-7a1c6fb87969_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT12LJZ%252F699252353%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252353/600 saved to cache
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c2a7ebc8-3779-5484-8073-7a1c6fb87969
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554364810>
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ba462d-c70d-5156-b443-d7d5e76250e2/a4ba462d-c70d-5156-b443-d7d5e76250e2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF19KHM%252F699252112%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252112/600 saved to cache
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a4ba462d-c70d-5156-b443-d7d5e76250e2
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55438d710>
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1f5ee4c-4910-54f2-806e-fcee61f2b886/b1f5ee4c-4910-54f2-806e-fcee61f2b886_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT69OUG%252F699023391%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023391/600 saved to cache
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b1f5ee4c-4910-54f2-806e-fcee61f2b886
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b0ca90>
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e23659de-a271-571f-ad29-745e3ce94452/e23659de-a271-571f-ad29-745e3ce94452_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT64JYY%252F699251899%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251899/600 saved to cache
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e23659de-a271-571f-ad29-745e3ce94452
2026-03-28 22:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038141/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK23XXL/42810961?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=HIraPhBD5waa9seHUB8yTzip4V%2BkelIT5vdZTBzO1L4%3D)
2026-03-28 22:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038160/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK23XXL/42810961?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=HIraPhBD5waa9seHUB8yTzip4V%2BkelIT5vdZTBzO1L4%3D)
2026-03-28 22:03:31 [bca.uk] INFO: Found listing with ID: ST64%20MMV
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST64%2520MMV%27 HTTP/1.1" 200 None
2026-03-28 22:03:31 [bca.uk] INFO: Scrape type for ST64%20MMV: 1
2026-03-28 22:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c98b2cc3-a1ec-5194-ae49-df6d05e42077 with identifier: ST64%20MMV
2026-03-28 22:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c98b2cc3-a1ec-5194-ae49-df6d05e42077 with scrape type 1
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c98b2cc3-a1ec-5194-ae49-df6d05e42077
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DST64MMV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ST64MMV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:31 [bca.uk] INFO: Found listing with ID: AK11%20NXR
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK11%2520NXR%27 HTTP/1.1" 200 None
2026-03-28 22:03:31 [bca.uk] INFO: Scrape type for AK11%20NXR: 1
2026-03-28 22:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f with identifier: AK11%20NXR
2026-03-28 22:03:31 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f
2026-03-28 22:03:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038232/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038232>
2026-03-28 22:03:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039798/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689039798>
2026-03-28 22:03:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038250/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038250>
2026-03-28 22:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023451/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT69OUG/42810791?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=Rkj%2FxkM1%2BIIgVTIeJOHfQd43I%2FeKECKsCGXnmowEFQk%3D)
2026-03-28 22:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023424/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT69OUG/42810791?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=Rkj%2FxkM1%2BIIgVTIeJOHfQd43I%2FeKECKsCGXnmowEFQk%3D)
2026-03-28 22:03:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252171/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252171>
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D684814022%27 HTTP/1.1" 200 None
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=684814022 not downloaded yet
2026-03-28 22:03:31 [bca.uk] INFO: Found listing with ID: YB08%20OEU
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB08%2520OEU%27 HTTP/1.1" 200 None
2026-03-28 22:03:31 [bca.uk] INFO: Scrape type for YB08%20OEU: 0
2026-03-28 22:03:31 [bca.uk] INFO: Found listing with ID: MM11%20JNV
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM11%2520JNV%27 HTTP/1.1" 200 None
2026-03-28 22:03:31 [bca.uk] INFO: Scrape type for MM11%20JNV: 0
2026-03-28 22:03:31 [bca.uk] INFO: Found listing with ID: AC58%20KVH
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AC58%2520KVH%27 HTTP/1.1" 200 None
2026-03-28 22:03:31 [bca.uk] INFO: Scrape type for AC58%20KVH: 0
2026-03-28 22:03:31 [bca.uk] INFO: Found listing with ID: KS04%20HEJ
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS04%2520HEJ%27 HTTP/1.1" 200 None
2026-03-28 22:03:31 [bca.uk] INFO: Scrape type for KS04%20HEJ: 0
2026-03-28 22:03:31 [bca.uk] INFO: Found listing with ID: YF12%20LYA
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF12%2520LYA%27 HTTP/1.1" 200 None
2026-03-28 22:03:31 [bca.uk] INFO: Scrape type for YF12%20LYA: 0
2026-03-28 22:03:31 [bca.uk] INFO: Found listing with ID: SG09%20LCM
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG09%2520LCM%27 HTTP/1.1" 200 None
2026-03-28 22:03:31 [bca.uk] INFO: Scrape type for SG09%20LCM: 0
2026-03-28 22:03:31 [bca.uk] INFO: Found listing with ID: BT54%20XOM
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT54%2520XOM%27 HTTP/1.1" 200 None
2026-03-28 22:03:31 [bca.uk] INFO: Scrape type for BT54%20XOM: 0
2026-03-28 22:03:31 [bca.uk] INFO: Found listing with ID: SU06%20XOV
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SU06%2520XOV%27 HTTP/1.1" 200 None
2026-03-28 22:03:31 [bca.uk] INFO: Scrape type for SU06%20XOV: 2
2026-03-28 22:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d93a8558-0c09-5d27-83ff-565ac66c6712 with identifier: SU06%20XOV
2026-03-28 22:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d93a8558-0c09-5d27-83ff-565ac66c6712 with scrape type 2
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d93a8558-0c09-5d27-83ff-565ac66c6712 with scrape type 2
2026-03-28 22:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d93a8558-0c09-5d27-83ff-565ac66c6712, identifier: SU06%20XOV
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55729ebd0>
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c3dd07d-5304-5ac0-80dc-e30cb298b7d6/5c3dd07d-5304-5ac0-80dc-e30cb298b7d6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS61FOF%252F698994470%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994470/600 saved to cache
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547c4e50>
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13188273-241e-5122-a324-f170682054c3/13188273-241e-5122-a324-f170682054c3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP11SXG%252F699253924%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253924/600 saved to cache
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 13188273-241e-5122-a324-f170682054c3
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542d1450>
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37980901-da86-559d-83e6-c8f73f7f2265/37980901-da86-559d-83e6-c8f73f7f2265_expert_report_file_0a039026-4fe4-4c71-b9a9-09845d0a700c.pdf HTTP/1.1" 201 0
2026-03-28 22:03:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 37980901-da86-559d-83e6-c8f73f7f2265
2026-03-28 22:03:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37980901-da86-559d-83e6-c8f73f7f2265, skipping ID generation
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 37980901-da86-559d-83e6-c8f73f7f2265
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKN68YYB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KN68YYB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54762c290>
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414fda2b-7a8b-5d29-ad43-b0e99521f4d6/414fda2b-7a8b-5d29-ad43-b0e99521f4d6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FB10PGJ%252F699110851%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110851/600 saved to cache
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 414fda2b-7a8b-5d29-ad43-b0e99521f4d6
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473cf250>
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bb0eb2-42f3-5cb2-b21b-580137f2554b/74bb0eb2-42f3-5cb2-b21b-580137f2554b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP15VFV%252F689039779%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039779/600 saved to cache
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74bb0eb2-42f3-5cb2-b21b-580137f2554b
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54714c8d0>
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ba462d-c70d-5156-b443-d7d5e76250e2/a4ba462d-c70d-5156-b443-d7d5e76250e2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF19KHM%252F699252126%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252126/600 saved to cache
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a4ba462d-c70d-5156-b443-d7d5e76250e2
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547605410>
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13188273-241e-5122-a324-f170682054c3/13188273-241e-5122-a324-f170682054c3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP11SXG%252F699253965%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253965/600 saved to cache
2026-03-28 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 13188273-241e-5122-a324-f170682054c3
2026-03-28 22:03:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d93a8558-0c09-5d27-83ff-565ac66c6712 with identifier: SU06%20XOV
2026-03-28 22:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d93a8558-0c09-5d27-83ff-565ac66c6712 with identifier: SU06%20XOV
2026-03-28 22:03:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d93a8558-0c09-5d27-83ff-565ac66c6712 with identifier: SU06%20XOV to the API
2026-03-28 22:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 249,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SU06%20XOV-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd93a8558-0c09-5d27-83ff-565ac66c6712',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SU06 XOV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SU06%20XOV&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'MERCEDES-BENZ',
'model': 'ML320',
'odometer': 154098,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ ML320 3.0 CDI SE StationWagon',
'transmission': 'manual',
'trim': 'CDI SE',
'vin': 'WDC1641222A059279',
'year': 2006}
2026-03-28 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SU06%2520XOV%27 HTTP/1.1" 200 None
2026-03-28 22:03:32 [bca.uk] INFO: Saving data for SU06%20XOV: {'auction_closing_time': 1774864800.0, 'created_time': 1774535355.465273, 'last_price_update_time': 1774735412.325153}
2026-03-28 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SU06%2520XOV') HTTP/1.1" 204 0
2026-03-28 22:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038268/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038268>
2026-03-28 22:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OU64UPA/42811127?sv=2020-08-04&st=2026-03-28T22%3A03%3A31Z&se=2026-03-28T22%3A28%3A31Z&sr=b&sp=r&sig=8BqSQERI1JQCVBe1x8fbzIsYG%2BShES3mtYstvdJ8vEg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OU64%20UPA-GB>
2026-03-28 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D684814026%27 HTTP/1.1" 200 None
2026-03-28 22:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=684814026 not downloaded yet
2026-03-28 22:03:32 [bca.uk] INFO: Found listing with ID: SP59%20HRM
2026-03-28 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP59%2520HRM%27 HTTP/1.1" 200 None
2026-03-28 22:03:32 [bca.uk] INFO: Scrape type for SP59%20HRM: 0
2026-03-28 22:03:32 [bca.uk] INFO: Found listing with ID: GJ56%20ZHY
2026-03-28 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ56%2520ZHY%27 HTTP/1.1" 200 None
2026-03-28 22:03:32 [bca.uk] INFO: Scrape type for GJ56%20ZHY: 0
2026-03-28 22:03:32 [bca.uk] INFO: Found listing with ID: M500%20MGW
2026-03-28 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M500%2520MGW%27 HTTP/1.1" 200 None
2026-03-28 22:03:32 [bca.uk] INFO: Scrape type for M500%20MGW: 0
2026-03-28 22:03:32 [bca.uk] INFO: Found listing with ID: KY06%20TYK
2026-03-28 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY06%2520TYK%27 HTTP/1.1" 200 None
2026-03-28 22:03:32 [bca.uk] INFO: Scrape type for KY06%20TYK: 2
2026-03-28 22:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 107d23bb-8742-5983-b85a-b41941cd68ed with identifier: KY06%20TYK
2026-03-28 22:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 107d23bb-8742-5983-b85a-b41941cd68ed with scrape type 2
2026-03-28 22:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 107d23bb-8742-5983-b85a-b41941cd68ed with scrape type 2
2026-03-28 22:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 107d23bb-8742-5983-b85a-b41941cd68ed, identifier: KY06%20TYK
2026-03-28 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010763%27 HTTP/1.1" 200 None
2026-03-28 22:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010763 not downloaded yet
2026-03-28 22:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038288/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038288>
2026-03-28 22:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU67EBV/42807577?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=Dc9GP37lnEoc8Ucnf7mZMpnnsmm75eM47cbqeVO4%2BUo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NU67%20EBV-GB>
2026-03-28 22:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW67HUY/42806780?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=IjccUHM%2BUsRolC4agemnjyYj%2By8q%2BaL%2Bv6NarfY2Bpc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KW67%20HUY-GB>
2026-03-28 22:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039802/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689039802>
2026-03-28 22:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039804/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689039804>
2026-03-28 22:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV65GFU/42810585?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=Uw05gug7lwLgV7s2MX8pmDxdS7jFiOh93SlRxrnK0ts%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV65%20GFU-GB>
2026-03-28 22:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 107d23bb-8742-5983-b85a-b41941cd68ed with identifier: KY06%20TYK
2026-03-28 22:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 107d23bb-8742-5983-b85a-b41941cd68ed with identifier: KY06%20TYK
2026-03-28 22:03:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 107d23bb-8742-5983-b85a-b41941cd68ed with identifier: KY06%20TYK to the API
2026-03-28 22:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 193,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KY06%20TYK-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '107d23bb-8742-5983-b85a-b41941cd68ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KY06 TYK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KY06%20TYK&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MERCEDES-BENZ',
'model': 'C180',
'odometer': 99099,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C180 1.8 K SE Coupe',
'transmission': 'manual',
'trim': 'K SE',
'vin': 'WDB2037462A889874',
'year': 2006}
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY06%2520TYK%27 HTTP/1.1" 200 None
2026-03-28 22:03:33 [bca.uk] INFO: Saving data for KY06%20TYK: {'auction_closing_time': 1774864800.0, 'created_time': 1774361726.718049, 'last_price_update_time': 1774735413.074327}
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KY06%2520TYK') HTTP/1.1" 204 0
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D684814031%27 HTTP/1.1" 200 None
2026-03-28 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=684814031 not downloaded yet
2026-03-28 22:03:33 [bca.uk] INFO: Found listing with ID: DG59%20XEM
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG59%2520XEM%27 HTTP/1.1" 200 None
2026-03-28 22:03:33 [bca.uk] INFO: Scrape type for DG59%20XEM: 0
2026-03-28 22:03:33 [bca.uk] INFO: Found listing with ID: BJ10%20UWH
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ10%2520UWH%27 HTTP/1.1" 200 None
2026-03-28 22:03:33 [bca.uk] INFO: Scrape type for BJ10%20UWH: 0
2026-03-28 22:03:33 [bca.uk] INFO: Found listing with ID: SC53%20TDX
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC53%2520TDX%27 HTTP/1.1" 200 None
2026-03-28 22:03:33 [bca.uk] INFO: Scrape type for SC53%20TDX: 0
2026-03-28 22:03:33 [bca.uk] INFO: Found listing with ID: HV57%20ETA
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV57%2520ETA%27 HTTP/1.1" 200 None
2026-03-28 22:03:33 [bca.uk] INFO: Scrape type for HV57%20ETA: 0
2026-03-28 22:03:33 [bca.uk] INFO: Found listing with ID: EN05%20JVE
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN05%2520JVE%27 HTTP/1.1" 200 None
2026-03-28 22:03:33 [bca.uk] INFO: Scrape type for EN05%20JVE: 0
2026-03-28 22:03:33 [bca.uk] INFO: Found listing with ID: GP57%20RLY
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GP57%2520RLY%27 HTTP/1.1" 200 None
2026-03-28 22:03:33 [bca.uk] INFO: Scrape type for GP57%20RLY: 2
2026-03-28 22:03:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d68004bb-c7d6-5c64-a447-7e1fa4ebc052 with identifier: GP57%20RLY
2026-03-28 22:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d68004bb-c7d6-5c64-a447-7e1fa4ebc052 with scrape type 2
2026-03-28 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d68004bb-c7d6-5c64-a447-7e1fa4ebc052 with scrape type 2
2026-03-28 22:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d68004bb-c7d6-5c64-a447-7e1fa4ebc052, identifier: GP57%20RLY
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010796%27 HTTP/1.1" 200 None
2026-03-28 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010796 not downloaded yet
2026-03-28 22:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039807/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689039807>
2026-03-28 22:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY66XSJ/42810063?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=n4o%2FwpUrt5NmnHO4b%2FuTK0GIrxHv%2BFYQBHPaaSLhQm0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KY66%20XSJ-GB>
2026-03-28 22:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d68004bb-c7d6-5c64-a447-7e1fa4ebc052 with identifier: GP57%20RLY
2026-03-28 22:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d68004bb-c7d6-5c64-a447-7e1fa4ebc052 with identifier: GP57%20RLY
2026-03-28 22:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d68004bb-c7d6-5c64-a447-7e1fa4ebc052 with identifier: GP57%20RLY to the API
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GP57%20RLY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd68004bb-c7d6-5c64-a447-7e1fa4ebc052',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GP57 RLY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GP57%20RLY&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'VOLKSWAGEN',
'model': 'TOURAN',
'odometer': 132539,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TOURAN 2.0 TDI 140 SE MPV',
'transmission': 'manual',
'trim': 'TDI 140 SE',
'vin': 'WVGZZZ1TZ8W092897',
'year': 2007}
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GP57%2520RLY%27 HTTP/1.1" 200 None
2026-03-28 22:03:33 [bca.uk] INFO: Saving data for GP57%20RLY: {'auction_closing_time': 1774864800.0, 'created_time': 1774072929.651519, 'last_price_update_time': 1774735413.685146}
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GP57%2520RLY') HTTP/1.1" 204 0
2026-03-28 22:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54762ff10>
2026-03-28 22:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f78646-9cef-5fc7-bd80-803ea7a167c9/47f78646-9cef-5fc7-bd80-803ea7a167c9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK23XXL%252F699038141%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038141/600 saved to cache
2026-03-28 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47f78646-9cef-5fc7-bd80-803ea7a167c9
2026-03-28 22:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548ed150>
2026-03-28 22:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f78646-9cef-5fc7-bd80-803ea7a167c9/47f78646-9cef-5fc7-bd80-803ea7a167c9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK23XXL%252F699038160%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038160/600 saved to cache
2026-03-28 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47f78646-9cef-5fc7-bd80-803ea7a167c9
2026-03-28 22:03:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473f8f50>
2026-03-28 22:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1f5ee4c-4910-54f2-806e-fcee61f2b886/b1f5ee4c-4910-54f2-806e-fcee61f2b886_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT69OUG%252F699023451%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023451/600 saved to cache
2026-03-28 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b1f5ee4c-4910-54f2-806e-fcee61f2b886
2026-03-28 22:03:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b78550>
2026-03-28 22:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1f5ee4c-4910-54f2-806e-fcee61f2b886/b1f5ee4c-4910-54f2-806e-fcee61f2b886_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT69OUG%252F699023424%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023424/600 saved to cache
2026-03-28 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b1f5ee4c-4910-54f2-806e-fcee61f2b886
2026-03-28 22:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039798/600> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK11NXR/42811064?sv=2020-08-04&st=2026-03-28T22%3A03%3A33Z&se=2026-03-28T22%3A28%3A33Z&sr=b&sp=r&sig=WQwb7hHALscNLn8OXQjUUwD9ln4%2BEG5I6c0xHH7%2BOPc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AK11%20NXR-GB>
2026-03-28 22:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814014/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ST64MMV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D686249341%27 HTTP/1.1" 200 None
2026-03-28 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=686249341 not downloaded yet
2026-03-28 22:03:33 [bca.uk] INFO: Found listing with ID: AX60%20BHW
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX60%2520BHW%27 HTTP/1.1" 200 None
2026-03-28 22:03:33 [bca.uk] INFO: Scrape type for AX60%20BHW: 0
2026-03-28 22:03:33 [bca.uk] INFO: Found listing with ID: CA57%20XLV
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA57%2520XLV%27 HTTP/1.1" 200 None
2026-03-28 22:03:33 [bca.uk] INFO: Scrape type for CA57%20XLV: 0
2026-03-28 22:03:33 [bca.uk] INFO: Found listing with ID: YE59%20XKU
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE59%2520XKU%27 HTTP/1.1" 200 None
2026-03-28 22:03:33 [bca.uk] INFO: Scrape type for YE59%20XKU: 0
2026-03-28 22:03:33 [bca.uk] INFO: Found listing with ID: VN60%20CDO
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN60%2520CDO%27 HTTP/1.1" 200 None
2026-03-28 22:03:33 [bca.uk] INFO: Scrape type for VN60%20CDO: 0
2026-03-28 22:03:33 [bca.uk] INFO: Found listing with ID: WJ58%20DWA
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ58%2520DWA%27 HTTP/1.1" 200 None
2026-03-28 22:03:33 [bca.uk] INFO: Scrape type for WJ58%20DWA: 0
2026-03-28 22:03:33 [bca.uk] INFO: Found listing with ID: HV62%20WPN
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV62%2520WPN%27 HTTP/1.1" 200 None
2026-03-28 22:03:33 [bca.uk] INFO: Scrape type for HV62%20WPN: 0
2026-03-28 22:03:33 [bca.uk] INFO: Found listing with ID: SD60%20WDX
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD60%2520WDX%27 HTTP/1.1" 200 None
2026-03-28 22:03:33 [bca.uk] INFO: Scrape type for SD60%20WDX: 0
2026-03-28 22:03:33 [bca.uk] INFO: Found listing with ID: CV61%20KBJ
2026-03-28 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV61%2520KBJ%27 HTTP/1.1" 200 None
2026-03-28 22:03:34 [bca.uk] INFO: Scrape type for CV61%20KBJ: 0
2026-03-28 22:03:34 [bca.uk] INFO: Found listing with ID: VO62%20VVP
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO62%2520VVP%27 HTTP/1.1" 200 None
2026-03-28 22:03:34 [bca.uk] INFO: Scrape type for VO62%20VVP: 2
2026-03-28 22:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1a765bb-ac90-5abf-b113-fb4f48614ee7 with identifier: VO62%20VVP
2026-03-28 22:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1a765bb-ac90-5abf-b113-fb4f48614ee7 with scrape type 2
2026-03-28 22:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1a765bb-ac90-5abf-b113-fb4f48614ee7 with scrape type 2
2026-03-28 22:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f1a765bb-ac90-5abf-b113-fb4f48614ee7, identifier: VO62%20VVP
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010816%27 HTTP/1.1" 200 None
2026-03-28 22:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010816 not downloaded yet
2026-03-28 22:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252171/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF19KHM/42806820?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=sr8AUvzfzyG0aLirfPlv3wY7sqotPL2UPVrzrL33HII%3D)
2026-03-28 22:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038250/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK23XXL/42810961?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=HIraPhBD5waa9seHUB8yTzip4V%2BkelIT5vdZTBzO1L4%3D)
2026-03-28 22:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038232/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK23XXL/42810961?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=HIraPhBD5waa9seHUB8yTzip4V%2BkelIT5vdZTBzO1L4%3D)
2026-03-28 22:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f1a765bb-ac90-5abf-b113-fb4f48614ee7 with identifier: VO62%20VVP
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Electric HTTP/1.1" 200 None
2026-03-28 22:03:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 22:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f1a765bb-ac90-5abf-b113-fb4f48614ee7 with identifier: VO62%20VVP
2026-03-28 22:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f1a765bb-ac90-5abf-b113-fb4f48614ee7 with identifier: VO62%20VVP to the API
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO62%20VVP-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Electric',
'id': 'f1a765bb-ac90-5abf-b113-fb4f48614ee7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VO62 VVP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VO62%20VVP&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'NISSAN',
'model': 'LEAF',
'odometer': 80987,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'NISSAN LEAF Hatchback',
'transmission': 'automatic',
'trim': '',
'vin': 'JN1FAAZE0U0013252',
'year': 2012}
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO62%2520VVP%27 HTTP/1.1" 200 None
2026-03-28 22:03:34 [bca.uk] INFO: Saving data for VO62%20VVP: {'auction_closing_time': 1774864800.0, 'created_time': 1774352680.721232, 'last_price_update_time': 1774735414.675484}
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VO62%2520VVP') HTTP/1.1" 204 0
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D686249352%27 HTTP/1.1" 200 None
2026-03-28 22:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=686249352 not downloaded yet
2026-03-28 22:03:34 [bca.uk] INFO: Found listing with ID: BJ07%20JAO
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ07%2520JAO%27 HTTP/1.1" 200 None
2026-03-28 22:03:34 [bca.uk] INFO: Scrape type for BJ07%20JAO: 0
2026-03-28 22:03:34 [bca.uk] INFO: Found listing with ID: YY62%20EHO
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY62%2520EHO%27 HTTP/1.1" 200 None
2026-03-28 22:03:34 [bca.uk] INFO: Scrape type for YY62%20EHO: 0
2026-03-28 22:03:34 [bca.uk] INFO: Found listing with ID: NU62%20FVV
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU62%2520FVV%27 HTTP/1.1" 200 None
2026-03-28 22:03:34 [bca.uk] INFO: Scrape type for NU62%20FVV: 0
2026-03-28 22:03:34 [bca.uk] INFO: Found listing with ID: YR60%20HSF
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR60%2520HSF%27 HTTP/1.1" 200 None
2026-03-28 22:03:34 [bca.uk] INFO: Scrape type for YR60%20HSF: 0
2026-03-28 22:03:34 [bca.uk] INFO: Found listing with ID: YE15%20JYC
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE15%2520JYC%27 HTTP/1.1" 200 None
2026-03-28 22:03:34 [bca.uk] INFO: Scrape type for YE15%20JYC: 0
2026-03-28 22:03:34 [bca.uk] INFO: Found listing with ID: VO63%20XSD
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO63%2520XSD%27 HTTP/1.1" 200 None
2026-03-28 22:03:34 [bca.uk] INFO: Scrape type for VO63%20XSD: 0
2026-03-28 22:03:34 [bca.uk] INFO: Found listing with ID: VK16%20BTV
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK16%2520BTV%27 HTTP/1.1" 200 None
2026-03-28 22:03:34 [bca.uk] INFO: Scrape type for VK16%20BTV: 0
2026-03-28 22:03:34 [bca.uk] INFO: Found listing with ID: RV60%20TZO
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV60%2520TZO%27 HTTP/1.1" 200 None
2026-03-28 22:03:34 [bca.uk] INFO: Scrape type for RV60%20TZO: 0
2026-03-28 22:03:34 [bca.uk] INFO: Found listing with ID: LG08%20RMU
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG08%2520RMU%27 HTTP/1.1" 200 None
2026-03-28 22:03:34 [bca.uk] INFO: Scrape type for LG08%20RMU: 0
2026-03-28 22:03:34 [bca.uk] INFO: Found listing with ID: HY60%20RUC
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY60%2520RUC%27 HTTP/1.1" 200 None
2026-03-28 22:03:34 [bca.uk] INFO: Scrape type for HY60%20RUC: 0
2026-03-28 22:03:34 [bca.uk] INFO: Found listing with ID: HV08%20XHP
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV08%2520XHP%27 HTTP/1.1" 200 None
2026-03-28 22:03:34 [bca.uk] INFO: Scrape type for HV08%20XHP: 0
2026-03-28 22:03:34 [bca.uk] INFO: Found listing with ID: GL11%20XOW
2026-03-28 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL11%2520XOW%27 HTTP/1.1" 200 None
2026-03-28 22:03:35 [bca.uk] INFO: Scrape type for GL11%20XOW: 0
2026-03-28 22:03:35 [bca.uk] INFO: Found listing with ID: LN10%20VMY
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN10%2520VMY%27 HTTP/1.1" 200 None
2026-03-28 22:03:35 [bca.uk] INFO: Scrape type for LN10%20VMY: 0
2026-03-28 22:03:35 [bca.uk] INFO: Found listing with ID: LK64%20NEJ
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK64%2520NEJ%27 HTTP/1.1" 200 None
2026-03-28 22:03:35 [bca.uk] INFO: Scrape type for LK64%20NEJ: 0
2026-03-28 22:03:35 [bca.uk] INFO: Found listing with ID: LD62%20NNR
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD62%2520NNR%27 HTTP/1.1" 200 None
2026-03-28 22:03:35 [bca.uk] INFO: Scrape type for LD62%20NNR: 0
2026-03-28 22:03:35 [bca.uk] INFO: Found listing with ID: KM11%20UUD
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM11%2520UUD%27 HTTP/1.1" 200 None
2026-03-28 22:03:35 [bca.uk] INFO: Scrape type for KM11%20UUD: 0
2026-03-28 22:03:35 [bca.uk] INFO: Found listing with ID: ST59%20MKN
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST59%2520MKN%27 HTTP/1.1" 200 None
2026-03-28 22:03:35 [bca.uk] INFO: Scrape type for ST59%20MKN: 1
2026-03-28 22:03:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72cdde96-e9b7-5650-a0c3-4625bb35dd6e with identifier: ST59%20MKN
2026-03-28 22:03:35 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 72cdde96-e9b7-5650-a0c3-4625bb35dd6e
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010846%27 HTTP/1.1" 200 None
2026-03-28 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010846 not downloaded yet
2026-03-28 22:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038268/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK23XXL/42810961?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=HIraPhBD5waa9seHUB8yTzip4V%2BkelIT5vdZTBzO1L4%3D)
2026-03-28 22:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039802/600> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039804/600> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D684814041%27 HTTP/1.1" 200 None
2026-03-28 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=684814041 not downloaded yet
2026-03-28 22:03:35 [bca.uk] INFO: Found listing with ID: GK61%20NMX
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK61%2520NMX%27 HTTP/1.1" 200 None
2026-03-28 22:03:35 [bca.uk] INFO: Scrape type for GK61%20NMX: 0
2026-03-28 22:03:35 [bca.uk] INFO: Found listing with ID: EN10%20PWV
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN10%2520PWV%27 HTTP/1.1" 200 None
2026-03-28 22:03:35 [bca.uk] INFO: Scrape type for EN10%20PWV: 0
2026-03-28 22:03:35 [bca.uk] INFO: Found listing with ID: BN10%20FFD
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN10%2520FFD%27 HTTP/1.1" 200 None
2026-03-28 22:03:35 [bca.uk] INFO: Scrape type for BN10%20FFD: 0
2026-03-28 22:03:35 [bca.uk] INFO: Found listing with ID: AV13%20PZZ
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV13%2520PZZ%27 HTTP/1.1" 200 None
2026-03-28 22:03:35 [bca.uk] INFO: Scrape type for AV13%20PZZ: 0
2026-03-28 22:03:35 [bca.uk] INFO: Found listing with ID: CV62%20UAZ
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV62%2520UAZ%27 HTTP/1.1" 200 None
2026-03-28 22:03:35 [bca.uk] INFO: Scrape type for CV62%20UAZ: 0
2026-03-28 22:03:35 [bca.uk] INFO: Found listing with ID: MV07%20KUJ
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV07%2520KUJ%27 HTTP/1.1" 200 None
2026-03-28 22:03:35 [bca.uk] INFO: Scrape type for MV07%20KUJ: 0
2026-03-28 22:03:35 [bca.uk] INFO: Found listing with ID: DG15%20HYL
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG15%2520HYL%27 HTTP/1.1" 200 None
2026-03-28 22:03:35 [bca.uk] INFO: Scrape type for DG15%20HYL: 1
2026-03-28 22:03:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5665b770-c5fc-5a05-b9d2-8e8d129df67b with identifier: DG15%20HYL
2026-03-28 22:03:35 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5665b770-c5fc-5a05-b9d2-8e8d129df67b
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010858%27 HTTP/1.1" 200 None
2026-03-28 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010858 not downloaded yet
2026-03-28 22:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55498cf50>
2026-03-28 22:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bb0eb2-42f3-5cb2-b21b-580137f2554b/74bb0eb2-42f3-5cb2-b21b-580137f2554b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP15VFV%252F689039798%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039798/600 saved to cache
2026-03-28 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 74bb0eb2-42f3-5cb2-b21b-580137f2554b
2026-03-28 22:03:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554942210>
2026-03-28 22:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ba462d-c70d-5156-b443-d7d5e76250e2/a4ba462d-c70d-5156-b443-d7d5e76250e2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF19KHM%252F699252171%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252171/600 saved to cache
2026-03-28 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a4ba462d-c70d-5156-b443-d7d5e76250e2
2026-03-28 22:03:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547c7190>
2026-03-28 22:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f78646-9cef-5fc7-bd80-803ea7a167c9/47f78646-9cef-5fc7-bd80-803ea7a167c9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK23XXL%252F699038250%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038250/600 saved to cache
2026-03-28 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 47f78646-9cef-5fc7-bd80-803ea7a167c9
2026-03-28 22:03:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54717e810>
2026-03-28 22:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f78646-9cef-5fc7-bd80-803ea7a167c9/47f78646-9cef-5fc7-bd80-803ea7a167c9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK23XXL%252F699038232%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038232/600 saved to cache
2026-03-28 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 47f78646-9cef-5fc7-bd80-803ea7a167c9
2026-03-28 22:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OU64UPA/42811127?sv=2020-08-04&st=2026-03-28T22%3A03%3A31Z&se=2026-03-28T22%3A28%3A31Z&sr=b&sp=r&sig=8BqSQERI1JQCVBe1x8fbzIsYG%2BShES3mtYstvdJ8vEg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038288/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK23XXL/42810961?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=HIraPhBD5waa9seHUB8yTzip4V%2BkelIT5vdZTBzO1L4%3D)
2026-03-28 22:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW67HUY/42806780?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=IjccUHM%2BUsRolC4agemnjyYj%2By8q%2BaL%2Bv6NarfY2Bpc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV65GFU/42810585?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=Uw05gug7lwLgV7s2MX8pmDxdS7jFiOh93SlRxrnK0ts%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU67EBV/42807577?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=Dc9GP37lnEoc8Ucnf7mZMpnnsmm75eM47cbqeVO4%2BUo%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D686249382%27 HTTP/1.1" 200 None
2026-03-28 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=686249382 not downloaded yet
2026-03-28 22:03:35 [bca.uk] INFO: Found listing with ID: DK61%20ZMO
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK61%2520ZMO%27 HTTP/1.1" 200 None
2026-03-28 22:03:35 [bca.uk] INFO: Scrape type for DK61%20ZMO: 1
2026-03-28 22:03:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68a22924-d609-517c-89c8-3ff469c2635b with identifier: DK61%20ZMO
2026-03-28 22:03:35 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 68a22924-d609-517c-89c8-3ff469c2635b
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010885%27 HTTP/1.1" 200 None
2026-03-28 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010885 not downloaded yet
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D684814047%27 HTTP/1.1" 200 None
2026-03-28 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=684814047 not downloaded yet
2026-03-28 22:03:35 [bca.uk] INFO: Found listing with ID: HN64%20NHD
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN64%2520NHD%27 HTTP/1.1" 200 None
2026-03-28 22:03:35 [bca.uk] INFO: Scrape type for HN64%20NHD: 0
2026-03-28 22:03:35 [bca.uk] INFO: Found listing with ID: BG65%20SWK
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG65%2520SWK%27 HTTP/1.1" 200 None
2026-03-28 22:03:35 [bca.uk] INFO: Scrape type for BG65%20SWK: 2
2026-03-28 22:03:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07f698f9-ba8c-53bf-8a4b-9ddb1dbcb7db with identifier: BG65%20SWK
2026-03-28 22:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07f698f9-ba8c-53bf-8a4b-9ddb1dbcb7db with scrape type 2
2026-03-28 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07f698f9-ba8c-53bf-8a4b-9ddb1dbcb7db with scrape type 2
2026-03-28 22:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 07f698f9-ba8c-53bf-8a4b-9ddb1dbcb7db, identifier: BG65%20SWK
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010906%27 HTTP/1.1" 200 None
2026-03-28 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010906 not downloaded yet
2026-03-28 22:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 07f698f9-ba8c-53bf-8a4b-9ddb1dbcb7db with identifier: BG65%20SWK
2026-03-28 22:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 07f698f9-ba8c-53bf-8a4b-9ddb1dbcb7db with identifier: BG65%20SWK
2026-03-28 22:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 07f698f9-ba8c-53bf-8a4b-9ddb1dbcb7db with identifier: BG65%20SWK to the API
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BG65%20SWK-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '07f698f9-ba8c-53bf-8a4b-9ddb1dbcb7db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BG65 SWK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BG65%20SWK&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'VAUXHALL',
'model': 'INSIGNIA',
'odometer': 116582,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VAUXHALL INSIGNIA 1.6 CDTI 136 E/F TECH LINE S/S Hatchback',
'transmission': 'manual',
'trim': 'CDTI 136 E/F TECH LINE S/S',
'vin': 'W0LGT6E3XG1019573',
'year': 2015}
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG65%2520SWK%27 HTTP/1.1" 200 None
2026-03-28 22:03:36 [bca.uk] INFO: Saving data for BG65%20SWK: {'auction_closing_time': 1774778400.0, 'created_time': 1774621716.978088, 'last_price_update_time': 1774735416.090893}
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BG65%2520SWK') HTTP/1.1" 204 0
2026-03-28 22:03:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554acf910>
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f78646-9cef-5fc7-bd80-803ea7a167c9/47f78646-9cef-5fc7-bd80-803ea7a167c9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK23XXL%252F699038268%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038268/600 saved to cache
2026-03-28 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 47f78646-9cef-5fc7-bd80-803ea7a167c9
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473e8790>
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bb0eb2-42f3-5cb2-b21b-580137f2554b/74bb0eb2-42f3-5cb2-b21b-580137f2554b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP15VFV%252F689039802%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039802/600 saved to cache
2026-03-28 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 74bb0eb2-42f3-5cb2-b21b-580137f2554b
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54717ea50>
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bb0eb2-42f3-5cb2-b21b-580137f2554b/74bb0eb2-42f3-5cb2-b21b-580137f2554b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP15VFV%252F689039804%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039804/600 saved to cache
2026-03-28 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 74bb0eb2-42f3-5cb2-b21b-580137f2554b
2026-03-28 22:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039807/600> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814014/600> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814031/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=684814031>
2026-03-28 22:03:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010796/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010796>
2026-03-28 22:03:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814026/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=684814026>
2026-03-28 22:03:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010763/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010763>
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D684814049%27 HTTP/1.1" 200 None
2026-03-28 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=684814049 not downloaded yet
2026-03-28 22:03:36 [bca.uk] INFO: Found listing with ID: KU57%20WZP
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU57%2520WZP%27 HTTP/1.1" 200 None
2026-03-28 22:03:36 [bca.uk] INFO: Scrape type for KU57%20WZP: 1
2026-03-28 22:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbb13ef4-19c8-586c-a4d2-93af637cef56 with identifier: KU57%20WZP
2026-03-28 22:03:36 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item bbb13ef4-19c8-586c-a4d2-93af637cef56
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010936%27 HTTP/1.1" 200 None
2026-03-28 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010936 not downloaded yet
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b7b750>
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4f2d0a0-2885-57c7-ae21-ea61c25273d9/d4f2d0a0-2885-57c7-ae21-ea61c25273d9_expert_report_file_dbc32de7-0b57-4cc5-80cf-5a33b1add5af.pdf HTTP/1.1" 201 0
2026-03-28 22:03:36 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d4f2d0a0-2885-57c7-ae21-ea61c25273d9
2026-03-28 22:03:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4f2d0a0-2885-57c7-ae21-ea61c25273d9, skipping ID generation
2026-03-28 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d4f2d0a0-2885-57c7-ae21-ea61c25273d9
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DOU64UPA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OU64UPA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548f7c50>
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f78646-9cef-5fc7-bd80-803ea7a167c9/47f78646-9cef-5fc7-bd80-803ea7a167c9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK23XXL%252F699038288%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038288/600 saved to cache
2026-03-28 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 47f78646-9cef-5fc7-bd80-803ea7a167c9
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542d2cd0>
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3649b9f8-64ee-584f-9d2b-f46b1db86e38/3649b9f8-64ee-584f-9d2b-f46b1db86e38_expert_report_file_53ed197e-1052-476f-a879-094672ab0979.pdf HTTP/1.1" 201 0
2026-03-28 22:03:36 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3649b9f8-64ee-584f-9d2b-f46b1db86e38
2026-03-28 22:03:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3649b9f8-64ee-584f-9d2b-f46b1db86e38, skipping ID generation
2026-03-28 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3649b9f8-64ee-584f-9d2b-f46b1db86e38
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKW67HUY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KW67HUY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548d4e50>
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63a9213b-9753-5663-b464-16226cca8eb4/63a9213b-9753-5663-b464-16226cca8eb4_expert_report_file_0ac80d8a-b022-425c-a22a-925aad22c91f.pdf HTTP/1.1" 201 0
2026-03-28 22:03:36 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 63a9213b-9753-5663-b464-16226cca8eb4
2026-03-28 22:03:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63a9213b-9753-5663-b464-16226cca8eb4, skipping ID generation
2026-03-28 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 63a9213b-9753-5663-b464-16226cca8eb4
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DOV65GFU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OV65GFU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55498c710>
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d00f4d6-3827-55c1-a06a-583364af76a6/2d00f4d6-3827-55c1-a06a-583364af76a6_expert_report_file_252fc9db-361e-4725-a692-a9dcb1641540.pdf HTTP/1.1" 201 0
2026-03-28 22:03:36 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2d00f4d6-3827-55c1-a06a-583364af76a6
2026-03-28 22:03:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d00f4d6-3827-55c1-a06a-583364af76a6, skipping ID generation
2026-03-28 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2d00f4d6-3827-55c1-a06a-583364af76a6
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNU67EBV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NU67EBV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:36 [bca.uk] INFO: Found listing with ID: AF20%20XNC
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF20%2520XNC%27 HTTP/1.1" 200 None
2026-03-28 22:03:36 [bca.uk] INFO: Scrape type for AF20%20XNC: 1
2026-03-28 22:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78b0421d-18ef-5012-9f9a-61cd23cc4cf6 with identifier: AF20%20XNC
2026-03-28 22:03:36 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 78b0421d-18ef-5012-9f9a-61cd23cc4cf6
2026-03-28 22:03:36 [bca.uk] INFO: Found listing with ID: KY58%20DDF
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY58%2520DDF%27 HTTP/1.1" 200 None
2026-03-28 22:03:36 [bca.uk] INFO: Scrape type for KY58%20DDF: 2
2026-03-28 22:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b93e7f6f-f9b0-5da5-bcd2-2f4822ea58df with identifier: KY58%20DDF
2026-03-28 22:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b93e7f6f-f9b0-5da5-bcd2-2f4822ea58df with scrape type 2
2026-03-28 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b93e7f6f-f9b0-5da5-bcd2-2f4822ea58df with scrape type 2
2026-03-28 22:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b93e7f6f-f9b0-5da5-bcd2-2f4822ea58df, identifier: KY58%20DDF
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010971%27 HTTP/1.1" 200 None
2026-03-28 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010971 not downloaded yet
2026-03-28 22:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY66XSJ/42810063?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=n4o%2FwpUrt5NmnHO4b%2FuTK0GIrxHv%2BFYQBHPaaSLhQm0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK11NXR/42811064?sv=2020-08-04&st=2026-03-28T22%3A03%3A33Z&se=2026-03-28T22%3A28%3A33Z&sr=b&sp=r&sig=WQwb7hHALscNLn8OXQjUUwD9ln4%2BEG5I6c0xHH7%2BOPc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b93e7f6f-f9b0-5da5-bcd2-2f4822ea58df with identifier: KY58%20DDF
2026-03-28 22:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b93e7f6f-f9b0-5da5-bcd2-2f4822ea58df with identifier: KY58%20DDF
2026-03-28 22:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b93e7f6f-f9b0-5da5-bcd2-2f4822ea58df with identifier: KY58%20DDF to the API
2026-03-28 22:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 186,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KY58%20DDF-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b93e7f6f-f9b0-5da5-bcd2-2f4822ea58df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KY58 DDF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KY58%20DDF&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 97055,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.8 VVT DESIGN Hatchback',
'transmission': 'automatic',
'trim': 'VVT DESIGN',
'vin': 'W0L0AHL4888123037',
'year': 2008}
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY58%2520DDF%27 HTTP/1.1" 200 None
2026-03-28 22:03:37 [bca.uk] INFO: Saving data for KY58%20DDF: {'auction_closing_time': 1774864800.0, 'created_time': 1774505153.943372, 'last_price_update_time': 1774735417.193711}
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KY58%2520DDF') HTTP/1.1" 204 0
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145943%27 HTTP/1.1" 200 None
2026-03-28 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145943 not downloaded yet
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251632%27 HTTP/1.1" 200 None
2026-03-28 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251632 not downloaded yet
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994433%27 HTTP/1.1" 200 None
2026-03-28 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994433 not downloaded yet
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189226%27 HTTP/1.1" 200 None
2026-03-28 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189226 not downloaded yet
2026-03-28 22:03:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010846/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010846>
2026-03-28 22:03:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010858/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010858>
2026-03-28 22:03:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/686249352/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=686249352>
2026-03-28 22:03:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814041/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=684814041>
2026-03-28 22:03:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG15HYL/42810937?sv=2020-08-04&st=2026-03-28T22%3A03%3A36Z&se=2026-03-28T22%3A28%3A36Z&sr=b&sp=r&sig=5%2Bm9q%2BE0Wl4g8RZLCygI%2BKewbEkOWA68pXi4u14HhvE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DG15%20HYL-GB>
2026-03-28 22:03:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST59MKN/42810519?sv=2020-08-04&st=2026-03-28T22%3A03%3A36Z&se=2026-03-28T22%3A28%3A36Z&sr=b&sp=r&sig=qdxvmwQC9M%2F12MyUbvpDYZ0p8e9m0rs2kGxmuCWXYT4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ST59%20MKN-GB>
2026-03-28 22:03:37 [bca.uk] INFO: Found listing with ID: LX62%20RKE
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX62%2520RKE%27 HTTP/1.1" 200 None
2026-03-28 22:03:37 [bca.uk] INFO: Scrape type for LX62%20RKE: 1
2026-03-28 22:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ad57269-af6f-5f89-b6bd-0f6f92938d2b with identifier: LX62%20RKE
2026-03-28 22:03:37 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2ad57269-af6f-5f89-b6bd-0f6f92938d2b
2026-03-28 22:03:37 [bca.uk] INFO: Found listing with ID: LT55%20XAG
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT55%2520XAG%27 HTTP/1.1" 200 None
2026-03-28 22:03:37 [bca.uk] INFO: Scrape type for LT55%20XAG: 0
2026-03-28 22:03:37 [bca.uk] INFO: Found listing with ID: RO59%20VYY
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO59%2520VYY%27 HTTP/1.1" 200 None
2026-03-28 22:03:37 [bca.uk] INFO: Scrape type for RO59%20VYY: 0
2026-03-28 22:03:37 [bca.uk] INFO: Found listing with ID: EA59%20HXN
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA59%2520HXN%27 HTTP/1.1" 200 None
2026-03-28 22:03:37 [bca.uk] INFO: Scrape type for EA59%20HXN: 2
2026-03-28 22:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7fedd12-6fbb-5184-a0b0-01f166ed4c7b with identifier: EA59%20HXN
2026-03-28 22:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7fedd12-6fbb-5184-a0b0-01f166ed4c7b with scrape type 2
2026-03-28 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7fedd12-6fbb-5184-a0b0-01f166ed4c7b with scrape type 2
2026-03-28 22:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f7fedd12-6fbb-5184-a0b0-01f166ed4c7b, identifier: EA59%20HXN
2026-03-28 22:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b2ad10>
2026-03-28 22:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bb0eb2-42f3-5cb2-b21b-580137f2554b/74bb0eb2-42f3-5cb2-b21b-580137f2554b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP15VFV%252F689039807%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039807/600 saved to cache
2026-03-28 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 74bb0eb2-42f3-5cb2-b21b-580137f2554b
2026-03-28 22:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473eb790>
2026-03-28 22:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c98b2cc3-a1ec-5194-ae49-df6d05e42077/c98b2cc3-a1ec-5194-ae49-df6d05e42077_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST64MMV%252F684814014%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814014/600 saved to cache
2026-03-28 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c98b2cc3-a1ec-5194-ae49-df6d05e42077
2026-03-28 22:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f7fedd12-6fbb-5184-a0b0-01f166ed4c7b with identifier: EA59%20HXN
2026-03-28 22:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f7fedd12-6fbb-5184-a0b0-01f166ed4c7b with identifier: EA59%20HXN
2026-03-28 22:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f7fedd12-6fbb-5184-a0b0-01f166ed4c7b with identifier: EA59%20HXN to the API
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 155,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EA59%20HXN-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f7fedd12-6fbb-5184-a0b0-01f166ed4c7b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EA59 HXN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EA59%20HXN&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 75615,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.6 VVT 115 SXI Hatchback',
'transmission': 'manual',
'trim': 'VVT 115 SXI',
'vin': 'W0L0AHL08A5014141',
'year': 2009}
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA59%2520HXN%27 HTTP/1.1" 200 None
2026-03-28 22:03:37 [bca.uk] INFO: Saving data for EA59%20HXN: {'auction_closing_time': 1774864800.0, 'created_time': 1774621543.408677, 'last_price_update_time': 1774735417.899978}
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EA59%2520HXN') HTTP/1.1" 204 0
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145949%27 HTTP/1.1" 200 None
2026-03-28 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145949 not downloaded yet
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251640%27 HTTP/1.1" 200 None
2026-03-28 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251640 not downloaded yet
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994457%27 HTTP/1.1" 200 None
2026-03-28 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994457 not downloaded yet
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189232%27 HTTP/1.1" 200 None
2026-03-28 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189232 not downloaded yet
2026-03-28 22:03:37 [bca.uk] INFO: Found listing with ID: SW19%20FWZ
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW19%2520FWZ%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [bca.uk] INFO: Scrape type for SW19%20FWZ: 1
2026-03-28 22:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91ccc5b9-c785-59f2-b3e3-b519a80bbf9e with identifier: SW19%20FWZ
2026-03-28 22:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91ccc5b9-c785-59f2-b3e3-b519a80bbf9e with scrape type 1
2026-03-28 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 91ccc5b9-c785-59f2-b3e3-b519a80bbf9e
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSW19FWZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SW19FWZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:38 [bca.uk] INFO: Found listing with ID: GJ68%20EYU
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ68%2520EYU%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [bca.uk] INFO: Scrape type for GJ68%20EYU: 1
2026-03-28 22:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4 with identifier: GJ68%20EYU
2026-03-28 22:03:38 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4
2026-03-28 22:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010796/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN68YYB/42810746?sv=2020-08-04&st=2026-03-28T22%3A03%3A29Z&se=2026-03-28T22%3A28%3A29Z&sr=b&sp=r&sig=wILsmg9cR%2BC5ELYsaDqFarEwRxBfh8Z9P1%2FXmbnSdGw%3D)
2026-03-28 22:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814047/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=684814047>
2026-03-28 22:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010906/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010906>
2026-03-28 22:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/686249341/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=686249341>
2026-03-28 22:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010816/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010816>
2026-03-28 22:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010763/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN68YYB/42810746?sv=2020-08-04&st=2026-03-28T22%3A03%3A29Z&se=2026-03-28T22%3A28%3A29Z&sr=b&sp=r&sig=wILsmg9cR%2BC5ELYsaDqFarEwRxBfh8Z9P1%2FXmbnSdGw%3D)
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145954%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145954 not downloaded yet
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251644%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251644 not downloaded yet
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994471%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994471 not downloaded yet
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189239%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189239 not downloaded yet
2026-03-28 22:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549b2a10>
2026-03-28 22:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b40829-d997-5432-a0e4-0fd30767ce9e/43b40829-d997-5432-a0e4-0fd30767ce9e_expert_report_file_f124eec1-e91d-4d0e-b0d2-82e282594bfb.pdf HTTP/1.1" 201 0
2026-03-28 22:03:38 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 43b40829-d997-5432-a0e4-0fd30767ce9e
2026-03-28 22:03:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43b40829-d997-5432-a0e4-0fd30767ce9e, skipping ID generation
2026-03-28 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43b40829-d997-5432-a0e4-0fd30767ce9e
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKY66XSJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KY66XSJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b0e910>
2026-03-28 22:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f/cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f_expert_report_file_9b59bebc-d6dc-4a74-affb-896bf8b4e860.pdf HTTP/1.1" 201 0
2026-03-28 22:03:38 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f
2026-03-28 22:03:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f, skipping ID generation
2026-03-28 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAK11NXR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AK11NXR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814026/600> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814031/600> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:38 [bca.uk] INFO: Found listing with ID: KT15%20GYV
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT15%2520GYV%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [bca.uk] INFO: Scrape type for KT15%20GYV: 0
2026-03-28 22:03:38 [bca.uk] INFO: Found listing with ID: CU71%20VTC
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU71%2520VTC%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [bca.uk] INFO: Scrape type for CU71%20VTC: 0
2026-03-28 22:03:38 [bca.uk] INFO: Found listing with ID: SR21%20XPN
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR21%2520XPN%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [bca.uk] INFO: Scrape type for SR21%20XPN: 0
2026-03-28 22:03:38 [bca.uk] INFO: Found listing with ID: ST72%20OPY
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST72%2520OPY%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [bca.uk] INFO: Scrape type for ST72%20OPY: 0
2026-03-28 22:03:38 [bca.uk] INFO: Found listing with ID: ST72%20OSN
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST72%2520OSN%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [bca.uk] INFO: Scrape type for ST72%20OSN: 2
2026-03-28 22:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faac7e05-80dd-59ba-9e57-f65529be8812 with identifier: ST72%20OSN
2026-03-28 22:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faac7e05-80dd-59ba-9e57-f65529be8812 with scrape type 2
2026-03-28 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faac7e05-80dd-59ba-9e57-f65529be8812 with scrape type 2
2026-03-28 22:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: faac7e05-80dd-59ba-9e57-f65529be8812, identifier: ST72%20OSN
2026-03-28 22:03:38 [bca.uk] INFO: Found listing with ID: KM18%20WKW
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM18%2520WKW%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [bca.uk] INFO: Scrape type for KM18%20WKW: 1
2026-03-28 22:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ab8ad02-8eed-55fd-8bce-08a2c5079d22 with identifier: KM18%20WKW
2026-03-28 22:03:38 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2ab8ad02-8eed-55fd-8bce-08a2c5079d22
2026-03-28 22:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: faac7e05-80dd-59ba-9e57-f65529be8812 with identifier: ST72%20OSN
2026-03-28 22:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: faac7e05-80dd-59ba-9e57-f65529be8812 with identifier: ST72%20OSN
2026-03-28 22:03:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: faac7e05-80dd-59ba-9e57-f65529be8812 with identifier: ST72%20OSN to the API
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ST72%20OSN-GB',
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'faac7e05-80dd-59ba-9e57-f65529be8812',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ST72 OSN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ST72%20OSN&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow',
'make': 'FORD',
'model': 'TRANSIT COURIER',
'odometer': 12631,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'FORD TRANSIT COURIER 1.5 TDCI 100 LEADER (6) Van',
'transmission': 'manual',
'trim': 'TDCI 100 LEADER (6)',
'vin': 'WF0WXXTACWNR67580',
'year': 2022}
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST72%2520OSN%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [bca.uk] INFO: Saving data for ST72%20OSN: {'auction_closing_time': 1775210400.0, 'created_time': 1774535130.4698, 'last_price_update_time': 1774735418.724247}
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ST72%2520OSN') HTTP/1.1" 204 0
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145965%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145965 not downloaded yet
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251648%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251648 not downloaded yet
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994491%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994491 not downloaded yet
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189247%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189247 not downloaded yet
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158266%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158266 not downloaded yet
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699028280%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699028280 not downloaded yet
2026-03-28 22:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814041/600> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010846/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN68YYB/42810746?sv=2020-08-04&st=2026-03-28T22%3A03%3A29Z&se=2026-03-28T22%3A28%3A29Z&sr=b&sp=r&sig=wILsmg9cR%2BC5ELYsaDqFarEwRxBfh8Z9P1%2FXmbnSdGw%3D)
2026-03-28 22:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010858/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN68YYB/42810746?sv=2020-08-04&st=2026-03-28T22%3A03%3A29Z&se=2026-03-28T22%3A28%3A29Z&sr=b&sp=r&sig=wILsmg9cR%2BC5ELYsaDqFarEwRxBfh8Z9P1%2FXmbnSdGw%3D)
2026-03-28 22:03:38 [bca.uk] INFO: Found listing with ID: ST72%20TKU
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST72%2520TKU%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [bca.uk] INFO: Scrape type for ST72%20TKU: 0
2026-03-28 22:03:38 [bca.uk] INFO: Found listing with ID: SY22%20UHR
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY22%2520UHR%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [bca.uk] INFO: Scrape type for SY22%20UHR: 0
2026-03-28 22:03:38 [bca.uk] INFO: Found listing with ID: MD19%20GWP
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD19%2520GWP%27 HTTP/1.1" 200 None
2026-03-28 22:03:38 [bca.uk] INFO: Scrape type for MD19%20GWP: 0
2026-03-28 22:03:38 [bca.uk] INFO: Found listing with ID: DE72%20KZJ
2026-03-28 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE72%2520KZJ%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [bca.uk] INFO: Scrape type for DE72%20KZJ: 0
2026-03-28 22:03:39 [bca.uk] INFO: Found listing with ID: BW21%20EVR
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW21%2520EVR%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [bca.uk] INFO: Scrape type for BW21%20EVR: 1
2026-03-28 22:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96c4f924-7308-5bd2-b24d-6916e1a7f917 with identifier: BW21%20EVR
2026-03-28 22:03:39 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 96c4f924-7308-5bd2-b24d-6916e1a7f917
2026-03-28 22:03:39 [bca.uk] INFO: Found listing with ID: GK19%20LKN
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK19%2520LKN%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [bca.uk] INFO: Scrape type for GK19%20LKN: 1
2026-03-28 22:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dbe411f-6de6-544b-9dbf-532e12cbc18e with identifier: GK19%20LKN
2026-03-28 22:03:39 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2dbe411f-6de6-544b-9dbf-532e12cbc18e
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474e4710>
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37980901-da86-559d-83e6-c8f73f7f2265/37980901-da86-559d-83e6-c8f73f7f2265_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN68YYB%252F699010796%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010796/600 saved to cache
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 37980901-da86-559d-83e6-c8f73f7f2265
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54779c250>
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37980901-da86-559d-83e6-c8f73f7f2265/37980901-da86-559d-83e6-c8f73f7f2265_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN68YYB%252F699010763%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010763/600 saved to cache
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 37980901-da86-559d-83e6-c8f73f7f2265
2026-03-28 22:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010971/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010971>
2026-03-28 22:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF20XNC/42807954?sv=2020-08-04&st=2026-03-28T22%3A03%3A38Z&se=2026-03-28T22%3A28%3A38Z&sr=b&sp=r&sig=HqECq2nNVAmAiFdZnnkNsAZVF%2FHK3rToWPsQPkpm8YM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AF20%20XNC-GB>
2026-03-28 22:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/686249352/600> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145971%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145971 not downloaded yet
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251656%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251656 not downloaded yet
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994507%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994507 not downloaded yet
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189252%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189252 not downloaded yet
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158274%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158274 not downloaded yet
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699028281%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699028281 not downloaded yet
2026-03-28 22:03:39 [bca.uk] INFO: Found listing with ID: CA19%20YWE
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA19%2520YWE%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [bca.uk] INFO: Scrape type for CA19%20YWE: 1
2026-03-28 22:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 425c7b94-e605-550f-9362-6af12cc1998a with identifier: CA19%20YWE
2026-03-28 22:03:39 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 425c7b94-e605-550f-9362-6af12cc1998a
2026-03-28 22:03:39 [bca.uk] INFO: Found listing with ID: GF07%20MDE
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF07%2520MDE%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [bca.uk] INFO: Scrape type for GF07%20MDE: 1
2026-03-28 22:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37d65eaf-0634-5a3f-9af8-91f997434603 with identifier: GF07%20MDE
2026-03-28 22:03:39 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 37d65eaf-0634-5a3f-9af8-91f997434603
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54731b710>
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c98b2cc3-a1ec-5194-ae49-df6d05e42077/c98b2cc3-a1ec-5194-ae49-df6d05e42077_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST64MMV%252F684814026%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814026/600 saved to cache
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c98b2cc3-a1ec-5194-ae49-df6d05e42077
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554271a50>
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c98b2cc3-a1ec-5194-ae49-df6d05e42077/c98b2cc3-a1ec-5194-ae49-df6d05e42077_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST64MMV%252F684814031%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814031/600 saved to cache
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c98b2cc3-a1ec-5194-ae49-df6d05e42077
2026-03-28 22:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010906/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN68YYB/42810746?sv=2020-08-04&st=2026-03-28T22%3A03%3A29Z&se=2026-03-28T22%3A28%3A29Z&sr=b&sp=r&sig=wILsmg9cR%2BC5ELYsaDqFarEwRxBfh8Z9P1%2FXmbnSdGw%3D)
2026-03-28 22:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010816/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN68YYB/42810746?sv=2020-08-04&st=2026-03-28T22%3A03%3A29Z&se=2026-03-28T22%3A28%3A29Z&sr=b&sp=r&sig=wILsmg9cR%2BC5ELYsaDqFarEwRxBfh8Z9P1%2FXmbnSdGw%3D)
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145984%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145984 not downloaded yet
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251669%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251669 not downloaded yet
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994528%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994528 not downloaded yet
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189266%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189266 not downloaded yet
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158281%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158281 not downloaded yet
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699028282%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699028282 not downloaded yet
2026-03-28 22:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG15HYL/42810937?sv=2020-08-04&st=2026-03-28T22%3A03%3A36Z&se=2026-03-28T22%3A28%3A36Z&sr=b&sp=r&sig=5%2Bm9q%2BE0Wl4g8RZLCygI%2BKewbEkOWA68pXi4u14HhvE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/686249341/600> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:39 [bca.uk] INFO: Found listing with ID: HL19%20RNJ
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HL19%2520RNJ%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [bca.uk] INFO: Scrape type for HL19%20RNJ: 1
2026-03-28 22:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f3b828e-d75c-5ff7-a14e-22edf0b6b900 with identifier: HL19%20RNJ
2026-03-28 22:03:39 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1f3b828e-d75c-5ff7-a14e-22edf0b6b900
2026-03-28 22:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST59MKN/42810519?sv=2020-08-04&st=2026-03-28T22%3A03%3A36Z&se=2026-03-28T22%3A28%3A36Z&sr=b&sp=r&sig=qdxvmwQC9M%2F12MyUbvpDYZ0p8e9m0rs2kGxmuCWXYT4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814047/600> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994457/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994457>
2026-03-28 22:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189232/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189232>
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146002%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146002 not downloaded yet
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251684%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251684 not downloaded yet
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994549%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994549 not downloaded yet
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189278%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189278 not downloaded yet
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158291%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158291 not downloaded yet
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699028283%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699028283 not downloaded yet
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555032c10>
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c98b2cc3-a1ec-5194-ae49-df6d05e42077/c98b2cc3-a1ec-5194-ae49-df6d05e42077_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST64MMV%252F684814041%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814041/600 saved to cache
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c98b2cc3-a1ec-5194-ae49-df6d05e42077
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543d15d0>
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37980901-da86-559d-83e6-c8f73f7f2265/37980901-da86-559d-83e6-c8f73f7f2265_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN68YYB%252F699010846%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010846/600 saved to cache
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 37980901-da86-559d-83e6-c8f73f7f2265
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547658490>
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37980901-da86-559d-83e6-c8f73f7f2265/37980901-da86-559d-83e6-c8f73f7f2265_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN68YYB%252F699010858%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010858/600 saved to cache
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 37980901-da86-559d-83e6-c8f73f7f2265
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554378050>
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c98b2cc3-a1ec-5194-ae49-df6d05e42077/c98b2cc3-a1ec-5194-ae49-df6d05e42077_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST64MMV%252F686249352%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/686249352/600 saved to cache
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c98b2cc3-a1ec-5194-ae49-df6d05e42077
2026-03-28 22:03:39 [bca.uk] INFO: Found listing with ID: KF19%20DKY
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF19%2520DKY%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [bca.uk] INFO: Scrape type for KF19%20DKY: 1
2026-03-28 22:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3f29b60-3863-5769-bd32-0a73da36e20b with identifier: KF19%20DKY
2026-03-28 22:03:39 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f3f29b60-3863-5769-bd32-0a73da36e20b
2026-03-28 22:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SW19FWZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ68EYU/42810875?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=mBNLdGQbm1DhNN1S4GccP%2FZY1Fjg8xcp9xUKQWMBqqA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ68%20EYU-GB>
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146018%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146018 not downloaded yet
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251699%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251699 not downloaded yet
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994573%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994573 not downloaded yet
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189292%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189292 not downloaded yet
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158295%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158295 not downloaded yet
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699028284%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699028284 not downloaded yet
2026-03-28 22:03:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b01910>
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37980901-da86-559d-83e6-c8f73f7f2265/37980901-da86-559d-83e6-c8f73f7f2265_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN68YYB%252F699010906%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010906/600 saved to cache
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 37980901-da86-559d-83e6-c8f73f7f2265
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472ab7d0>
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37980901-da86-559d-83e6-c8f73f7f2265/37980901-da86-559d-83e6-c8f73f7f2265_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN68YYB%252F699010816%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010816/600 saved to cache
2026-03-28 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 37980901-da86-559d-83e6-c8f73f7f2265
2026-03-28 22:03:39 [bca.uk] INFO: Found listing with ID: LG72%20UJY
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG72%2520UJY%27 HTTP/1.1" 200 None
2026-03-28 22:03:39 [bca.uk] INFO: Scrape type for LG72%20UJY: 1
2026-03-28 22:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55409954-1173-5276-a10a-2f132fbeb032 with identifier: LG72%20UJY
2026-03-28 22:03:39 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 55409954-1173-5276-a10a-2f132fbeb032
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5476213d0>
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5665b770-c5fc-5a05-b9d2-8e8d129df67b/5665b770-c5fc-5a05-b9d2-8e8d129df67b_expert_report_file_1cad6454-d6fb-4d25-8b07-49367f48a2b8.pdf HTTP/1.1" 201 0
2026-03-28 22:03:40 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5665b770-c5fc-5a05-b9d2-8e8d129df67b
2026-03-28 22:03:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5665b770-c5fc-5a05-b9d2-8e8d129df67b, skipping ID generation
2026-03-28 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5665b770-c5fc-5a05-b9d2-8e8d129df67b
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDG15HYL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DG15HYL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554357a10>
2026-03-28 22:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c98b2cc3-a1ec-5194-ae49-df6d05e42077/c98b2cc3-a1ec-5194-ae49-df6d05e42077_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST64MMV%252F686249341%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/686249341/600 saved to cache
2026-03-28 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c98b2cc3-a1ec-5194-ae49-df6d05e42077
2026-03-28 22:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548a6d90>
2026-03-28 22:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cdde96-e9b7-5650-a0c3-4625bb35dd6e/72cdde96-e9b7-5650-a0c3-4625bb35dd6e_expert_report_file_8ffa991d-9332-4a51-8ff1-9d3f289e282b.pdf HTTP/1.1" 201 0
2026-03-28 22:03:40 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 72cdde96-e9b7-5650-a0c3-4625bb35dd6e
2026-03-28 22:03:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72cdde96-e9b7-5650-a0c3-4625bb35dd6e, skipping ID generation
2026-03-28 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 72cdde96-e9b7-5650-a0c3-4625bb35dd6e
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DST59MKN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ST59MKN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471d7510>
2026-03-28 22:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c98b2cc3-a1ec-5194-ae49-df6d05e42077/c98b2cc3-a1ec-5194-ae49-df6d05e42077_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST64MMV%252F684814047%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814047/600 saved to cache
2026-03-28 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c98b2cc3-a1ec-5194-ae49-df6d05e42077
2026-03-28 22:03:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM18WKW/42810921?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=u7VJrUxDokN8Iixrnjk2hyR5sgKyUuwrEDXBiO7lLtU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM18%20WKW-GB>
2026-03-28 22:03:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK19LKN/42810703?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=4GGZxgtOFbi6XjOH0lIxuujHODhGbK%2FoxZi%2BcEW9zoI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GK19%20LKN-GB>
2026-03-28 22:03:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028279/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AK11NXR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158258/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KY66XSJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146028%27 HTTP/1.1" 200 None
2026-03-28 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146028 not downloaded yet
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251710%27 HTTP/1.1" 200 None
2026-03-28 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251710 not downloaded yet
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994592%27 HTTP/1.1" 200 None
2026-03-28 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994592 not downloaded yet
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189301%27 HTTP/1.1" 200 None
2026-03-28 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189301 not downloaded yet
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158308%27 HTTP/1.1" 200 None
2026-03-28 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158308 not downloaded yet
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699028285%27 HTTP/1.1" 200 None
2026-03-28 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699028285 not downloaded yet
2026-03-28 22:03:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158274/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158274>
2026-03-28 22:03:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028281/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699028281>
2026-03-28 22:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010971/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN68YYB/42810746?sv=2020-08-04&st=2026-03-28T22%3A03%3A29Z&se=2026-03-28T22%3A28%3A29Z&sr=b&sp=r&sig=wILsmg9cR%2BC5ELYsaDqFarEwRxBfh8Z9P1%2FXmbnSdGw%3D)
2026-03-28 22:03:40 [bca.uk] INFO: Found listing with ID: RJ69%20GGF
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ69%2520GGF%27 HTTP/1.1" 200 None
2026-03-28 22:03:40 [bca.uk] INFO: Scrape type for RJ69%20GGF: 0
2026-03-28 22:03:40 [bca.uk] INFO: Found listing with ID: RK68%20WZS
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK68%2520WZS%27 HTTP/1.1" 200 None
2026-03-28 22:03:40 [bca.uk] INFO: Scrape type for RK68%20WZS: 1
2026-03-28 22:03:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e86ebe18-a2b5-52bb-9b19-9683b6ffda08 with identifier: RK68%20WZS
2026-03-28 22:03:40 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e86ebe18-a2b5-52bb-9b19-9683b6ffda08
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011098%27 HTTP/1.1" 200 None
2026-03-28 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011098 not downloaded yet
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976083%27 HTTP/1.1" 200 None
2026-03-28 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976083 not downloaded yet
2026-03-28 22:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55422f410>
2026-03-28 22:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91ccc5b9-c785-59f2-b3e3-b519a80bbf9e/91ccc5b9-c785-59f2-b3e3-b519a80bbf9e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSW19FWZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5') HTTP/1.1" 204 0
2026-03-28 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SW19FWZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 saved to cache
2026-03-28 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91ccc5b9-c785-59f2-b3e3-b519a80bbf9e
2026-03-28 22:03:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91ccc5b9-c785-59f2-b3e3-b519a80bbf9e, skipping ID generation
2026-03-28 22:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91ccc5b9-c785-59f2-b3e3-b519a80bbf9e with scrape type 1
2026-03-28 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91ccc5b9-c785-59f2-b3e3-b519a80bbf9e sending to next pipeline
2026-03-28 22:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 91ccc5b9-c785-59f2-b3e3-b519a80bbf9e, identifier: SW19%20FWZ
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158321%27 HTTP/1.1" 200 None
2026-03-28 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158321 not downloaded yet
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699028286%27 HTTP/1.1" 200 None
2026-03-28 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699028286 not downloaded yet
2026-03-28 22:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 91ccc5b9-c785-59f2-b3e3-b519a80bbf9e with identifier: SW19%20FWZ
2026-03-28 22:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 91ccc5b9-c785-59f2-b3e3-b519a80bbf9e with identifier: SW19%20FWZ
2026-03-28 22:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 91ccc5b9-c785-59f2-b3e3-b519a80bbf9e with identifier: SW19%20FWZ to the API
2026-03-28 22:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SW19FWZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
{'auction_title': '',
'c_o_2_emission_value': 195,
'car_expert_report_source_url': None,
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Diesel',
'id': '91ccc5b9-c785-59f2-b3e3-b519a80bbf9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SW19 FWZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SW19%20FWZ&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'FORD',
'model': 'TRANSIT 350 RWD',
'odometer': 127973,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 1,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91ccc5b9-c785-59f2-b3e3-b519a80bbf9e/91ccc5b9-c785-59f2-b3e3-b519a80bbf9e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21922,
'Height': 300,
'OriginUrl': 'https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SW19FWZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'Width': 400}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD TRANSIT 350 RWD 2.0 TDCI 130 LWB Dropside',
'transmission': 'manual',
'trim': 'TDCI 130 LWB',
'vin': 'WF0DXXTTGDJG01441',
'year': 2019}
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW19%2520FWZ%27 HTTP/1.1" 200 None
2026-03-28 22:03:41 [bca.uk] INFO: Saving data for SW19%20FWZ: {'created_time': 1774735421.172884, 'last_price_update_time': 1774735421.172894, 'auction_closing_time': 1775210400.0}
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SW19%2520FWZ') HTTP/1.1" 204 0
2026-03-28 22:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF20XNC/42807954?sv=2020-08-04&st=2026-03-28T22%3A03%3A38Z&se=2026-03-28T22%3A28%3A38Z&sr=b&sp=r&sig=HqECq2nNVAmAiFdZnnkNsAZVF%2FHK3rToWPsQPkpm8YM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:41 [bca.uk] INFO: Found listing with ID: YH70%20HRN
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH70%2520HRN%27 HTTP/1.1" 200 None
2026-03-28 22:03:41 [bca.uk] INFO: Scrape type for YH70%20HRN: 1
2026-03-28 22:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fa3513c-d7c1-5913-b481-6acfffd741bf with identifier: YH70%20HRN
2026-03-28 22:03:41 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6fa3513c-d7c1-5913-b481-6acfffd741bf
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011114%27 HTTP/1.1" 200 None
2026-03-28 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011114 not downloaded yet
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976105%27 HTTP/1.1" 200 None
2026-03-28 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976105 not downloaded yet
2026-03-28 22:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189232/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU67EBV/42807577?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=Dc9GP37lnEoc8Ucnf7mZMpnnsmm75eM47cbqeVO4%2BUo%3D)
2026-03-28 22:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994457/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV65GFU/42810585?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=Uw05gug7lwLgV7s2MX8pmDxdS7jFiOh93SlRxrnK0ts%3D)
2026-03-28 22:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189266/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189266>
2026-03-28 22:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028282/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699028282>
2026-03-28 22:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158281/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158281>
2026-03-28 22:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994528/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994528>
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158334%27 HTTP/1.1" 200 None
2026-03-28 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158334 not downloaded yet
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699028287%27 HTTP/1.1" 200 None
2026-03-28 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699028287 not downloaded yet
2026-03-28 22:03:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54761c290>
2026-03-28 22:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37980901-da86-559d-83e6-c8f73f7f2265/37980901-da86-559d-83e6-c8f73f7f2265_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN68YYB%252F699010971%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010971/600 saved to cache
2026-03-28 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 37980901-da86-559d-83e6-c8f73f7f2265
2026-03-28 22:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ68EYU/42810875?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=mBNLdGQbm1DhNN1S4GccP%2FZY1Fjg8xcp9xUKQWMBqqA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:41 [bca.uk] INFO: Found listing with ID: MP19%20HZK
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP19%2520HZK%27 HTTP/1.1" 200 None
2026-03-28 22:03:41 [bca.uk] INFO: Scrape type for MP19%20HZK: 0
2026-03-28 22:03:41 [bca.uk] INFO: Found listing with ID: MT23%20TUO
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT23%2520TUO%27 HTTP/1.1" 200 None
2026-03-28 22:03:41 [bca.uk] INFO: Scrape type for MT23%20TUO: 0
2026-03-28 22:03:41 [bca.uk] INFO: Found listing with ID: NU72%20GYN
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU72%2520GYN%27 HTTP/1.1" 200 None
2026-03-28 22:03:41 [bca.uk] INFO: Scrape type for NU72%20GYN: 0
2026-03-28 22:03:41 [bca.uk] INFO: Found listing with ID: RGZ%202258
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RGZ%25202258%27 HTTP/1.1" 200 None
2026-03-28 22:03:41 [bca.uk] INFO: Scrape type for RGZ%202258: 1
2026-03-28 22:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df646afa-cd7d-59ba-af23-e32bf2546109 with identifier: RGZ%202258
2026-03-28 22:03:41 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item df646afa-cd7d-59ba-af23-e32bf2546109
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011133%27 HTTP/1.1" 200 None
2026-03-28 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011133 not downloaded yet
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976130%27 HTTP/1.1" 200 None
2026-03-28 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976130 not downloaded yet
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158346%27 HTTP/1.1" 200 None
2026-03-28 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158346 not downloaded yet
2026-03-28 22:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158258/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY66XSJ/42810063?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=n4o%2FwpUrt5NmnHO4b%2FuTK0GIrxHv%2BFYQBHPaaSLhQm0%3D)
2026-03-28 22:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028283/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699028283>
2026-03-28 22:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158274/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY66XSJ/42810063?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=n4o%2FwpUrt5NmnHO4b%2FuTK0GIrxHv%2BFYQBHPaaSLhQm0%3D)
2026-03-28 22:03:41 [bca.uk] INFO: Found listing with ID: SH22%20GFY
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH22%2520GFY%27 HTTP/1.1" 200 None
2026-03-28 22:03:41 [bca.uk] INFO: Scrape type for SH22%20GFY: 0
2026-03-28 22:03:41 [bca.uk] INFO: Found listing with ID: WF68%20XGD
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF68%2520XGD%27 HTTP/1.1" 200 None
2026-03-28 22:03:41 [bca.uk] INFO: Scrape type for WF68%20XGD: 0
2026-03-28 22:03:41 [bca.uk] INFO: Found listing with ID: WO19%20HKY
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO19%2520HKY%27 HTTP/1.1" 200 None
2026-03-28 22:03:41 [bca.uk] INFO: Scrape type for WO19%20HKY: 0
2026-03-28 22:03:41 [bca.uk] INFO: Found listing with ID: YC68%20TVN
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC68%2520TVN%27 HTTP/1.1" 200 None
2026-03-28 22:03:41 [bca.uk] INFO: Scrape type for YC68%20TVN: 2
2026-03-28 22:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 384424c5-4a27-5c4a-8ba8-b04b931ad0f3 with identifier: YC68%20TVN
2026-03-28 22:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 384424c5-4a27-5c4a-8ba8-b04b931ad0f3 with scrape type 2
2026-03-28 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 384424c5-4a27-5c4a-8ba8-b04b931ad0f3 with scrape type 2
2026-03-28 22:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 384424c5-4a27-5c4a-8ba8-b04b931ad0f3, identifier: YC68%20TVN
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011154%27 HTTP/1.1" 200 None
2026-03-28 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011154 not downloaded yet
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976142%27 HTTP/1.1" 200 None
2026-03-28 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976142 not downloaded yet
2026-03-28 22:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5476321d0>
2026-03-28 22:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b0421d-18ef-5012-9f9a-61cd23cc4cf6/78b0421d-18ef-5012-9f9a-61cd23cc4cf6_expert_report_file_e4172c38-8a64-4224-a727-c01a40525de9.pdf HTTP/1.1" 201 0
2026-03-28 22:03:41 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 78b0421d-18ef-5012-9f9a-61cd23cc4cf6
2026-03-28 22:03:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78b0421d-18ef-5012-9f9a-61cd23cc4cf6, skipping ID generation
2026-03-28 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 78b0421d-18ef-5012-9f9a-61cd23cc4cf6
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAF20XNC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AF20XNC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 384424c5-4a27-5c4a-8ba8-b04b931ad0f3 with identifier: YC68%20TVN
2026-03-28 22:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 384424c5-4a27-5c4a-8ba8-b04b931ad0f3 with identifier: YC68%20TVN
2026-03-28 22:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 384424c5-4a27-5c4a-8ba8-b04b931ad0f3 with identifier: YC68%20TVN to the API
2026-03-28 22:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YC68%20TVN-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '384424c5-4a27-5c4a-8ba8-b04b931ad0f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YC68 TVN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YC68%20TVN&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'JAGUAR',
'model': 'E-PACE',
'odometer': 45022,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'JAGUAR E-PACE 2.0 D150 2WD R-DYNAMIC S Hatchback',
'transmission': 'manual',
'trim': 'D150 2WD R-DYNAMIC S',
'vin': 'SADFB2CN2K1Z38767',
'year': 2018}
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC68%2520TVN%27 HTTP/1.1" 200 None
2026-03-28 22:03:42 [bca.uk] INFO: Saving data for YC68%20TVN: {'auction_closing_time': 1774951200.0, 'created_time': 1774217126.374088, 'last_price_update_time': 1774735422.180975}
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YC68%2520TVN') HTTP/1.1" 204 0
2026-03-28 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028281/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK11NXR/42811064?sv=2020-08-04&st=2026-03-28T22%3A03%3A33Z&se=2026-03-28T22%3A28%3A33Z&sr=b&sp=r&sig=WQwb7hHALscNLn8OXQjUUwD9ln4%2BEG5I6c0xHH7%2BOPc%3D)
2026-03-28 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028279/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK11NXR/42811064?sv=2020-08-04&st=2026-03-28T22%3A03%3A33Z&se=2026-03-28T22%3A28%3A33Z&sr=b&sp=r&sig=WQwb7hHALscNLn8OXQjUUwD9ln4%2BEG5I6c0xHH7%2BOPc%3D)
2026-03-28 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976062/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ST59MKN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:42 [bca.uk] INFO: Found listing with ID: YK19%20TBP
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK19%2520TBP%27 HTTP/1.1" 200 None
2026-03-28 22:03:42 [bca.uk] INFO: Scrape type for YK19%20TBP: 0
2026-03-28 22:03:42 [bca.uk] INFO: Found listing with ID: DK69%20NEO
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK69%2520NEO%27 HTTP/1.1" 200 None
2026-03-28 22:03:42 [bca.uk] INFO: Scrape type for DK69%20NEO: 1
2026-03-28 22:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6 with identifier: DK69%20NEO
2026-03-28 22:03:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011169%27 HTTP/1.1" 200 None
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011169 not downloaded yet
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976157%27 HTTP/1.1" 200 None
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976157 not downloaded yet
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699084861%27 HTTP/1.1" 200 None
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699084861 not downloaded yet
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547170290>
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d00f4d6-3827-55c1-a06a-583364af76a6/2d00f4d6-3827-55c1-a06a-583364af76a6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU67EBV%252F699189232%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189232/600 saved to cache
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2d00f4d6-3827-55c1-a06a-583364af76a6
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548fe910>
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63a9213b-9753-5663-b464-16226cca8eb4/63a9213b-9753-5663-b464-16226cca8eb4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV65GFU%252F698994457%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994457/600 saved to cache
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 63a9213b-9753-5663-b464-16226cca8eb4
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b3aa50>
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4/9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4_expert_report_file_266800ed-5c25-41a4-b285-080d4f75a034.pdf HTTP/1.1" 201 0
2026-03-28 22:03:42 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4
2026-03-28 22:03:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4, skipping ID generation
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGJ68EYU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GJ68EYU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM18WKW/42810921?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=u7VJrUxDokN8Iixrnjk2hyR5sgKyUuwrEDXBiO7lLtU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158281/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY66XSJ/42810063?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=n4o%2FwpUrt5NmnHO4b%2FuTK0GIrxHv%2BFYQBHPaaSLhQm0%3D)
2026-03-28 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK19LKN/42810703?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=4GGZxgtOFbi6XjOH0lIxuujHODhGbK%2FoxZi%2BcEW9zoI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994528/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV65GFU/42810585?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=Uw05gug7lwLgV7s2MX8pmDxdS7jFiOh93SlRxrnK0ts%3D)
2026-03-28 22:03:42 [bca.uk] INFO: Found listing with ID: MH19%20RHF
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MH19%2520RHF%27 HTTP/1.1" 200 None
2026-03-28 22:03:42 [bca.uk] INFO: Scrape type for MH19%20RHF: 1
2026-03-28 22:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7bbb95c-34a4-508c-9af6-6415bfd76278 with identifier: MH19%20RHF
2026-03-28 22:03:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f7bbb95c-34a4-508c-9af6-6415bfd76278
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011209%27 HTTP/1.1" 200 None
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011209 not downloaded yet
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976189%27 HTTP/1.1" 200 None
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976189 not downloaded yet
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699084870%27 HTTP/1.1" 200 None
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699084870 not downloaded yet
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002786%27 HTTP/1.1" 200 None
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002786 not downloaded yet
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a01fd0>
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b40829-d997-5432-a0e4-0fd30767ce9e/43b40829-d997-5432-a0e4-0fd30767ce9e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY66XSJ%252F699158258%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158258/600 saved to cache
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43b40829-d997-5432-a0e4-0fd30767ce9e
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b2c8d0>
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b40829-d997-5432-a0e4-0fd30767ce9e/43b40829-d997-5432-a0e4-0fd30767ce9e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY66XSJ%252F699158274%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158274/600 saved to cache
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43b40829-d997-5432-a0e4-0fd30767ce9e
2026-03-28 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028282/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK11NXR/42811064?sv=2020-08-04&st=2026-03-28T22%3A03%3A33Z&se=2026-03-28T22%3A28%3A33Z&sr=b&sp=r&sig=WQwb7hHALscNLn8OXQjUUwD9ln4%2BEG5I6c0xHH7%2BOPc%3D)
2026-03-28 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976083/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976083>
2026-03-28 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976105/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976105>
2026-03-28 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028286/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699028286>
2026-03-28 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158321/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158321>
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a169d0>
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f/cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK11NXR%252F699028281%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028281/600 saved to cache
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54717fc50>
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f/cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK11NXR%252F699028279%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028279/600 saved to cache
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f
2026-03-28 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189266/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU67EBV/42807577?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=Dc9GP37lnEoc8Ucnf7mZMpnnsmm75eM47cbqeVO4%2BUo%3D)
2026-03-28 22:03:42 [bca.uk] INFO: Found listing with ID: MJ19%20JYG
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ19%2520JYG%27 HTTP/1.1" 200 None
2026-03-28 22:03:42 [bca.uk] INFO: Scrape type for MJ19%20JYG: 1
2026-03-28 22:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7c54e9b-c505-5a1c-96f8-efc7e46f0480 with identifier: MJ19%20JYG
2026-03-28 22:03:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a7c54e9b-c505-5a1c-96f8-efc7e46f0480
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011237%27 HTTP/1.1" 200 None
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011237 not downloaded yet
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976211%27 HTTP/1.1" 200 None
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976211 not downloaded yet
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699084875%27 HTTP/1.1" 200 None
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699084875 not downloaded yet
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002811%27 HTTP/1.1" 200 None
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002811 not downloaded yet
2026-03-28 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976130/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976130>
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b75110>
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ab8ad02-8eed-55fd-8bce-08a2c5079d22/2ab8ad02-8eed-55fd-8bce-08a2c5079d22_expert_report_file_bbf4aae2-121a-463d-8977-ddba0df2e41c.pdf HTTP/1.1" 201 0
2026-03-28 22:03:42 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2ab8ad02-8eed-55fd-8bce-08a2c5079d22
2026-03-28 22:03:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ab8ad02-8eed-55fd-8bce-08a2c5079d22, skipping ID generation
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2ab8ad02-8eed-55fd-8bce-08a2c5079d22
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKM18WKW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KM18WKW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549cbdd0>
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b40829-d997-5432-a0e4-0fd30767ce9e/43b40829-d997-5432-a0e4-0fd30767ce9e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY66XSJ%252F699158281%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158281/600 saved to cache
2026-03-28 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 43b40829-d997-5432-a0e4-0fd30767ce9e
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a62790>
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbe411f-6de6-544b-9dbf-532e12cbc18e/2dbe411f-6de6-544b-9dbf-532e12cbc18e_expert_report_file_a66d8294-6c0e-4a89-84ff-51d2f56b300d.pdf HTTP/1.1" 201 0
2026-03-28 22:03:43 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2dbe411f-6de6-544b-9dbf-532e12cbc18e
2026-03-28 22:03:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2dbe411f-6de6-544b-9dbf-532e12cbc18e, skipping ID generation
2026-03-28 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2dbe411f-6de6-544b-9dbf-532e12cbc18e
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGK19LKN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GK19LKN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477cc4d0>
2026-03-28 22:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63a9213b-9753-5663-b464-16226cca8eb4/63a9213b-9753-5663-b464-16226cca8eb4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV65GFU%252F698994528%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994528/600 saved to cache
2026-03-28 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 63a9213b-9753-5663-b464-16226cca8eb4
2026-03-28 22:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976062/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST59MKN/42810519?sv=2020-08-04&st=2026-03-28T22%3A03%3A36Z&se=2026-03-28T22%3A28%3A36Z&sr=b&sp=r&sig=qdxvmwQC9M%2F12MyUbvpDYZ0p8e9m0rs2kGxmuCWXYT4%3D)
2026-03-28 22:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011154/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011154>
2026-03-28 22:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011133/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011133>
2026-03-28 22:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084847/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AF20XNC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976142/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976142>
2026-03-28 22:03:43 [bca.uk] INFO: Found listing with ID: ML71%20WFO
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML71%2520WFO%27 HTTP/1.1" 200 None
2026-03-28 22:03:43 [bca.uk] INFO: Scrape type for ML71%20WFO: 0
2026-03-28 22:03:43 [bca.uk] INFO: Found listing with ID: YE19%20VLP
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE19%2520VLP%27 HTTP/1.1" 200 None
2026-03-28 22:03:43 [bca.uk] INFO: Scrape type for YE19%20VLP: 2
2026-03-28 22:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0e34e59-38b0-5058-b818-add93848e6bd with identifier: YE19%20VLP
2026-03-28 22:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0e34e59-38b0-5058-b818-add93848e6bd with scrape type 2
2026-03-28 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0e34e59-38b0-5058-b818-add93848e6bd with scrape type 2
2026-03-28 22:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b0e34e59-38b0-5058-b818-add93848e6bd, identifier: YE19%20VLP
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011269%27 HTTP/1.1" 200 None
2026-03-28 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011269 not downloaded yet
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976239%27 HTTP/1.1" 200 None
2026-03-28 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976239 not downloaded yet
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699084888%27 HTTP/1.1" 200 None
2026-03-28 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699084888 not downloaded yet
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002826%27 HTTP/1.1" 200 None
2026-03-28 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002826 not downloaded yet
2026-03-28 22:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b0e34e59-38b0-5058-b818-add93848e6bd with identifier: YE19%20VLP
2026-03-28 22:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b0e34e59-38b0-5058-b818-add93848e6bd with identifier: YE19%20VLP
2026-03-28 22:03:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b0e34e59-38b0-5058-b818-add93848e6bd with identifier: YE19%20VLP to the API
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YE19%20VLP-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b0e34e59-38b0-5058-b818-add93848e6bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YE19 VLP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YE19%20VLP&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'CITROEN',
'model': 'C3 AIRCROSS',
'odometer': 70236,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'CITROEN C3 AIRCROSS 1.2 P/T 130 FLAIR Hatchback',
'transmission': 'manual',
'trim': 'P/T 130 FLAIR',
'vin': 'VF72RHNSJK4222529',
'year': 2019}
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE19%2520VLP%27 HTTP/1.1" 200 None
2026-03-28 22:03:43 [bca.uk] INFO: Saving data for YE19%20VLP: {'auction_closing_time': 1774864800.0, 'created_time': 1774130744.483752, 'last_price_update_time': 1774735423.729064}
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YE19%2520VLP') HTTP/1.1" 204 0
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011390%27 HTTP/1.1" 200 None
2026-03-28 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011390 not downloaded yet
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976378%27 HTTP/1.1" 200 None
2026-03-28 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976378 not downloaded yet
2026-03-28 22:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028283/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK11NXR/42811064?sv=2020-08-04&st=2026-03-28T22%3A03%3A33Z&se=2026-03-28T22%3A28%3A33Z&sr=b&sp=r&sig=WQwb7hHALscNLn8OXQjUUwD9ln4%2BEG5I6c0xHH7%2BOPc%3D)
2026-03-28 22:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158346/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158346>
2026-03-28 22:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002761/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GJ68EYU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:43 [bca.uk] INFO: Found listing with ID: YB19%20VUL
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB19%2520VUL%27 HTTP/1.1" 200 None
2026-03-28 22:03:43 [bca.uk] INFO: Scrape type for YB19%20VUL: 2
2026-03-28 22:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd5ff414-9c8a-5f3d-8f77-38507ba5d434 with identifier: YB19%20VUL
2026-03-28 22:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd5ff414-9c8a-5f3d-8f77-38507ba5d434 with scrape type 2
2026-03-28 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd5ff414-9c8a-5f3d-8f77-38507ba5d434 with scrape type 2
2026-03-28 22:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fd5ff414-9c8a-5f3d-8f77-38507ba5d434, identifier: YB19%20VUL
2026-03-28 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011291%27 HTTP/1.1" 200 None
2026-03-28 22:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011291 not downloaded yet
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976274%27 HTTP/1.1" 200 None
2026-03-28 22:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976274 not downloaded yet
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699084897%27 HTTP/1.1" 200 None
2026-03-28 22:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699084897 not downloaded yet
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002841%27 HTTP/1.1" 200 None
2026-03-28 22:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002841 not downloaded yet
2026-03-28 22:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547733e90>
2026-03-28 22:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f/cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK11NXR%252F699028282%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028282/600 saved to cache
2026-03-28 22:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f
2026-03-28 22:03:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55498e950>
2026-03-28 22:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d00f4d6-3827-55c1-a06a-583364af76a6/2d00f4d6-3827-55c1-a06a-583364af76a6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU67EBV%252F699189266%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189266/600 saved to cache
2026-03-28 22:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2d00f4d6-3827-55c1-a06a-583364af76a6
2026-03-28 22:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976083/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST59MKN/42810519?sv=2020-08-04&st=2026-03-28T22%3A03%3A36Z&se=2026-03-28T22%3A28%3A36Z&sr=b&sp=r&sig=qdxvmwQC9M%2F12MyUbvpDYZ0p8e9m0rs2kGxmuCWXYT4%3D)
2026-03-28 22:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976105/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST59MKN/42810519?sv=2020-08-04&st=2026-03-28T22%3A03%3A36Z&se=2026-03-28T22%3A28%3A36Z&sr=b&sp=r&sig=qdxvmwQC9M%2F12MyUbvpDYZ0p8e9m0rs2kGxmuCWXYT4%3D)
2026-03-28 22:03:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084861/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699084861>
2026-03-28 22:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fd5ff414-9c8a-5f3d-8f77-38507ba5d434 with identifier: YB19%20VUL
2026-03-28 22:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fd5ff414-9c8a-5f3d-8f77-38507ba5d434 with identifier: YB19%20VUL
2026-03-28 22:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fd5ff414-9c8a-5f3d-8f77-38507ba5d434 with identifier: YB19%20VUL to the API
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YB19%20VUL-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'fd5ff414-9c8a-5f3d-8f77-38507ba5d434',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YB19 VUL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YB19%20VUL&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'BMW',
'model': '320D',
'odometer': 999999,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'BMW 320D 2.0 SE STEP Saloon',
'transmission': 'automatic',
'trim': 'SE STEP',
'vin': 'WBA5V52010AJ67430',
'year': 2019}
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB19%2520VUL%27 HTTP/1.1" 200 None
2026-03-28 22:03:44 [bca.uk] INFO: Saving data for YB19%20VUL: {'auction_closing_time': 1774864800.0, 'created_time': 1774536309.985425, 'last_price_update_time': 1774735424.550207}
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YB19%2520VUL') HTTP/1.1" 204 0
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011406%27 HTTP/1.1" 200 None
2026-03-28 22:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011406 not downloaded yet
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976402%27 HTTP/1.1" 200 None
2026-03-28 22:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976402 not downloaded yet
2026-03-28 22:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158321/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY66XSJ/42810063?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=n4o%2FwpUrt5NmnHO4b%2FuTK0GIrxHv%2BFYQBHPaaSLhQm0%3D)
2026-03-28 22:03:44 [bca.uk] INFO: Found listing with ID: NG19%20PXT
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG19%2520PXT%27 HTTP/1.1" 200 None
2026-03-28 22:03:44 [bca.uk] INFO: Scrape type for NG19%20PXT: 0
2026-03-28 22:03:44 [bca.uk] INFO: Found listing with ID: LP69%20AYT
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP69%2520AYT%27 HTTP/1.1" 200 None
2026-03-28 22:03:44 [bca.uk] INFO: Scrape type for LP69%20AYT: 0
2026-03-28 22:03:44 [bca.uk] INFO: Found listing with ID: BD19%20VEB
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD19%2520VEB%27 HTTP/1.1" 200 None
2026-03-28 22:03:44 [bca.uk] INFO: Scrape type for BD19%20VEB: 0
2026-03-28 22:03:44 [bca.uk] INFO: Found listing with ID: AP14%20VMA
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP14%2520VMA%27 HTTP/1.1" 200 None
2026-03-28 22:03:44 [bca.uk] INFO: Scrape type for AP14%20VMA: 0
2026-03-28 22:03:44 [bca.uk] INFO: Found listing with ID: HN67%20CEF
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN67%2520CEF%27 HTTP/1.1" 200 None
2026-03-28 22:03:44 [bca.uk] INFO: Scrape type for HN67%20CEF: 0
2026-03-28 22:03:44 [bca.uk] INFO: Found listing with ID: PJ17%20GNU
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ17%2520GNU%27 HTTP/1.1" 200 None
2026-03-28 22:03:44 [bca.uk] INFO: Scrape type for PJ17%20GNU: 0
2026-03-28 22:03:44 [bca.uk] INFO: Found listing with ID: SO15%20AOG
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SO15%2520AOG%27 HTTP/1.1" 200 None
2026-03-28 22:03:44 [bca.uk] INFO: Scrape type for SO15%20AOG: 0
2026-03-28 22:03:44 [bca.uk] INFO: Found listing with ID: SY66%20NNC
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY66%2520NNC%27 HTTP/1.1" 200 None
2026-03-28 22:03:44 [bca.uk] INFO: Scrape type for SY66%20NNC: 0
2026-03-28 22:03:44 [bca.uk] INFO: Found listing with ID: CA65%20KLE
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA65%2520KLE%27 HTTP/1.1" 200 None
2026-03-28 22:03:44 [bca.uk] INFO: Scrape type for CA65%20KLE: 2
2026-03-28 22:03:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecf9ce68-f48f-590f-a228-caae4c9bb46f with identifier: CA65%20KLE
2026-03-28 22:03:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecf9ce68-f48f-590f-a228-caae4c9bb46f with scrape type 2
2026-03-28 22:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecf9ce68-f48f-590f-a228-caae4c9bb46f with scrape type 2
2026-03-28 22:03:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ecf9ce68-f48f-590f-a228-caae4c9bb46f, identifier: CA65%20KLE
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699084918%27 HTTP/1.1" 200 None
2026-03-28 22:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699084918 not downloaded yet
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002867%27 HTTP/1.1" 200 None
2026-03-28 22:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002867 not downloaded yet
2026-03-28 22:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028286/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK11NXR/42811064?sv=2020-08-04&st=2026-03-28T22%3A03%3A33Z&se=2026-03-28T22%3A28%3A33Z&sr=b&sp=r&sig=WQwb7hHALscNLn8OXQjUUwD9ln4%2BEG5I6c0xHH7%2BOPc%3D)
2026-03-28 22:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976130/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST59MKN/42810519?sv=2020-08-04&st=2026-03-28T22%3A03%3A36Z&se=2026-03-28T22%3A28%3A36Z&sr=b&sp=r&sig=qdxvmwQC9M%2F12MyUbvpDYZ0p8e9m0rs2kGxmuCWXYT4%3D)
2026-03-28 22:03:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976157/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976157>
2026-03-28 22:03:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002786/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002786>
2026-03-28 22:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ecf9ce68-f48f-590f-a228-caae4c9bb46f with identifier: CA65%20KLE
2026-03-28 22:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ecf9ce68-f48f-590f-a228-caae4c9bb46f with identifier: CA65%20KLE
2026-03-28 22:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ecf9ce68-f48f-590f-a228-caae4c9bb46f with identifier: CA65%20KLE to the API
2026-03-28 22:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CA65%20KLE-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ecf9ce68-f48f-590f-a228-caae4c9bb46f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CA65 KLE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CA65%20KLE&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 63835,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.2 DIG-T 113 ACENTA PREMIUM Hatchback',
'transmission': 'manual',
'trim': 'DIG-T 113 ACENTA PREMIUM',
'vin': 'SJNFEAF15U7143482',
'year': 2015}
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA65%2520KLE%27 HTTP/1.1" 200 None
2026-03-28 22:03:45 [bca.uk] INFO: Saving data for CA65%20KLE: {'auction_closing_time': 1774778400.0, 'created_time': 1774620777.568671, 'last_price_update_time': 1774735425.243365}
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CA65%2520KLE') HTTP/1.1" 204 0
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011415%27 HTTP/1.1" 200 None
2026-03-28 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011415 not downloaded yet
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976422%27 HTTP/1.1" 200 None
2026-03-28 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976422 not downloaded yet
2026-03-28 22:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477553d0>
2026-03-28 22:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cdde96-e9b7-5650-a0c3-4625bb35dd6e/72cdde96-e9b7-5650-a0c3-4625bb35dd6e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST59MKN%252F698976062%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976062/600 saved to cache
2026-03-28 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72cdde96-e9b7-5650-a0c3-4625bb35dd6e
2026-03-28 22:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5541fe4d0>
2026-03-28 22:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f/cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK11NXR%252F699028283%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028283/600 saved to cache
2026-03-28 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f
2026-03-28 22:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976142/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST59MKN/42810519?sv=2020-08-04&st=2026-03-28T22%3A03%3A36Z&se=2026-03-28T22%3A28%3A36Z&sr=b&sp=r&sig=qdxvmwQC9M%2F12MyUbvpDYZ0p8e9m0rs2kGxmuCWXYT4%3D)
2026-03-28 22:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011133/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG15HYL/42810937?sv=2020-08-04&st=2026-03-28T22%3A03%3A36Z&se=2026-03-28T22%3A28%3A36Z&sr=b&sp=r&sig=5%2Bm9q%2BE0Wl4g8RZLCygI%2BKewbEkOWA68pXi4u14HhvE%3D)
2026-03-28 22:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084847/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF20XNC/42807954?sv=2020-08-04&st=2026-03-28T22%3A03%3A38Z&se=2026-03-28T22%3A28%3A38Z&sr=b&sp=r&sig=HqECq2nNVAmAiFdZnnkNsAZVF%2FHK3rToWPsQPkpm8YM%3D)
2026-03-28 22:03:45 [bca.uk] INFO: Found listing with ID: DA14%20ORY
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA14%2520ORY%27 HTTP/1.1" 200 None
2026-03-28 22:03:45 [bca.uk] INFO: Scrape type for DA14%20ORY: 0
2026-03-28 22:03:45 [bca.uk] INFO: Found listing with ID: M80%20AKD
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M80%2520AKD%27 HTTP/1.1" 200 None
2026-03-28 22:03:45 [bca.uk] INFO: Scrape type for M80%20AKD: 0
2026-03-28 22:03:45 [bca.uk] INFO: Found listing with ID: SC14%20NFN
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC14%2520NFN%27 HTTP/1.1" 200 None
2026-03-28 22:03:45 [bca.uk] INFO: Scrape type for SC14%20NFN: 2
2026-03-28 22:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59b7727d-49c8-5685-bc4a-615d45a3eba9 with identifier: SC14%20NFN
2026-03-28 22:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59b7727d-49c8-5685-bc4a-615d45a3eba9 with scrape type 2
2026-03-28 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59b7727d-49c8-5685-bc4a-615d45a3eba9 with scrape type 2
2026-03-28 22:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 59b7727d-49c8-5685-bc4a-615d45a3eba9, identifier: SC14%20NFN
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699084936%27 HTTP/1.1" 200 None
2026-03-28 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699084936 not downloaded yet
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002903%27 HTTP/1.1" 200 None
2026-03-28 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002903 not downloaded yet
2026-03-28 22:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 59b7727d-49c8-5685-bc4a-615d45a3eba9 with identifier: SC14%20NFN
2026-03-28 22:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 59b7727d-49c8-5685-bc4a-615d45a3eba9 with identifier: SC14%20NFN
2026-03-28 22:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 59b7727d-49c8-5685-bc4a-615d45a3eba9 with identifier: SC14%20NFN to the API
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SC14%20NFN-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '59b7727d-49c8-5685-bc4a-615d45a3eba9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SC14 NFN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SC14%20NFN&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'KIA',
'model': 'VENGA',
'odometer': 65938,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'KIA VENGA 1.4 1 ECODYNAMICS MPV',
'transmission': 'manual',
'trim': '1 ECODYNAMICS',
'vin': 'U5YEG811LEL086355',
'year': 2014}
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC14%2520NFN%27 HTTP/1.1" 200 None
2026-03-28 22:03:45 [bca.uk] INFO: Saving data for SC14%20NFN: {'auction_closing_time': 1774778400.0, 'created_time': 1774620782.391294, 'last_price_update_time': 1774735425.888844}
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SC14%2520NFN') HTTP/1.1" 204 0
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011429%27 HTTP/1.1" 200 None
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011429 not downloaded yet
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976444%27 HTTP/1.1" 200 None
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976444 not downloaded yet
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b38250>
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cdde96-e9b7-5650-a0c3-4625bb35dd6e/72cdde96-e9b7-5650-a0c3-4625bb35dd6e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST59MKN%252F698976083%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976083/600 saved to cache
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 72cdde96-e9b7-5650-a0c3-4625bb35dd6e
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543e0910>
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cdde96-e9b7-5650-a0c3-4625bb35dd6e/72cdde96-e9b7-5650-a0c3-4625bb35dd6e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST59MKN%252F698976105%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976105/600 saved to cache
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 72cdde96-e9b7-5650-a0c3-4625bb35dd6e
2026-03-28 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554944950>
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b40829-d997-5432-a0e4-0fd30767ce9e/43b40829-d997-5432-a0e4-0fd30767ce9e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY66XSJ%252F699158321%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158321/600 saved to cache
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 43b40829-d997-5432-a0e4-0fd30767ce9e
2026-03-28 22:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002761/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ68EYU/42810875?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=mBNLdGQbm1DhNN1S4GccP%2FZY1Fjg8xcp9xUKQWMBqqA%3D)
2026-03-28 22:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011154/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG15HYL/42810937?sv=2020-08-04&st=2026-03-28T22%3A03%3A36Z&se=2026-03-28T22%3A28%3A36Z&sr=b&sp=r&sig=5%2Bm9q%2BE0Wl4g8RZLCygI%2BKewbEkOWA68pXi4u14HhvE%3D)
2026-03-28 22:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002811/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002811>
2026-03-28 22:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002826/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002826>
2026-03-28 22:03:46 [bca.uk] INFO: Found listing with ID: SK68%20YYP
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK68%2520YYP%27 HTTP/1.1" 200 None
2026-03-28 22:03:46 [bca.uk] INFO: Scrape type for SK68%20YYP: 0
2026-03-28 22:03:46 [bca.uk] INFO: Found listing with ID: YA66%20ACZ
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA66%2520ACZ%27 HTTP/1.1" 200 None
2026-03-28 22:03:46 [bca.uk] INFO: Scrape type for YA66%20ACZ: 2
2026-03-28 22:03:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fce67d35-a8d0-5c8f-b601-1862a3a0684d with identifier: YA66%20ACZ
2026-03-28 22:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fce67d35-a8d0-5c8f-b601-1862a3a0684d with scrape type 2
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fce67d35-a8d0-5c8f-b601-1862a3a0684d with scrape type 2
2026-03-28 22:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fce67d35-a8d0-5c8f-b601-1862a3a0684d, identifier: YA66%20ACZ
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699084959%27 HTTP/1.1" 200 None
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699084959 not downloaded yet
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002952%27 HTTP/1.1" 200 None
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002952 not downloaded yet
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b38250>
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f/cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK11NXR%252F699028286%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028286/600 saved to cache
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471ae310>
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cdde96-e9b7-5650-a0c3-4625bb35dd6e/72cdde96-e9b7-5650-a0c3-4625bb35dd6e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST59MKN%252F698976130%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976130/600 saved to cache
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 72cdde96-e9b7-5650-a0c3-4625bb35dd6e
2026-03-28 22:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011390/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011390>
2026-03-28 22:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084861/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF20XNC/42807954?sv=2020-08-04&st=2026-03-28T22%3A03%3A38Z&se=2026-03-28T22%3A28%3A38Z&sr=b&sp=r&sig=HqECq2nNVAmAiFdZnnkNsAZVF%2FHK3rToWPsQPkpm8YM%3D)
2026-03-28 22:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976378/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976378>
2026-03-28 22:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158346/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY66XSJ/42810063?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=n4o%2FwpUrt5NmnHO4b%2FuTK0GIrxHv%2BFYQBHPaaSLhQm0%3D)
2026-03-28 22:03:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fce67d35-a8d0-5c8f-b601-1862a3a0684d with identifier: YA66%20ACZ
2026-03-28 22:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fce67d35-a8d0-5c8f-b601-1862a3a0684d with identifier: YA66%20ACZ
2026-03-28 22:03:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fce67d35-a8d0-5c8f-b601-1862a3a0684d with identifier: YA66%20ACZ to the API
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 177,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YA66%20ACZ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fce67d35-a8d0-5c8f-b601-1862a3a0684d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YA66 ACZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YA66%20ACZ&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 79395,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'KIA SPORTAGE 1.6 T GDI AWD GT-LINE StationWagon',
'transmission': 'manual',
'trim': 'T GDI AWD GT-LINE',
'vin': 'U5YPK816NGL127642',
'year': 2016}
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA66%2520ACZ%27 HTTP/1.1" 200 None
2026-03-28 22:03:46 [bca.uk] INFO: Saving data for YA66%20ACZ: {'auction_closing_time': 1774778400.0, 'created_time': 1774621472.054124, 'last_price_update_time': 1774735426.785201}
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YA66%2520ACZ') HTTP/1.1" 204 0
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011468%27 HTTP/1.1" 200 None
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011468 not downloaded yet
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976465%27 HTTP/1.1" 200 None
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976465 not downloaded yet
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699084983%27 HTTP/1.1" 200 None
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699084983 not downloaded yet
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002969%27 HTTP/1.1" 200 None
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002969 not downloaded yet
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b42210>
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cdde96-e9b7-5650-a0c3-4625bb35dd6e/72cdde96-e9b7-5650-a0c3-4625bb35dd6e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST59MKN%252F698976142%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976142/600 saved to cache
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 72cdde96-e9b7-5650-a0c3-4625bb35dd6e
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b43ed0>
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5665b770-c5fc-5a05-b9d2-8e8d129df67b/5665b770-c5fc-5a05-b9d2-8e8d129df67b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG15HYL%252F699011133%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011133/600 saved to cache
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5665b770-c5fc-5a05-b9d2-8e8d129df67b
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547367490>
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b0421d-18ef-5012-9f9a-61cd23cc4cf6/78b0421d-18ef-5012-9f9a-61cd23cc4cf6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF20XNC%252F699084847%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084847/600 saved to cache
2026-03-28 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78b0421d-18ef-5012-9f9a-61cd23cc4cf6
2026-03-28 22:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002786/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ68EYU/42810875?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=mBNLdGQbm1DhNN1S4GccP%2FZY1Fjg8xcp9xUKQWMBqqA%3D)
2026-03-28 22:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976157/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST59MKN/42810519?sv=2020-08-04&st=2026-03-28T22%3A03%3A36Z&se=2026-03-28T22%3A28%3A36Z&sr=b&sp=r&sig=qdxvmwQC9M%2F12MyUbvpDYZ0p8e9m0rs2kGxmuCWXYT4%3D)
2026-03-28 22:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976402/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976402>
2026-03-28 22:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011406/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011406>
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011500%27 HTTP/1.1" 200 None
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011500 not downloaded yet
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976484%27 HTTP/1.1" 200 None
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976484 not downloaded yet
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002987%27 HTTP/1.1" 200 None
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002987 not downloaded yet
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011524%27 HTTP/1.1" 200 None
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011524 not downloaded yet
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976510%27 HTTP/1.1" 200 None
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976510 not downloaded yet
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542d5f10>
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4/9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ68EYU%252F699002761%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002761/600 saved to cache
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473737d0>
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5665b770-c5fc-5a05-b9d2-8e8d129df67b/5665b770-c5fc-5a05-b9d2-8e8d129df67b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG15HYL%252F699011154%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011154/600 saved to cache
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5665b770-c5fc-5a05-b9d2-8e8d129df67b
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543dd4d0>
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b0421d-18ef-5012-9f9a-61cd23cc4cf6/78b0421d-18ef-5012-9f9a-61cd23cc4cf6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF20XNC%252F699084861%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084861/600 saved to cache
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 78b0421d-18ef-5012-9f9a-61cd23cc4cf6
2026-03-28 22:03:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554301350>
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b40829-d997-5432-a0e4-0fd30767ce9e/43b40829-d997-5432-a0e4-0fd30767ce9e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY66XSJ%252F699158346%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158346/600 saved to cache
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 43b40829-d997-5432-a0e4-0fd30767ce9e
2026-03-28 22:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002867/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002867>
2026-03-28 22:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002841/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002841>
2026-03-28 22:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084918/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699084918>
2026-03-28 22:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084897/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699084897>
2026-03-28 22:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002811/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ68EYU/42810875?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=mBNLdGQbm1DhNN1S4GccP%2FZY1Fjg8xcp9xUKQWMBqqA%3D)
2026-03-28 22:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002826/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ68EYU/42810875?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=mBNLdGQbm1DhNN1S4GccP%2FZY1Fjg8xcp9xUKQWMBqqA%3D)
2026-03-28 22:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002903/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002903>
2026-03-28 22:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084936/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699084936>
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011549%27 HTTP/1.1" 200 None
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011549 not downloaded yet
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976542%27 HTTP/1.1" 200 None
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976542 not downloaded yet
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474ba750>
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4/9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ68EYU%252F699002786%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002786/600 saved to cache
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55456b190>
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cdde96-e9b7-5650-a0c3-4625bb35dd6e/72cdde96-e9b7-5650-a0c3-4625bb35dd6e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST59MKN%252F698976157%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976157/600 saved to cache
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 72cdde96-e9b7-5650-a0c3-4625bb35dd6e
2026-03-28 22:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011390/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM18WKW/42810921?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=u7VJrUxDokN8Iixrnjk2hyR5sgKyUuwrEDXBiO7lLtU%3D)
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011569%27 HTTP/1.1" 200 None
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011569 not downloaded yet
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976574%27 HTTP/1.1" 200 None
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976574 not downloaded yet
2026-03-28 22:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002952/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002952>
2026-03-28 22:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976378/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK19LKN/42810703?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=4GGZxgtOFbi6XjOH0lIxuujHODhGbK%2FoxZi%2BcEW9zoI%3D)
2026-03-28 22:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976402/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK19LKN/42810703?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=4GGZxgtOFbi6XjOH0lIxuujHODhGbK%2FoxZi%2BcEW9zoI%3D)
2026-03-28 22:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011406/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM18WKW/42810921?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=u7VJrUxDokN8Iixrnjk2hyR5sgKyUuwrEDXBiO7lLtU%3D)
2026-03-28 22:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084959/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699084959>
2026-03-28 22:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011468/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011468>
2026-03-28 22:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976465/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976465>
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477cf710>
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4/9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ68EYU%252F699002811%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002811/600 saved to cache
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b72210>
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4/9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ68EYU%252F699002826%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002826/600 saved to cache
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472656d0>
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ab8ad02-8eed-55fd-8bce-08a2c5079d22/2ab8ad02-8eed-55fd-8bce-08a2c5079d22_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM18WKW%252F699011390%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011390/600 saved to cache
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2ab8ad02-8eed-55fd-8bce-08a2c5079d22
2026-03-28 22:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084918/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF20XNC/42807954?sv=2020-08-04&st=2026-03-28T22%3A03%3A38Z&se=2026-03-28T22%3A28%3A38Z&sr=b&sp=r&sig=HqECq2nNVAmAiFdZnnkNsAZVF%2FHK3rToWPsQPkpm8YM%3D)
2026-03-28 22:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002841/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ68EYU/42810875?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=mBNLdGQbm1DhNN1S4GccP%2FZY1Fjg8xcp9xUKQWMBqqA%3D)
2026-03-28 22:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002867/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ68EYU/42810875?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=mBNLdGQbm1DhNN1S4GccP%2FZY1Fjg8xcp9xUKQWMBqqA%3D)
2026-03-28 22:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084897/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF20XNC/42807954?sv=2020-08-04&st=2026-03-28T22%3A03%3A38Z&se=2026-03-28T22%3A28%3A38Z&sr=b&sp=r&sig=HqECq2nNVAmAiFdZnnkNsAZVF%2FHK3rToWPsQPkpm8YM%3D)
2026-03-28 22:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976510/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976510>
2026-03-28 22:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011524/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011524>
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477ccb10>
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbe411f-6de6-544b-9dbf-532e12cbc18e/2dbe411f-6de6-544b-9dbf-532e12cbc18e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK19LKN%252F698976378%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976378/600 saved to cache
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2dbe411f-6de6-544b-9dbf-532e12cbc18e
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554557110>
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbe411f-6de6-544b-9dbf-532e12cbc18e/2dbe411f-6de6-544b-9dbf-532e12cbc18e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK19LKN%252F698976402%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976402/600 saved to cache
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2dbe411f-6de6-544b-9dbf-532e12cbc18e
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542d6c90>
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ab8ad02-8eed-55fd-8bce-08a2c5079d22/2ab8ad02-8eed-55fd-8bce-08a2c5079d22_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM18WKW%252F699011406%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011406/600 saved to cache
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2ab8ad02-8eed-55fd-8bce-08a2c5079d22
2026-03-28 22:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002903/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ68EYU/42810875?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=mBNLdGQbm1DhNN1S4GccP%2FZY1Fjg8xcp9xUKQWMBqqA%3D)
2026-03-28 22:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084936/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF20XNC/42807954?sv=2020-08-04&st=2026-03-28T22%3A03%3A38Z&se=2026-03-28T22%3A28%3A38Z&sr=b&sp=r&sig=HqECq2nNVAmAiFdZnnkNsAZVF%2FHK3rToWPsQPkpm8YM%3D)
2026-03-28 22:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011468/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM18WKW/42810921?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=u7VJrUxDokN8Iixrnjk2hyR5sgKyUuwrEDXBiO7lLtU%3D)
2026-03-28 22:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976542/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976542>
2026-03-28 22:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976574/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976574>
2026-03-28 22:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976465/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK19LKN/42810703?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=4GGZxgtOFbi6XjOH0lIxuujHODhGbK%2FoxZi%2BcEW9zoI%3D)
2026-03-28 22:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002952/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ68EYU/42810875?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=mBNLdGQbm1DhNN1S4GccP%2FZY1Fjg8xcp9xUKQWMBqqA%3D)
2026-03-28 22:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084959/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF20XNC/42807954?sv=2020-08-04&st=2026-03-28T22%3A03%3A38Z&se=2026-03-28T22%3A28%3A38Z&sr=b&sp=r&sig=HqECq2nNVAmAiFdZnnkNsAZVF%2FHK3rToWPsQPkpm8YM%3D)
2026-03-28 22:03:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547111b50>
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b0421d-18ef-5012-9f9a-61cd23cc4cf6/78b0421d-18ef-5012-9f9a-61cd23cc4cf6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF20XNC%252F699084918%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084918/600 saved to cache
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 78b0421d-18ef-5012-9f9a-61cd23cc4cf6
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554806350>
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4/9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ68EYU%252F699002841%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002841/600 saved to cache
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543d13d0>
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4/9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ68EYU%252F699002867%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002867/600 saved to cache
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542d03d0>
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b0421d-18ef-5012-9f9a-61cd23cc4cf6/78b0421d-18ef-5012-9f9a-61cd23cc4cf6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF20XNC%252F699084897%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084897/600 saved to cache
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 78b0421d-18ef-5012-9f9a-61cd23cc4cf6
2026-03-28 22:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011524/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM18WKW/42810921?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=u7VJrUxDokN8Iixrnjk2hyR5sgKyUuwrEDXBiO7lLtU%3D)
2026-03-28 22:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011569/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011569>
2026-03-28 22:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002987/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002987>
2026-03-28 22:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976484/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976484>
2026-03-28 22:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011549/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011549>
2026-03-28 22:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976510/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK19LKN/42810703?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=4GGZxgtOFbi6XjOH0lIxuujHODhGbK%2FoxZi%2BcEW9zoI%3D)
2026-03-28 22:03:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55423ad10>
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4/9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ68EYU%252F699002903%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002903/600 saved to cache
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4
2026-03-28 22:03:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547287950>
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b0421d-18ef-5012-9f9a-61cd23cc4cf6/78b0421d-18ef-5012-9f9a-61cd23cc4cf6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF20XNC%252F699084936%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084936/600 saved to cache
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 78b0421d-18ef-5012-9f9a-61cd23cc4cf6
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477edc90>
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ab8ad02-8eed-55fd-8bce-08a2c5079d22/2ab8ad02-8eed-55fd-8bce-08a2c5079d22_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM18WKW%252F699011468%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011468/600 saved to cache
2026-03-28 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2ab8ad02-8eed-55fd-8bce-08a2c5079d22
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547286e10>
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbe411f-6de6-544b-9dbf-532e12cbc18e/2dbe411f-6de6-544b-9dbf-532e12cbc18e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK19LKN%252F698976465%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976465/600 saved to cache
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2dbe411f-6de6-544b-9dbf-532e12cbc18e
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542a4590>
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4/9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ68EYU%252F699002952%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002952/600 saved to cache
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472b2d90>
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b0421d-18ef-5012-9f9a-61cd23cc4cf6/78b0421d-18ef-5012-9f9a-61cd23cc4cf6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF20XNC%252F699084959%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084959/600 saved to cache
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 78b0421d-18ef-5012-9f9a-61cd23cc4cf6
2026-03-28 22:03:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002969/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002969>
2026-03-28 22:03:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011500/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011500>
2026-03-28 22:03:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084983/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699084983>
2026-03-28 22:03:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011429/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011429>
2026-03-28 22:03:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976444/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976444>
2026-03-28 22:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976542/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK19LKN/42810703?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=4GGZxgtOFbi6XjOH0lIxuujHODhGbK%2FoxZi%2BcEW9zoI%3D)
2026-03-28 22:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976574/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK19LKN/42810703?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=4GGZxgtOFbi6XjOH0lIxuujHODhGbK%2FoxZi%2BcEW9zoI%3D)
2026-03-28 22:03:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976422/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976422>
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554817210>
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ab8ad02-8eed-55fd-8bce-08a2c5079d22/2ab8ad02-8eed-55fd-8bce-08a2c5079d22_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM18WKW%252F699011524%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011524/600 saved to cache
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2ab8ad02-8eed-55fd-8bce-08a2c5079d22
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548b80d0>
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbe411f-6de6-544b-9dbf-532e12cbc18e/2dbe411f-6de6-544b-9dbf-532e12cbc18e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK19LKN%252F698976510%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976510/600 saved to cache
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2dbe411f-6de6-544b-9dbf-532e12cbc18e
2026-03-28 22:03:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011415/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011415>
2026-03-28 22:03:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976274/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976274>
2026-03-28 22:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002987/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ68EYU/42810875?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=mBNLdGQbm1DhNN1S4GccP%2FZY1Fjg8xcp9xUKQWMBqqA%3D)
2026-03-28 22:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011549/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM18WKW/42810921?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=u7VJrUxDokN8Iixrnjk2hyR5sgKyUuwrEDXBiO7lLtU%3D)
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b4450>
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbe411f-6de6-544b-9dbf-532e12cbc18e/2dbe411f-6de6-544b-9dbf-532e12cbc18e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK19LKN%252F698976542%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976542/600 saved to cache
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2dbe411f-6de6-544b-9dbf-532e12cbc18e
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548145d0>
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbe411f-6de6-544b-9dbf-532e12cbc18e/2dbe411f-6de6-544b-9dbf-532e12cbc18e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK19LKN%252F698976574%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976574/600 saved to cache
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2dbe411f-6de6-544b-9dbf-532e12cbc18e
2026-03-28 22:03:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011291/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011291>
2026-03-28 22:03:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084888/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699084888>
2026-03-28 22:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011569/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM18WKW/42810921?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=u7VJrUxDokN8Iixrnjk2hyR5sgKyUuwrEDXBiO7lLtU%3D)
2026-03-28 22:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976444/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK19LKN/42810703?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=4GGZxgtOFbi6XjOH0lIxuujHODhGbK%2FoxZi%2BcEW9zoI%3D)
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554226250>
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4/9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ68EYU%252F699002987%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002987/600 saved to cache
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5573dfa90>
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ab8ad02-8eed-55fd-8bce-08a2c5079d22/2ab8ad02-8eed-55fd-8bce-08a2c5079d22_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM18WKW%252F699011549%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011549/600 saved to cache
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2ab8ad02-8eed-55fd-8bce-08a2c5079d22
2026-03-28 22:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002969/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ68EYU/42810875?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=mBNLdGQbm1DhNN1S4GccP%2FZY1Fjg8xcp9xUKQWMBqqA%3D)
2026-03-28 22:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011429/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM18WKW/42810921?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=u7VJrUxDokN8Iixrnjk2hyR5sgKyUuwrEDXBiO7lLtU%3D)
2026-03-28 22:03:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976239/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976239>
2026-03-28 22:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011500/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM18WKW/42810921?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=u7VJrUxDokN8Iixrnjk2hyR5sgKyUuwrEDXBiO7lLtU%3D)
2026-03-28 22:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976484/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK19LKN/42810703?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=4GGZxgtOFbi6XjOH0lIxuujHODhGbK%2FoxZi%2BcEW9zoI%3D)
2026-03-28 22:03:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011269/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011269>
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543e8250>
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ab8ad02-8eed-55fd-8bce-08a2c5079d22/2ab8ad02-8eed-55fd-8bce-08a2c5079d22_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM18WKW%252F699011569%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011569/600 saved to cache
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2ab8ad02-8eed-55fd-8bce-08a2c5079d22
2026-03-28 22:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976422/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK19LKN/42810703?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=4GGZxgtOFbi6XjOH0lIxuujHODhGbK%2FoxZi%2BcEW9zoI%3D)
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547740550>
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbe411f-6de6-544b-9dbf-532e12cbc18e/2dbe411f-6de6-544b-9dbf-532e12cbc18e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK19LKN%252F698976444%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976444/600 saved to cache
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2dbe411f-6de6-544b-9dbf-532e12cbc18e
2026-03-28 22:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011415/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM18WKW/42810921?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=u7VJrUxDokN8Iixrnjk2hyR5sgKyUuwrEDXBiO7lLtU%3D)
2026-03-28 22:03:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976358/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GK19LKN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011377/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KM18WKW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976274/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST59MKN/42810519?sv=2020-08-04&st=2026-03-28T22%3A03%3A36Z&se=2026-03-28T22%3A28%3A36Z&sr=b&sp=r&sig=qdxvmwQC9M%2F12MyUbvpDYZ0p8e9m0rs2kGxmuCWXYT4%3D)
2026-03-28 22:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011291/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG15HYL/42810937?sv=2020-08-04&st=2026-03-28T22%3A03%3A36Z&se=2026-03-28T22%3A28%3A36Z&sr=b&sp=r&sig=5%2Bm9q%2BE0Wl4g8RZLCygI%2BKewbEkOWA68pXi4u14HhvE%3D)
2026-03-28 22:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084888/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF20XNC/42807954?sv=2020-08-04&st=2026-03-28T22%3A03%3A38Z&se=2026-03-28T22%3A28%3A38Z&sr=b&sp=r&sig=HqECq2nNVAmAiFdZnnkNsAZVF%2FHK3rToWPsQPkpm8YM%3D)
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554803ad0>
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4/9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ68EYU%252F699002969%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002969/600 saved to cache
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4
2026-03-28 22:03:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4, skipping ID generation
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4 sending to next pipeline
2026-03-28 22:03:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4, identifier: GJ68%20EYU
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54762a3d0>
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ab8ad02-8eed-55fd-8bce-08a2c5079d22/2ab8ad02-8eed-55fd-8bce-08a2c5079d22_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM18WKW%252F699011429%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011429/600 saved to cache
2026-03-28 22:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2ab8ad02-8eed-55fd-8bce-08a2c5079d22
2026-03-28 22:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4 with identifier: GJ68%20EYU
2026-03-28 22:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4 with identifier: GJ68%20EYU
2026-03-28 22:03:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4 with identifier: GJ68%20EYU to the API
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002969/600>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4/9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4_expert_report_file_266800ed-5c25-41a4-b285-080d4f75a034.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ68%20EYU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ68 EYU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ68%20EYU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'AUDI',
'model': 'A3 SPORTBACK',
'odometer': 65468,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4/9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43296,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002761/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4/9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42590,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002786/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4/9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41324,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002811/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4/9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39396,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002826/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4/9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37072,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002841/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4/9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36638,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002867/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4/9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77771,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002903/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4/9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65568,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002952/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4/9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75511,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002969/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4/9cbdfd8b-6b0a-5ba6-8a65-f332439f00a4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72864,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ68EYU/699002987/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'AUDI A3 SPORTBACK 1.0 30 TFSI SPORT Hatchback',
'transmission': 'manual',
'trim': '30 TFSI SPORT',
'vin': 'WAUZZZ8V4KA012941',
'year': 2018}
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ68%2520EYU%27 HTTP/1.1" 200 None
2026-03-28 22:03:49 [bca.uk] INFO: Saving data for GJ68%20EYU: {'created_time': 1774735429.358366, 'last_price_update_time': 1774735429.358379, 'auction_closing_time': 1774778400.0}
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ68%2520EYU') HTTP/1.1" 204 0
2026-03-28 22:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084983/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF20XNC/42807954?sv=2020-08-04&st=2026-03-28T22%3A03%3A38Z&se=2026-03-28T22%3A28%3A38Z&sr=b&sp=r&sig=HqECq2nNVAmAiFdZnnkNsAZVF%2FHK3rToWPsQPkpm8YM%3D)
2026-03-28 22:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084875/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699084875>
2026-03-28 22:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976211/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976211>
2026-03-28 22:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011237/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011237>
2026-03-28 22:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084870/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699084870>
2026-03-28 22:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ19JYG/42810741?sv=2020-08-04&st=2026-03-28T22%3A03%3A48Z&se=2026-03-28T22%3A28%3A48Z&sr=b&sp=r&sig=w1dVOm9NlUvvpCkKDpL5NSUYZ809EAUFO2pNnfq9jVU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MJ19%20JYG-GB>
2026-03-28 22:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011269/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG15HYL/42810937?sv=2020-08-04&st=2026-03-28T22%3A03%3A36Z&se=2026-03-28T22%3A28%3A36Z&sr=b&sp=r&sig=5%2Bm9q%2BE0Wl4g8RZLCygI%2BKewbEkOWA68pXi4u14HhvE%3D)
2026-03-28 22:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976239/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST59MKN/42810519?sv=2020-08-04&st=2026-03-28T22%3A03%3A36Z&se=2026-03-28T22%3A28%3A36Z&sr=b&sp=r&sig=qdxvmwQC9M%2F12MyUbvpDYZ0p8e9m0rs2kGxmuCWXYT4%3D)
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547740cd0>
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ab8ad02-8eed-55fd-8bce-08a2c5079d22/2ab8ad02-8eed-55fd-8bce-08a2c5079d22_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM18WKW%252F699011500%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011500/600 saved to cache
2026-03-28 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2ab8ad02-8eed-55fd-8bce-08a2c5079d22
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473dff10>
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbe411f-6de6-544b-9dbf-532e12cbc18e/2dbe411f-6de6-544b-9dbf-532e12cbc18e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK19LKN%252F698976484%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976484/600 saved to cache
2026-03-28 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2dbe411f-6de6-544b-9dbf-532e12cbc18e
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548dd950>
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbe411f-6de6-544b-9dbf-532e12cbc18e/2dbe411f-6de6-544b-9dbf-532e12cbc18e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK19LKN%252F698976422%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976422/600 saved to cache
2026-03-28 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2dbe411f-6de6-544b-9dbf-532e12cbc18e
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547f4b10>
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ab8ad02-8eed-55fd-8bce-08a2c5079d22/2ab8ad02-8eed-55fd-8bce-08a2c5079d22_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM18WKW%252F699011415%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011415/600 saved to cache
2026-03-28 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2ab8ad02-8eed-55fd-8bce-08a2c5079d22
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5476320d0>
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cdde96-e9b7-5650-a0c3-4625bb35dd6e/72cdde96-e9b7-5650-a0c3-4625bb35dd6e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST59MKN%252F698976274%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976274/600 saved to cache
2026-03-28 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 72cdde96-e9b7-5650-a0c3-4625bb35dd6e
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472e5010>
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5665b770-c5fc-5a05-b9d2-8e8d129df67b/5665b770-c5fc-5a05-b9d2-8e8d129df67b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG15HYL%252F699011291%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011291/600 saved to cache
2026-03-28 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5665b770-c5fc-5a05-b9d2-8e8d129df67b
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547632310>
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b0421d-18ef-5012-9f9a-61cd23cc4cf6/78b0421d-18ef-5012-9f9a-61cd23cc4cf6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF20XNC%252F699084888%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084888/600 saved to cache
2026-03-28 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 78b0421d-18ef-5012-9f9a-61cd23cc4cf6
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554555c50>
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b0421d-18ef-5012-9f9a-61cd23cc4cf6/78b0421d-18ef-5012-9f9a-61cd23cc4cf6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF20XNC%252F699084983%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084983/600 saved to cache
2026-03-28 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 78b0421d-18ef-5012-9f9a-61cd23cc4cf6
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55729a450>
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5665b770-c5fc-5a05-b9d2-8e8d129df67b/5665b770-c5fc-5a05-b9d2-8e8d129df67b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG15HYL%252F699011269%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011269/600 saved to cache
2026-03-28 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5665b770-c5fc-5a05-b9d2-8e8d129df67b
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554238c10>
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cdde96-e9b7-5650-a0c3-4625bb35dd6e/72cdde96-e9b7-5650-a0c3-4625bb35dd6e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST59MKN%252F698976239%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976239/600 saved to cache
2026-03-28 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 72cdde96-e9b7-5650-a0c3-4625bb35dd6e
2026-03-28 22:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011377/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM18WKW/42810921?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=u7VJrUxDokN8Iixrnjk2hyR5sgKyUuwrEDXBiO7lLtU%3D)
2026-03-28 22:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976358/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK19LKN/42810703?sv=2020-08-04&st=2026-03-28T22%3A03%3A39Z&se=2026-03-28T22%3A28%3A39Z&sr=b&sp=r&sig=4GGZxgtOFbi6XjOH0lIxuujHODhGbK%2FoxZi%2BcEW9zoI%3D)
2026-03-28 22:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976189/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976189>
2026-03-28 22:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011209/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011209>
2026-03-28 22:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RGZ2258/42810452?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=kBITiyfs97TuYzs7g7kH25vciSHF5hJ%2FRLgR6cReuFI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RGZ%202258-GB>
2026-03-28 22:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011169/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011169>
2026-03-28 22:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MH19RHF/42810725?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=Kg%2BtIUY9mVuB07ZcMhSvfMrr0cRTs83uUt6BXIeXvuI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MH19%20RHF-GB>
2026-03-28 22:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK69NEO/42810650?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=MCQCSbXeIV%2FoZtdBllblp3i0Xi85S2CxDag2PQM%2Br94%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DK69%20NEO-GB>
2026-03-28 22:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158334/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158334>
2026-03-28 22:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011114/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011114>
2026-03-28 22:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084870/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF20XNC/42807954?sv=2020-08-04&st=2026-03-28T22%3A03%3A38Z&se=2026-03-28T22%3A28%3A38Z&sr=b&sp=r&sig=HqECq2nNVAmAiFdZnnkNsAZVF%2FHK3rToWPsQPkpm8YM%3D)
2026-03-28 22:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028287/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699028287>
2026-03-28 22:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976211/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST59MKN/42810519?sv=2020-08-04&st=2026-03-28T22%3A03%3A36Z&se=2026-03-28T22%3A28%3A36Z&sr=b&sp=r&sig=qdxvmwQC9M%2F12MyUbvpDYZ0p8e9m0rs2kGxmuCWXYT4%3D)
2026-03-28 22:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011237/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG15HYL/42810937?sv=2020-08-04&st=2026-03-28T22%3A03%3A36Z&se=2026-03-28T22%3A28%3A36Z&sr=b&sp=r&sig=5%2Bm9q%2BE0Wl4g8RZLCygI%2BKewbEkOWA68pXi4u14HhvE%3D)
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554925a10>
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ab8ad02-8eed-55fd-8bce-08a2c5079d22/2ab8ad02-8eed-55fd-8bce-08a2c5079d22_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM18WKW%252F699011377%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011377/600 saved to cache
2026-03-28 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ab8ad02-8eed-55fd-8bce-08a2c5079d22
2026-03-28 22:03:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ab8ad02-8eed-55fd-8bce-08a2c5079d22, skipping ID generation
2026-03-28 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ab8ad02-8eed-55fd-8bce-08a2c5079d22 sending to next pipeline
2026-03-28 22:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2ab8ad02-8eed-55fd-8bce-08a2c5079d22, identifier: KM18%20WKW
2026-03-28 22:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5572a52d0>
2026-03-28 22:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbe411f-6de6-544b-9dbf-532e12cbc18e/2dbe411f-6de6-544b-9dbf-532e12cbc18e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK19LKN%252F698976358%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976358/600 saved to cache
2026-03-28 22:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2dbe411f-6de6-544b-9dbf-532e12cbc18e
2026-03-28 22:03:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2dbe411f-6de6-544b-9dbf-532e12cbc18e, skipping ID generation
2026-03-28 22:03:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2dbe411f-6de6-544b-9dbf-532e12cbc18e sending to next pipeline
2026-03-28 22:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2dbe411f-6de6-544b-9dbf-532e12cbc18e, identifier: GK19%20LKN
2026-03-28 22:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084875/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF20XNC/42807954?sv=2020-08-04&st=2026-03-28T22%3A03%3A38Z&se=2026-03-28T22%3A28%3A38Z&sr=b&sp=r&sig=HqECq2nNVAmAiFdZnnkNsAZVF%2FHK3rToWPsQPkpm8YM%3D)
2026-03-28 22:03:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2ab8ad02-8eed-55fd-8bce-08a2c5079d22 with identifier: KM18%20WKW
2026-03-28 22:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2ab8ad02-8eed-55fd-8bce-08a2c5079d22 with identifier: KM18%20WKW
2026-03-28 22:03:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2ab8ad02-8eed-55fd-8bce-08a2c5079d22 with identifier: KM18%20WKW to the API
2026-03-28 22:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011377/600>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab8ad02-8eed-55fd-8bce-08a2c5079d22/2ab8ad02-8eed-55fd-8bce-08a2c5079d22_expert_report_file_bbf4aae2-121a-463d-8977-ddba0df2e41c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM18%20WKW-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2ab8ad02-8eed-55fd-8bce-08a2c5079d22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KM18 WKW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KM18%20WKW&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'CLA 180',
'odometer': 83743,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab8ad02-8eed-55fd-8bce-08a2c5079d22/2ab8ad02-8eed-55fd-8bce-08a2c5079d22_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43155,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011377/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab8ad02-8eed-55fd-8bce-08a2c5079d22/2ab8ad02-8eed-55fd-8bce-08a2c5079d22_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41219,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011390/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab8ad02-8eed-55fd-8bce-08a2c5079d22/2ab8ad02-8eed-55fd-8bce-08a2c5079d22_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41643,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011406/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab8ad02-8eed-55fd-8bce-08a2c5079d22/2ab8ad02-8eed-55fd-8bce-08a2c5079d22_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38380,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011415/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab8ad02-8eed-55fd-8bce-08a2c5079d22/2ab8ad02-8eed-55fd-8bce-08a2c5079d22_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34910,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011429/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab8ad02-8eed-55fd-8bce-08a2c5079d22/2ab8ad02-8eed-55fd-8bce-08a2c5079d22_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34897,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011468/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab8ad02-8eed-55fd-8bce-08a2c5079d22/2ab8ad02-8eed-55fd-8bce-08a2c5079d22_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74477,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011500/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab8ad02-8eed-55fd-8bce-08a2c5079d22/2ab8ad02-8eed-55fd-8bce-08a2c5079d22_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51213,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011524/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab8ad02-8eed-55fd-8bce-08a2c5079d22/2ab8ad02-8eed-55fd-8bce-08a2c5079d22_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74812,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011549/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab8ad02-8eed-55fd-8bce-08a2c5079d22/2ab8ad02-8eed-55fd-8bce-08a2c5079d22_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78752,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18WKW/699011569/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLA 180 1.6 AMG LINE DCT Coupe',
'transmission': 'automatic',
'trim': 'AMG LINE DCT',
'vin': 'WDD1173422N694014',
'year': 2018}
2026-03-28 22:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM18%2520WKW%27 HTTP/1.1" 200 None
2026-03-28 22:03:50 [bca.uk] INFO: Saving data for KM18%20WKW: {'created_time': 1774735430.55891, 'last_price_update_time': 1774735430.558921, 'auction_closing_time': 1774778400.0}
2026-03-28 22:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KM18%2520WKW') HTTP/1.1" 204 0
2026-03-28 22:03:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2dbe411f-6de6-544b-9dbf-532e12cbc18e with identifier: GK19%20LKN
2026-03-28 22:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2dbe411f-6de6-544b-9dbf-532e12cbc18e with identifier: GK19%20LKN
2026-03-28 22:03:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2dbe411f-6de6-544b-9dbf-532e12cbc18e with identifier: GK19%20LKN to the API
2026-03-28 22:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976358/600>
{'auction_title': '',
'c_o_2_emission_value': 152,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbe411f-6de6-544b-9dbf-532e12cbc18e/2dbe411f-6de6-544b-9dbf-532e12cbc18e_expert_report_file_a66d8294-6c0e-4a89-84ff-51d2f56b300d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GK19%20LKN-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2dbe411f-6de6-544b-9dbf-532e12cbc18e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GK19 LKN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GK19%20LKN&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 44345,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbe411f-6de6-544b-9dbf-532e12cbc18e/2dbe411f-6de6-544b-9dbf-532e12cbc18e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48406,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976358/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbe411f-6de6-544b-9dbf-532e12cbc18e/2dbe411f-6de6-544b-9dbf-532e12cbc18e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47167,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976378/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbe411f-6de6-544b-9dbf-532e12cbc18e/2dbe411f-6de6-544b-9dbf-532e12cbc18e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45542,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976402/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbe411f-6de6-544b-9dbf-532e12cbc18e/2dbe411f-6de6-544b-9dbf-532e12cbc18e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43523,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976422/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbe411f-6de6-544b-9dbf-532e12cbc18e/2dbe411f-6de6-544b-9dbf-532e12cbc18e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40692,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976444/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbe411f-6de6-544b-9dbf-532e12cbc18e/2dbe411f-6de6-544b-9dbf-532e12cbc18e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41592,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976465/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbe411f-6de6-544b-9dbf-532e12cbc18e/2dbe411f-6de6-544b-9dbf-532e12cbc18e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107547,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976484/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbe411f-6de6-544b-9dbf-532e12cbc18e/2dbe411f-6de6-544b-9dbf-532e12cbc18e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76010,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976510/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbe411f-6de6-544b-9dbf-532e12cbc18e/2dbe411f-6de6-544b-9dbf-532e12cbc18e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80095,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976542/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbe411f-6de6-544b-9dbf-532e12cbc18e/2dbe411f-6de6-544b-9dbf-532e12cbc18e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82756,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK19LKN/698976574/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.6 112 TEKNA Hatchback',
'transmission': 'automatic',
'trim': '112 TEKNA',
'vin': 'SJNFBAF15U8050685',
'year': 2019}
2026-03-28 22:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK19%2520LKN%27 HTTP/1.1" 200 None
2026-03-28 22:03:50 [bca.uk] INFO: Saving data for GK19%20LKN: {'created_time': 1774735430.945404, 'last_price_update_time': 1774735430.945415, 'auction_closing_time': 1774778400.0}
2026-03-28 22:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GK19%2520LKN') HTTP/1.1" 204 0
2026-03-28 22:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011169/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG15HYL/42810937?sv=2020-08-04&st=2026-03-28T22%3A03%3A36Z&se=2026-03-28T22%3A28%3A36Z&sr=b&sp=r&sig=5%2Bm9q%2BE0Wl4g8RZLCygI%2BKewbEkOWA68pXi4u14HhvE%3D)
2026-03-28 22:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ19JYG/42810741?sv=2020-08-04&st=2026-03-28T22%3A03%3A48Z&se=2026-03-28T22%3A28%3A48Z&sr=b&sp=r&sig=w1dVOm9NlUvvpCkKDpL5NSUYZ809EAUFO2pNnfq9jVU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MH19RHF/42810725?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=Kg%2BtIUY9mVuB07ZcMhSvfMrr0cRTs83uUt6BXIeXvuI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011209/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG15HYL/42810937?sv=2020-08-04&st=2026-03-28T22%3A03%3A36Z&se=2026-03-28T22%3A28%3A36Z&sr=b&sp=r&sig=5%2Bm9q%2BE0Wl4g8RZLCygI%2BKewbEkOWA68pXi4u14HhvE%3D)
2026-03-28 22:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976189/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST59MKN/42810519?sv=2020-08-04&st=2026-03-28T22%3A03%3A36Z&se=2026-03-28T22%3A28%3A36Z&sr=b&sp=r&sig=qdxvmwQC9M%2F12MyUbvpDYZ0p8e9m0rs2kGxmuCWXYT4%3D)
2026-03-28 22:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK69NEO/42810650?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=MCQCSbXeIV%2FoZtdBllblp3i0Xi85S2CxDag2PQM%2Br94%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b776d0>
2026-03-28 22:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b0421d-18ef-5012-9f9a-61cd23cc4cf6/78b0421d-18ef-5012-9f9a-61cd23cc4cf6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF20XNC%252F699084870%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084870/600 saved to cache
2026-03-28 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 78b0421d-18ef-5012-9f9a-61cd23cc4cf6
2026-03-28 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548b2fd0>
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cdde96-e9b7-5650-a0c3-4625bb35dd6e/72cdde96-e9b7-5650-a0c3-4625bb35dd6e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST59MKN%252F698976211%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976211/600 saved to cache
2026-03-28 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 72cdde96-e9b7-5650-a0c3-4625bb35dd6e
2026-03-28 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542db7d0>
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5665b770-c5fc-5a05-b9d2-8e8d129df67b/5665b770-c5fc-5a05-b9d2-8e8d129df67b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG15HYL%252F699011237%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011237/600 saved to cache
2026-03-28 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5665b770-c5fc-5a05-b9d2-8e8d129df67b
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477c4990>
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b0421d-18ef-5012-9f9a-61cd23cc4cf6/78b0421d-18ef-5012-9f9a-61cd23cc4cf6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF20XNC%252F699084875%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084875/600 saved to cache
2026-03-28 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 78b0421d-18ef-5012-9f9a-61cd23cc4cf6
2026-03-28 22:03:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78b0421d-18ef-5012-9f9a-61cd23cc4cf6, skipping ID generation
2026-03-28 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78b0421d-18ef-5012-9f9a-61cd23cc4cf6 sending to next pipeline
2026-03-28 22:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 78b0421d-18ef-5012-9f9a-61cd23cc4cf6, identifier: AF20%20XNC
2026-03-28 22:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RGZ2258/42810452?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=kBITiyfs97TuYzs7g7kH25vciSHF5hJ%2FRLgR6cReuFI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 78b0421d-18ef-5012-9f9a-61cd23cc4cf6 with identifier: AF20%20XNC
2026-03-28 22:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 78b0421d-18ef-5012-9f9a-61cd23cc4cf6 with identifier: AF20%20XNC
2026-03-28 22:03:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 78b0421d-18ef-5012-9f9a-61cd23cc4cf6 with identifier: AF20%20XNC to the API
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084875/600>
{'auction_title': '',
'c_o_2_emission_value': 142,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b0421d-18ef-5012-9f9a-61cd23cc4cf6/78b0421d-18ef-5012-9f9a-61cd23cc4cf6_expert_report_file_e4172c38-8a64-4224-a727-c01a40525de9.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AF20%20XNC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '78b0421d-18ef-5012-9f9a-61cd23cc4cf6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AF20 XNC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AF20%20XNC&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'BMW',
'model': '118I',
'odometer': 81844,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b0421d-18ef-5012-9f9a-61cd23cc4cf6/78b0421d-18ef-5012-9f9a-61cd23cc4cf6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43620,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084847/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b0421d-18ef-5012-9f9a-61cd23cc4cf6/78b0421d-18ef-5012-9f9a-61cd23cc4cf6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42505,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084861/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b0421d-18ef-5012-9f9a-61cd23cc4cf6/78b0421d-18ef-5012-9f9a-61cd23cc4cf6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38009,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084870/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b0421d-18ef-5012-9f9a-61cd23cc4cf6/78b0421d-18ef-5012-9f9a-61cd23cc4cf6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36821,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084875/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b0421d-18ef-5012-9f9a-61cd23cc4cf6/78b0421d-18ef-5012-9f9a-61cd23cc4cf6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35814,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084888/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b0421d-18ef-5012-9f9a-61cd23cc4cf6/78b0421d-18ef-5012-9f9a-61cd23cc4cf6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36402,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084897/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b0421d-18ef-5012-9f9a-61cd23cc4cf6/78b0421d-18ef-5012-9f9a-61cd23cc4cf6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63621,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084918/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b0421d-18ef-5012-9f9a-61cd23cc4cf6/78b0421d-18ef-5012-9f9a-61cd23cc4cf6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60175,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084936/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b0421d-18ef-5012-9f9a-61cd23cc4cf6/78b0421d-18ef-5012-9f9a-61cd23cc4cf6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101327,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084959/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b0421d-18ef-5012-9f9a-61cd23cc4cf6/78b0421d-18ef-5012-9f9a-61cd23cc4cf6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98519,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF20XNC/699084983/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'BMW 118I 1.5 SPORT STEP Hatchback',
'transmission': 'automatic',
'trim': 'SPORT STEP',
'vin': 'WBA7K320505R60339',
'year': 2020}
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF20%2520XNC%27 HTTP/1.1" 200 None
2026-03-28 22:03:51 [bca.uk] INFO: Saving data for AF20%20XNC: {'created_time': 1774735431.630673, 'last_price_update_time': 1774735431.630684, 'auction_closing_time': 1774951200.0}
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AF20%2520XNC') HTTP/1.1" 204 0
2026-03-28 22:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011114/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG15HYL/42810937?sv=2020-08-04&st=2026-03-28T22%3A03%3A36Z&se=2026-03-28T22%3A28%3A36Z&sr=b&sp=r&sig=5%2Bm9q%2BE0Wl4g8RZLCygI%2BKewbEkOWA68pXi4u14HhvE%3D)
2026-03-28 22:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH70HRN/42810982?sv=2020-08-04&st=2026-03-28T22%3A03%3A50Z&se=2026-03-28T22%3A28%3A50Z&sr=b&sp=r&sig=z772%2BQEc4Xe%2FDYwJDwuoncqvDgwdMOZOP65i6cisEww%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YH70%20HRN-GB>
2026-03-28 22:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011098/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011098>
2026-03-28 22:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK68WZS/42810938?sv=2020-08-04&st=2026-03-28T22%3A03%3A51Z&se=2026-03-28T22%3A28%3A51Z&sr=b&sp=r&sig=RIKAWuJBzwkqe2GFufXdWIdytCoD47TJXidmKusSd5U%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RK68%20WZS-GB>
2026-03-28 22:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028285/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699028285>
2026-03-28 22:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158334/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY66XSJ/42810063?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=n4o%2FwpUrt5NmnHO4b%2FuTK0GIrxHv%2BFYQBHPaaSLhQm0%3D)
2026-03-28 22:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028287/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK11NXR/42811064?sv=2020-08-04&st=2026-03-28T22%3A03%3A33Z&se=2026-03-28T22%3A28%3A33Z&sr=b&sp=r&sig=WQwb7hHALscNLn8OXQjUUwD9ln4%2BEG5I6c0xHH7%2BOPc%3D)
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548b3710>
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5665b770-c5fc-5a05-b9d2-8e8d129df67b/5665b770-c5fc-5a05-b9d2-8e8d129df67b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG15HYL%252F699011169%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011169/600 saved to cache
2026-03-28 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5665b770-c5fc-5a05-b9d2-8e8d129df67b
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543bbf90>
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7c54e9b-c505-5a1c-96f8-efc7e46f0480/a7c54e9b-c505-5a1c-96f8-efc7e46f0480_expert_report_file_6672d68d-88e2-4d84-b160-6d6dc6aeebaf.pdf HTTP/1.1" 201 0
2026-03-28 22:03:51 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a7c54e9b-c505-5a1c-96f8-efc7e46f0480
2026-03-28 22:03:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7c54e9b-c505-5a1c-96f8-efc7e46f0480, skipping ID generation
2026-03-28 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a7c54e9b-c505-5a1c-96f8-efc7e46f0480
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMJ19JYG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MJ19JYG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543ba190>
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7bbb95c-34a4-508c-9af6-6415bfd76278/f7bbb95c-34a4-508c-9af6-6415bfd76278_expert_report_file_16f7b7fa-fe31-4a0d-ae0a-98726fba2c38.pdf HTTP/1.1" 201 0
2026-03-28 22:03:51 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f7bbb95c-34a4-508c-9af6-6415bfd76278
2026-03-28 22:03:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f7bbb95c-34a4-508c-9af6-6415bfd76278, skipping ID generation
2026-03-28 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f7bbb95c-34a4-508c-9af6-6415bfd76278
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMH19RHF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MH19RHF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54772a7d0>
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5665b770-c5fc-5a05-b9d2-8e8d129df67b/5665b770-c5fc-5a05-b9d2-8e8d129df67b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG15HYL%252F699011209%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011209/600 saved to cache
2026-03-28 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5665b770-c5fc-5a05-b9d2-8e8d129df67b
2026-03-28 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548de210>
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cdde96-e9b7-5650-a0c3-4625bb35dd6e/72cdde96-e9b7-5650-a0c3-4625bb35dd6e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST59MKN%252F698976189%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976189/600 saved to cache
2026-03-28 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 72cdde96-e9b7-5650-a0c3-4625bb35dd6e
2026-03-28 22:03:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72cdde96-e9b7-5650-a0c3-4625bb35dd6e, skipping ID generation
2026-03-28 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72cdde96-e9b7-5650-a0c3-4625bb35dd6e sending to next pipeline
2026-03-28 22:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 72cdde96-e9b7-5650-a0c3-4625bb35dd6e, identifier: ST59%20MKN
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477c5490>
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6/4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6_expert_report_file_81df544f-1ee1-45ac-825d-04134a5ded1d.pdf HTTP/1.1" 201 0
2026-03-28 22:03:51 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6
2026-03-28 22:03:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6, skipping ID generation
2026-03-28 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6
2026-03-28 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDK69NEO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DK69NEO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547742110>
2026-03-28 22:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df646afa-cd7d-59ba-af23-e32bf2546109/df646afa-cd7d-59ba-af23-e32bf2546109_expert_report_file_4a54dea4-4198-4fb1-a0e7-dea4fa99d8b8.pdf HTTP/1.1" 201 0
2026-03-28 22:03:52 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item df646afa-cd7d-59ba-af23-e32bf2546109
2026-03-28 22:03:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df646afa-cd7d-59ba-af23-e32bf2546109, skipping ID generation
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item df646afa-cd7d-59ba-af23-e32bf2546109
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRGZ2258-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RGZ2258-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 72cdde96-e9b7-5650-a0c3-4625bb35dd6e with identifier: ST59%20MKN
2026-03-28 22:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 72cdde96-e9b7-5650-a0c3-4625bb35dd6e with identifier: ST59%20MKN
2026-03-28 22:03:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 72cdde96-e9b7-5650-a0c3-4625bb35dd6e with identifier: ST59%20MKN to the API
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976189/600>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cdde96-e9b7-5650-a0c3-4625bb35dd6e/72cdde96-e9b7-5650-a0c3-4625bb35dd6e_expert_report_file_8ffa991d-9332-4a51-8ff1-9d3f289e282b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ST59%20MKN-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '72cdde96-e9b7-5650-a0c3-4625bb35dd6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ST59 MKN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ST59%20MKN&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'KIA',
'model': 'PICANTO',
'odometer': 1,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cdde96-e9b7-5650-a0c3-4625bb35dd6e/72cdde96-e9b7-5650-a0c3-4625bb35dd6e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39132,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976062/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cdde96-e9b7-5650-a0c3-4625bb35dd6e/72cdde96-e9b7-5650-a0c3-4625bb35dd6e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38904,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976083/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cdde96-e9b7-5650-a0c3-4625bb35dd6e/72cdde96-e9b7-5650-a0c3-4625bb35dd6e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40009,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976105/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cdde96-e9b7-5650-a0c3-4625bb35dd6e/72cdde96-e9b7-5650-a0c3-4625bb35dd6e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39598,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976130/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cdde96-e9b7-5650-a0c3-4625bb35dd6e/72cdde96-e9b7-5650-a0c3-4625bb35dd6e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38331,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976142/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cdde96-e9b7-5650-a0c3-4625bb35dd6e/72cdde96-e9b7-5650-a0c3-4625bb35dd6e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37968,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976157/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cdde96-e9b7-5650-a0c3-4625bb35dd6e/72cdde96-e9b7-5650-a0c3-4625bb35dd6e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93574,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976189/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cdde96-e9b7-5650-a0c3-4625bb35dd6e/72cdde96-e9b7-5650-a0c3-4625bb35dd6e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68832,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976211/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cdde96-e9b7-5650-a0c3-4625bb35dd6e/72cdde96-e9b7-5650-a0c3-4625bb35dd6e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83716,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976239/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cdde96-e9b7-5650-a0c3-4625bb35dd6e/72cdde96-e9b7-5650-a0c3-4625bb35dd6e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78874,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST59MKN/698976274/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'KIA PICANTO 1.0 1 Hatchback',
'transmission': 'manual',
'trim': '1',
'vin': 'KNABF514LAT859341',
'year': 2009}
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST59%2520MKN%27 HTTP/1.1" 200 None
2026-03-28 22:03:52 [bca.uk] INFO: Saving data for ST59%20MKN: {'created_time': 1774735432.53366, 'last_price_update_time': 1774735432.533671, 'auction_closing_time': 1774778400.0}
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ST59%2520MKN') HTTP/1.1" 204 0
2026-03-28 22:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158308/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158308>
2026-03-28 22:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699146028/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146028>
2026-03-28 22:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189301/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189301>
2026-03-28 22:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994592/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994592>
2026-03-28 22:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251710/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251710>
2026-03-28 22:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG72UJY/42810751?sv=2020-08-04&st=2026-03-28T22%3A03%3A51Z&se=2026-03-28T22%3A28%3A51Z&sr=b&sp=r&sig=SXJbCQ8vL0YTQrDvTTDF%2Fh3lr%2FnU8Qo3%2F7A1RB26qWE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LG72%20UJY-GB>
2026-03-28 22:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011083/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DG15HYL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015664%27 HTTP/1.1" 200 None
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015664 not downloaded yet
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011347%27 HTTP/1.1" 200 None
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011347 not downloaded yet
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002708%27 HTTP/1.1" 200 None
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002708 not downloaded yet
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698969352%27 HTTP/1.1" 200 None
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698969352 not downloaded yet
2026-03-28 22:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028284/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699028284>
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015672%27 HTTP/1.1" 200 None
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015672 not downloaded yet
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011353%27 HTTP/1.1" 200 None
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011353 not downloaded yet
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002719%27 HTTP/1.1" 200 None
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002719 not downloaded yet
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698969363%27 HTTP/1.1" 200 None
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698969363 not downloaded yet
2026-03-28 22:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548dff90>
2026-03-28 22:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5665b770-c5fc-5a05-b9d2-8e8d129df67b/5665b770-c5fc-5a05-b9d2-8e8d129df67b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG15HYL%252F699011114%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011114/600 saved to cache
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5665b770-c5fc-5a05-b9d2-8e8d129df67b
2026-03-28 22:03:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547447f10>
2026-03-28 22:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b40829-d997-5432-a0e4-0fd30767ce9e/43b40829-d997-5432-a0e4-0fd30767ce9e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY66XSJ%252F699158334%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158334/600 saved to cache
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 43b40829-d997-5432-a0e4-0fd30767ce9e
2026-03-28 22:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471134d0>
2026-03-28 22:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f/cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK11NXR%252F699028287%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028287/600 saved to cache
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f
2026-03-28 22:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011098/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG15HYL/42810937?sv=2020-08-04&st=2026-03-28T22%3A03%3A36Z&se=2026-03-28T22%3A28%3A36Z&sr=b&sp=r&sig=5%2Bm9q%2BE0Wl4g8RZLCygI%2BKewbEkOWA68pXi4u14HhvE%3D)
2026-03-28 22:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189292/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189292>
2026-03-28 22:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158295/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158295>
2026-03-28 22:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251699/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251699>
2026-03-28 22:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994573/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994573>
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015681%27 HTTP/1.1" 200 None
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015681 not downloaded yet
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011362%27 HTTP/1.1" 200 None
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011362 not downloaded yet
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002733%27 HTTP/1.1" 200 None
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002733 not downloaded yet
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698969375%27 HTTP/1.1" 200 None
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698969375 not downloaded yet
2026-03-28 22:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028285/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK11NXR/42811064?sv=2020-08-04&st=2026-03-28T22%3A03%3A33Z&se=2026-03-28T22%3A28%3A33Z&sr=b&sp=r&sig=WQwb7hHALscNLn8OXQjUUwD9ln4%2BEG5I6c0xHH7%2BOPc%3D)
2026-03-28 22:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK68WZS/42810938?sv=2020-08-04&st=2026-03-28T22%3A03%3A51Z&se=2026-03-28T22%3A28%3A51Z&sr=b&sp=r&sig=RIKAWuJBzwkqe2GFufXdWIdytCoD47TJXidmKusSd5U%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH70HRN/42810982?sv=2020-08-04&st=2026-03-28T22%3A03%3A50Z&se=2026-03-28T22%3A28%3A50Z&sr=b&sp=r&sig=z772%2BQEc4Xe%2FDYwJDwuoncqvDgwdMOZOP65i6cisEww%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015688%27 HTTP/1.1" 200 None
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015688 not downloaded yet
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011369%27 HTTP/1.1" 200 None
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011369 not downloaded yet
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002747%27 HTTP/1.1" 200 None
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002747 not downloaded yet
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698969388%27 HTTP/1.1" 200 None
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698969388 not downloaded yet
2026-03-28 22:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011083/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG15HYL/42810937?sv=2020-08-04&st=2026-03-28T22%3A03%3A36Z&se=2026-03-28T22%3A28%3A36Z&sr=b&sp=r&sig=5%2Bm9q%2BE0Wl4g8RZLCygI%2BKewbEkOWA68pXi4u14HhvE%3D)
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015695%27 HTTP/1.1" 200 None
2026-03-28 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015695 not downloaded yet
2026-03-28 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011388%27 HTTP/1.1" 200 None
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011388 not downloaded yet
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002769%27 HTTP/1.1" 200 None
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002769 not downloaded yet
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698969396%27 HTTP/1.1" 200 None
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698969396 not downloaded yet
2026-03-28 22:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994592/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV65GFU/42810585?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=Uw05gug7lwLgV7s2MX8pmDxdS7jFiOh93SlRxrnK0ts%3D)
2026-03-28 22:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189301/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU67EBV/42807577?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=Dc9GP37lnEoc8Ucnf7mZMpnnsmm75eM47cbqeVO4%2BUo%3D)
2026-03-28 22:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251710/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW67HUY/42806780?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=IjccUHM%2BUsRolC4agemnjyYj%2By8q%2BaL%2Bv6NarfY2Bpc%3D)
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015713%27 HTTP/1.1" 200 None
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015713 not downloaded yet
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011421%27 HTTP/1.1" 200 None
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011421 not downloaded yet
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002813%27 HTTP/1.1" 200 None
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002813 not downloaded yet
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698969410%27 HTTP/1.1" 200 None
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698969410 not downloaded yet
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548fed10>
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5665b770-c5fc-5a05-b9d2-8e8d129df67b/5665b770-c5fc-5a05-b9d2-8e8d129df67b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG15HYL%252F699011098%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011098/600 saved to cache
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5665b770-c5fc-5a05-b9d2-8e8d129df67b
2026-03-28 22:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158308/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY66XSJ/42810063?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=n4o%2FwpUrt5NmnHO4b%2FuTK0GIrxHv%2BFYQBHPaaSLhQm0%3D)
2026-03-28 22:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699146028/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OU64UPA/42811127?sv=2020-08-04&st=2026-03-28T22%3A03%3A31Z&se=2026-03-28T22%3A28%3A31Z&sr=b&sp=r&sig=8BqSQERI1JQCVBe1x8fbzIsYG%2BShES3mtYstvdJ8vEg%3D)
2026-03-28 22:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG72UJY/42810751?sv=2020-08-04&st=2026-03-28T22%3A03%3A51Z&se=2026-03-28T22%3A28%3A51Z&sr=b&sp=r&sig=SXJbCQ8vL0YTQrDvTTDF%2Fh3lr%2FnU8Qo3%2F7A1RB26qWE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015754%27 HTTP/1.1" 200 None
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015754 not downloaded yet
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011456%27 HTTP/1.1" 200 None
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011456 not downloaded yet
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002836%27 HTTP/1.1" 200 None
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002836 not downloaded yet
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698969422%27 HTTP/1.1" 200 None
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698969422 not downloaded yet
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555c63610>
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f/cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK11NXR%252F699028285%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028285/600 saved to cache
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549049d0>
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e86ebe18-a2b5-52bb-9b19-9683b6ffda08/e86ebe18-a2b5-52bb-9b19-9683b6ffda08_expert_report_file_d27dff29-b937-4a77-bfda-ede0e86eb4b1.pdf HTTP/1.1" 201 0
2026-03-28 22:03:53 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e86ebe18-a2b5-52bb-9b19-9683b6ffda08
2026-03-28 22:03:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e86ebe18-a2b5-52bb-9b19-9683b6ffda08, skipping ID generation
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e86ebe18-a2b5-52bb-9b19-9683b6ffda08
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRK68WZS-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RK68WZS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547371050>
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fa3513c-d7c1-5913-b481-6acfffd741bf/6fa3513c-d7c1-5913-b481-6acfffd741bf_expert_report_file_043ce6ae-9ae9-4ff3-a96a-781edb662c42.pdf HTTP/1.1" 201 0
2026-03-28 22:03:53 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6fa3513c-d7c1-5913-b481-6acfffd741bf
2026-03-28 22:03:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6fa3513c-d7c1-5913-b481-6acfffd741bf, skipping ID generation
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6fa3513c-d7c1-5913-b481-6acfffd741bf
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYH70HRN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YH70HRN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994573/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV65GFU/42810585?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=Uw05gug7lwLgV7s2MX8pmDxdS7jFiOh93SlRxrnK0ts%3D)
2026-03-28 22:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028284/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK11NXR/42811064?sv=2020-08-04&st=2026-03-28T22%3A03%3A33Z&se=2026-03-28T22%3A28%3A33Z&sr=b&sp=r&sig=WQwb7hHALscNLn8OXQjUUwD9ln4%2BEG5I6c0xHH7%2BOPc%3D)
2026-03-28 22:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158295/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY66XSJ/42810063?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=n4o%2FwpUrt5NmnHO4b%2FuTK0GIrxHv%2BFYQBHPaaSLhQm0%3D)
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015789%27 HTTP/1.1" 200 None
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015789 not downloaded yet
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011489%27 HTTP/1.1" 200 None
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011489 not downloaded yet
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002890%27 HTTP/1.1" 200 None
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002890 not downloaded yet
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698969433%27 HTTP/1.1" 200 None
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698969433 not downloaded yet
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146357%27 HTTP/1.1" 200 None
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146357 not downloaded yet
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147051%27 HTTP/1.1" 200 None
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147051 not downloaded yet
2026-03-28 22:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189292/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU67EBV/42807577?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=Dc9GP37lnEoc8Ucnf7mZMpnnsmm75eM47cbqeVO4%2BUo%3D)
2026-03-28 22:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251699/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW67HUY/42806780?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=IjccUHM%2BUsRolC4agemnjyYj%2By8q%2BaL%2Bv6NarfY2Bpc%3D)
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542a4310>
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5665b770-c5fc-5a05-b9d2-8e8d129df67b/5665b770-c5fc-5a05-b9d2-8e8d129df67b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG15HYL%252F699011083%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011083/600 saved to cache
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5665b770-c5fc-5a05-b9d2-8e8d129df67b
2026-03-28 22:03:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5665b770-c5fc-5a05-b9d2-8e8d129df67b, skipping ID generation
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5665b770-c5fc-5a05-b9d2-8e8d129df67b sending to next pipeline
2026-03-28 22:03:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5665b770-c5fc-5a05-b9d2-8e8d129df67b, identifier: DG15%20HYL
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557365850>
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63a9213b-9753-5663-b464-16226cca8eb4/63a9213b-9753-5663-b464-16226cca8eb4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV65GFU%252F698994592%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994592/600 saved to cache
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 63a9213b-9753-5663-b464-16226cca8eb4
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542fd8d0>
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d00f4d6-3827-55c1-a06a-583364af76a6/2d00f4d6-3827-55c1-a06a-583364af76a6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU67EBV%252F699189301%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189301/600 saved to cache
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2d00f4d6-3827-55c1-a06a-583364af76a6
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554302490>
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3649b9f8-64ee-584f-9d2b-f46b1db86e38/3649b9f8-64ee-584f-9d2b-f46b1db86e38_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKW67HUY%252F699251710%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251710/600 saved to cache
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3649b9f8-64ee-584f-9d2b-f46b1db86e38
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547660850>
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b40829-d997-5432-a0e4-0fd30767ce9e/43b40829-d997-5432-a0e4-0fd30767ce9e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY66XSJ%252F699158308%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158308/600 saved to cache
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 43b40829-d997-5432-a0e4-0fd30767ce9e
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547663ed0>
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4f2d0a0-2885-57c7-ae21-ea61c25273d9/d4f2d0a0-2885-57c7-ae21-ea61c25273d9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOU64UPA%252F699146028%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699146028/600 saved to cache
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d4f2d0a0-2885-57c7-ae21-ea61c25273d9
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547104390>
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55409954-1173-5276-a10a-2f132fbeb032/55409954-1173-5276-a10a-2f132fbeb032_expert_report_file_886f2db9-433b-464a-ab13-6b2619985339.pdf HTTP/1.1" 201 0
2026-03-28 22:03:53 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 55409954-1173-5276-a10a-2f132fbeb032
2026-03-28 22:03:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55409954-1173-5276-a10a-2f132fbeb032, skipping ID generation
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55409954-1173-5276-a10a-2f132fbeb032
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLG72UJY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LG72UJY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969363/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698969363>
2026-03-28 22:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969375/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698969375>
2026-03-28 22:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002733/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002733>
2026-03-28 22:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011362/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011362>
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015822%27 HTTP/1.1" 200 None
2026-03-28 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015822 not downloaded yet
2026-03-28 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011532%27 HTTP/1.1" 200 None
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011532 not downloaded yet
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002931%27 HTTP/1.1" 200 None
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002931 not downloaded yet
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698969442%27 HTTP/1.1" 200 None
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698969442 not downloaded yet
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146364%27 HTTP/1.1" 200 None
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146364 not downloaded yet
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147058%27 HTTP/1.1" 200 None
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147058 not downloaded yet
2026-03-28 22:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5665b770-c5fc-5a05-b9d2-8e8d129df67b with identifier: DG15%20HYL
2026-03-28 22:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5665b770-c5fc-5a05-b9d2-8e8d129df67b with identifier: DG15%20HYL
2026-03-28 22:03:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5665b770-c5fc-5a05-b9d2-8e8d129df67b with identifier: DG15%20HYL to the API
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011083/600>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5665b770-c5fc-5a05-b9d2-8e8d129df67b/5665b770-c5fc-5a05-b9d2-8e8d129df67b_expert_report_file_1cad6454-d6fb-4d25-8b07-49367f48a2b8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DG15%20HYL-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '5665b770-c5fc-5a05-b9d2-8e8d129df67b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DG15 HYL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DG15%20HYL&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'SKODA',
'model': 'SUPERB',
'odometer': 48086,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5665b770-c5fc-5a05-b9d2-8e8d129df67b/5665b770-c5fc-5a05-b9d2-8e8d129df67b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39217,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011083/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5665b770-c5fc-5a05-b9d2-8e8d129df67b/5665b770-c5fc-5a05-b9d2-8e8d129df67b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39247,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011098/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5665b770-c5fc-5a05-b9d2-8e8d129df67b/5665b770-c5fc-5a05-b9d2-8e8d129df67b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37406,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011114/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5665b770-c5fc-5a05-b9d2-8e8d129df67b/5665b770-c5fc-5a05-b9d2-8e8d129df67b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36471,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011133/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5665b770-c5fc-5a05-b9d2-8e8d129df67b/5665b770-c5fc-5a05-b9d2-8e8d129df67b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33072,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011154/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5665b770-c5fc-5a05-b9d2-8e8d129df67b/5665b770-c5fc-5a05-b9d2-8e8d129df67b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33375,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011169/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5665b770-c5fc-5a05-b9d2-8e8d129df67b/5665b770-c5fc-5a05-b9d2-8e8d129df67b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75018,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011209/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5665b770-c5fc-5a05-b9d2-8e8d129df67b/5665b770-c5fc-5a05-b9d2-8e8d129df67b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62027,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011237/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5665b770-c5fc-5a05-b9d2-8e8d129df67b/5665b770-c5fc-5a05-b9d2-8e8d129df67b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82554,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011269/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5665b770-c5fc-5a05-b9d2-8e8d129df67b/5665b770-c5fc-5a05-b9d2-8e8d129df67b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85893,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG15HYL/699011291/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'SKODA SUPERB 2.0 TDI CR 140 ELEGANCE 4X4 Hatchback',
'transmission': 'manual',
'trim': 'TDI CR 140 ELEGANCE 4X4',
'vin': 'TMBDE73TXF9045291',
'year': 2015}
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG15%2520HYL%27 HTTP/1.1" 200 None
2026-03-28 22:03:54 [bca.uk] INFO: Saving data for DG15%20HYL: {'created_time': 1774735434.483548, 'last_price_update_time': 1774735434.48356, 'auction_closing_time': 1774778400.0}
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DG15%2520HYL') HTTP/1.1" 204 0
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145158%27 HTTP/1.1" 200 None
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145158 not downloaded yet
2026-03-28 22:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969388/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698969388>
2026-03-28 22:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969396/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698969396>
2026-03-28 22:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011388/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011388>
2026-03-28 22:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002769/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002769>
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146369%27 HTTP/1.1" 200 None
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146369 not downloaded yet
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147067%27 HTTP/1.1" 200 None
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147067 not downloaded yet
2026-03-28 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472be8d0>
2026-03-28 22:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63a9213b-9753-5663-b464-16226cca8eb4/63a9213b-9753-5663-b464-16226cca8eb4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV65GFU%252F698994573%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994573/600 saved to cache
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 63a9213b-9753-5663-b464-16226cca8eb4
2026-03-28 22:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54713d150>
2026-03-28 22:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f/cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK11NXR%252F699028284%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028284/600 saved to cache
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f
2026-03-28 22:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474978d0>
2026-03-28 22:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b40829-d997-5432-a0e4-0fd30767ce9e/43b40829-d997-5432-a0e4-0fd30767ce9e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY66XSJ%252F699158295%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158295/600 saved to cache
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 43b40829-d997-5432-a0e4-0fd30767ce9e
2026-03-28 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554345090>
2026-03-28 22:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d00f4d6-3827-55c1-a06a-583364af76a6/2d00f4d6-3827-55c1-a06a-583364af76a6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU67EBV%252F699189292%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189292/600 saved to cache
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2d00f4d6-3827-55c1-a06a-583364af76a6
2026-03-28 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472be850>
2026-03-28 22:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3649b9f8-64ee-584f-9d2b-f46b1db86e38/3649b9f8-64ee-584f-9d2b-f46b1db86e38_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKW67HUY%252F699251699%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251699/600 saved to cache
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3649b9f8-64ee-584f-9d2b-f46b1db86e38
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145166%27 HTTP/1.1" 200 None
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145166 not downloaded yet
2026-03-28 22:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002813/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002813>
2026-03-28 22:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011421/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011421>
2026-03-28 22:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015713/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015713>
2026-03-28 22:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969410/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698969410>
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146374%27 HTTP/1.1" 200 None
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146374 not downloaded yet
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147074%27 HTTP/1.1" 200 None
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147074 not downloaded yet
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145177%27 HTTP/1.1" 200 None
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145177 not downloaded yet
2026-03-28 22:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969422/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698969422>
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146379%27 HTTP/1.1" 200 None
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146379 not downloaded yet
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147082%27 HTTP/1.1" 200 None
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147082 not downloaded yet
2026-03-28 22:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002836/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002836>
2026-03-28 22:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147044/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YH70HRN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146345/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RK68WZS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145182%27 HTTP/1.1" 200 None
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145182 not downloaded yet
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146397%27 HTTP/1.1" 200 None
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146397 not downloaded yet
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147098%27 HTTP/1.1" 200 None
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147098 not downloaded yet
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145191%27 HTTP/1.1" 200 None
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145191 not downloaded yet
2026-03-28 22:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969375/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RGZ2258/42810452?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=kBITiyfs97TuYzs7g7kH25vciSHF5hJ%2FRLgR6cReuFI%3D)
2026-03-28 22:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969363/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RGZ2258/42810452?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=kBITiyfs97TuYzs7g7kH25vciSHF5hJ%2FRLgR6cReuFI%3D)
2026-03-28 22:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011362/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MH19RHF/42810725?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=Kg%2BtIUY9mVuB07ZcMhSvfMrr0cRTs83uUt6BXIeXvuI%3D)
2026-03-28 22:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002733/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK69NEO/42810650?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=MCQCSbXeIV%2FoZtdBllblp3i0Xi85S2CxDag2PQM%2Br94%3D)
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146412%27 HTTP/1.1" 200 None
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146412 not downloaded yet
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147115%27 HTTP/1.1" 200 None
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147115 not downloaded yet
2026-03-28 22:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969388/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RGZ2258/42810452?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=kBITiyfs97TuYzs7g7kH25vciSHF5hJ%2FRLgR6cReuFI%3D)
2026-03-28 22:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011388/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MH19RHF/42810725?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=Kg%2BtIUY9mVuB07ZcMhSvfMrr0cRTs83uUt6BXIeXvuI%3D)
2026-03-28 22:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969396/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RGZ2258/42810452?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=kBITiyfs97TuYzs7g7kH25vciSHF5hJ%2FRLgR6cReuFI%3D)
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145207%27 HTTP/1.1" 200 None
2026-03-28 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145207 not downloaded yet
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146428%27 HTTP/1.1" 200 None
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146428 not downloaded yet
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147130%27 HTTP/1.1" 200 None
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147130 not downloaded yet
2026-03-28 22:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002769/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK69NEO/42810650?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=MCQCSbXeIV%2FoZtdBllblp3i0Xi85S2CxDag2PQM%2Br94%3D)
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145222%27 HTTP/1.1" 200 None
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145222 not downloaded yet
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146438%27 HTTP/1.1" 200 None
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146438 not downloaded yet
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147144%27 HTTP/1.1" 200 None
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147144 not downloaded yet
2026-03-28 22:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147044/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH70HRN/42810982?sv=2020-08-04&st=2026-03-28T22%3A03%3A50Z&se=2026-03-28T22%3A28%3A50Z&sr=b&sp=r&sig=z772%2BQEc4Xe%2FDYwJDwuoncqvDgwdMOZOP65i6cisEww%3D)
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145238%27 HTTP/1.1" 200 None
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145238 not downloaded yet
2026-03-28 22:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011421/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MH19RHF/42810725?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=Kg%2BtIUY9mVuB07ZcMhSvfMrr0cRTs83uUt6BXIeXvuI%3D)
2026-03-28 22:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969410/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RGZ2258/42810452?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=kBITiyfs97TuYzs7g7kH25vciSHF5hJ%2FRLgR6cReuFI%3D)
2026-03-28 22:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146345/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK68WZS/42810938?sv=2020-08-04&st=2026-03-28T22%3A03%3A51Z&se=2026-03-28T22%3A28%3A51Z&sr=b&sp=r&sig=RIKAWuJBzwkqe2GFufXdWIdytCoD47TJXidmKusSd5U%3D)
2026-03-28 22:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015713/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ19JYG/42810741?sv=2020-08-04&st=2026-03-28T22%3A03%3A48Z&se=2026-03-28T22%3A28%3A48Z&sr=b&sp=r&sig=w1dVOm9NlUvvpCkKDpL5NSUYZ809EAUFO2pNnfq9jVU%3D)
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145250%27 HTTP/1.1" 200 None
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145250 not downloaded yet
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472bc8d0>
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df646afa-cd7d-59ba-af23-e32bf2546109/df646afa-cd7d-59ba-af23-e32bf2546109_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRGZ2258%252F698969375%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969375/600 saved to cache
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df646afa-cd7d-59ba-af23-e32bf2546109
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547364bd0>
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df646afa-cd7d-59ba-af23-e32bf2546109/df646afa-cd7d-59ba-af23-e32bf2546109_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRGZ2258%252F698969363%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969363/600 saved to cache
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df646afa-cd7d-59ba-af23-e32bf2546109
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b02710>
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7bbb95c-34a4-508c-9af6-6415bfd76278/f7bbb95c-34a4-508c-9af6-6415bfd76278_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMH19RHF%252F699011362%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011362/600 saved to cache
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f7bbb95c-34a4-508c-9af6-6415bfd76278
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542d7d50>
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6/4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK69NEO%252F699002733%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002733/600 saved to cache
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542fc810>
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df646afa-cd7d-59ba-af23-e32bf2546109/df646afa-cd7d-59ba-af23-e32bf2546109_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRGZ2258%252F698969388%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969388/600 saved to cache
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df646afa-cd7d-59ba-af23-e32bf2546109
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54713fa50>
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7bbb95c-34a4-508c-9af6-6415bfd76278/f7bbb95c-34a4-508c-9af6-6415bfd76278_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMH19RHF%252F699011388%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011388/600 saved to cache
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f7bbb95c-34a4-508c-9af6-6415bfd76278
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548def90>
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df646afa-cd7d-59ba-af23-e32bf2546109/df646afa-cd7d-59ba-af23-e32bf2546109_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRGZ2258%252F698969396%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969396/600 saved to cache
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df646afa-cd7d-59ba-af23-e32bf2546109
2026-03-28 22:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145191/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145191>
2026-03-28 22:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969422/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RGZ2258/42810452?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=kBITiyfs97TuYzs7g7kH25vciSHF5hJ%2FRLgR6cReuFI%3D)
2026-03-28 22:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002836/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK69NEO/42810650?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=MCQCSbXeIV%2FoZtdBllblp3i0Xi85S2CxDag2PQM%2Br94%3D)
2026-03-28 22:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002813/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK69NEO/42810650?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=MCQCSbXeIV%2FoZtdBllblp3i0Xi85S2CxDag2PQM%2Br94%3D)
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547225e10>
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6/4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK69NEO%252F699002769%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002769/600 saved to cache
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547262f10>
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fa3513c-d7c1-5913-b481-6acfffd741bf/6fa3513c-d7c1-5913-b481-6acfffd741bf_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH70HRN%252F699147044%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147044/600 saved to cache
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6fa3513c-d7c1-5913-b481-6acfffd741bf
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549843d0>
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7bbb95c-34a4-508c-9af6-6415bfd76278/f7bbb95c-34a4-508c-9af6-6415bfd76278_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMH19RHF%252F699011421%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011421/600 saved to cache
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f7bbb95c-34a4-508c-9af6-6415bfd76278
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547263950>
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df646afa-cd7d-59ba-af23-e32bf2546109/df646afa-cd7d-59ba-af23-e32bf2546109_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRGZ2258%252F698969410%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969410/600 saved to cache
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item df646afa-cd7d-59ba-af23-e32bf2546109
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554916810>
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e86ebe18-a2b5-52bb-9b19-9683b6ffda08/e86ebe18-a2b5-52bb-9b19-9683b6ffda08_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK68WZS%252F699146345%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146345/600 saved to cache
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e86ebe18-a2b5-52bb-9b19-9683b6ffda08
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547262510>
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7c54e9b-c505-5a1c-96f8-efc7e46f0480/a7c54e9b-c505-5a1c-96f8-efc7e46f0480_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ19JYG%252F699015713%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015713/600 saved to cache
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7c54e9b-c505-5a1c-96f8-efc7e46f0480
2026-03-28 22:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147082/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147082>
2026-03-28 22:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146397/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146397>
2026-03-28 22:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145182/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145182>
2026-03-28 22:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147098/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147098>
2026-03-28 22:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145177/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145177>
2026-03-28 22:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146379/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146379>
2026-03-28 22:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145207/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145207>
2026-03-28 22:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145222/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145222>
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a150d0>
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df646afa-cd7d-59ba-af23-e32bf2546109/df646afa-cd7d-59ba-af23-e32bf2546109_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRGZ2258%252F698969422%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969422/600 saved to cache
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item df646afa-cd7d-59ba-af23-e32bf2546109
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543384d0>
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6/4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK69NEO%252F699002836%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002836/600 saved to cache
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54732fed0>
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6/4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK69NEO%252F699002813%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002813/600 saved to cache
2026-03-28 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6
2026-03-28 22:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145250/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145250>
2026-03-28 22:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145238/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145238>
2026-03-28 22:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147130/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147130>
2026-03-28 22:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146438/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146438>
2026-03-28 22:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146428/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146428>
2026-03-28 22:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147144/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147144>
2026-03-28 22:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147115/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147115>
2026-03-28 22:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145191/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG72UJY/42810751?sv=2020-08-04&st=2026-03-28T22%3A03%3A51Z&se=2026-03-28T22%3A28%3A51Z&sr=b&sp=r&sig=SXJbCQ8vL0YTQrDvTTDF%2Fh3lr%2FnU8Qo3%2F7A1RB26qWE%3D)
2026-03-28 22:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145222/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG72UJY/42810751?sv=2020-08-04&st=2026-03-28T22%3A03%3A51Z&se=2026-03-28T22%3A28%3A51Z&sr=b&sp=r&sig=SXJbCQ8vL0YTQrDvTTDF%2Fh3lr%2FnU8Qo3%2F7A1RB26qWE%3D)
2026-03-28 22:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145182/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG72UJY/42810751?sv=2020-08-04&st=2026-03-28T22%3A03%3A51Z&se=2026-03-28T22%3A28%3A51Z&sr=b&sp=r&sig=SXJbCQ8vL0YTQrDvTTDF%2Fh3lr%2FnU8Qo3%2F7A1RB26qWE%3D)
2026-03-28 22:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147098/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH70HRN/42810982?sv=2020-08-04&st=2026-03-28T22%3A03%3A50Z&se=2026-03-28T22%3A28%3A50Z&sr=b&sp=r&sig=z772%2BQEc4Xe%2FDYwJDwuoncqvDgwdMOZOP65i6cisEww%3D)
2026-03-28 22:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146397/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK68WZS/42810938?sv=2020-08-04&st=2026-03-28T22%3A03%3A51Z&se=2026-03-28T22%3A28%3A51Z&sr=b&sp=r&sig=RIKAWuJBzwkqe2GFufXdWIdytCoD47TJXidmKusSd5U%3D)
2026-03-28 22:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147082/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH70HRN/42810982?sv=2020-08-04&st=2026-03-28T22%3A03%3A50Z&se=2026-03-28T22%3A28%3A50Z&sr=b&sp=r&sig=z772%2BQEc4Xe%2FDYwJDwuoncqvDgwdMOZOP65i6cisEww%3D)
2026-03-28 22:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145207/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG72UJY/42810751?sv=2020-08-04&st=2026-03-28T22%3A03%3A51Z&se=2026-03-28T22%3A28%3A51Z&sr=b&sp=r&sig=SXJbCQ8vL0YTQrDvTTDF%2Fh3lr%2FnU8Qo3%2F7A1RB26qWE%3D)
2026-03-28 22:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145177/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG72UJY/42810751?sv=2020-08-04&st=2026-03-28T22%3A03%3A51Z&se=2026-03-28T22%3A28%3A51Z&sr=b&sp=r&sig=SXJbCQ8vL0YTQrDvTTDF%2Fh3lr%2FnU8Qo3%2F7A1RB26qWE%3D)
2026-03-28 22:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146379/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK68WZS/42810938?sv=2020-08-04&st=2026-03-28T22%3A03%3A51Z&se=2026-03-28T22%3A28%3A51Z&sr=b&sp=r&sig=RIKAWuJBzwkqe2GFufXdWIdytCoD47TJXidmKusSd5U%3D)
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547776b90>
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55409954-1173-5276-a10a-2f132fbeb032/55409954-1173-5276-a10a-2f132fbeb032_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLG72UJY%252F699145191%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145191/600 saved to cache
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55409954-1173-5276-a10a-2f132fbeb032
2026-03-28 22:03:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146412/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146412>
2026-03-28 22:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147115/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH70HRN/42810982?sv=2020-08-04&st=2026-03-28T22%3A03%3A50Z&se=2026-03-28T22%3A28%3A50Z&sr=b&sp=r&sig=z772%2BQEc4Xe%2FDYwJDwuoncqvDgwdMOZOP65i6cisEww%3D)
2026-03-28 22:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147130/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH70HRN/42810982?sv=2020-08-04&st=2026-03-28T22%3A03%3A50Z&se=2026-03-28T22%3A28%3A50Z&sr=b&sp=r&sig=z772%2BQEc4Xe%2FDYwJDwuoncqvDgwdMOZOP65i6cisEww%3D)
2026-03-28 22:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145238/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG72UJY/42810751?sv=2020-08-04&st=2026-03-28T22%3A03%3A51Z&se=2026-03-28T22%3A28%3A51Z&sr=b&sp=r&sig=SXJbCQ8vL0YTQrDvTTDF%2Fh3lr%2FnU8Qo3%2F7A1RB26qWE%3D)
2026-03-28 22:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146438/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK68WZS/42810938?sv=2020-08-04&st=2026-03-28T22%3A03%3A51Z&se=2026-03-28T22%3A28%3A51Z&sr=b&sp=r&sig=RIKAWuJBzwkqe2GFufXdWIdytCoD47TJXidmKusSd5U%3D)
2026-03-28 22:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146428/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK68WZS/42810938?sv=2020-08-04&st=2026-03-28T22%3A03%3A51Z&se=2026-03-28T22%3A28%3A51Z&sr=b&sp=r&sig=RIKAWuJBzwkqe2GFufXdWIdytCoD47TJXidmKusSd5U%3D)
2026-03-28 22:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145250/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG72UJY/42810751?sv=2020-08-04&st=2026-03-28T22%3A03%3A51Z&se=2026-03-28T22%3A28%3A51Z&sr=b&sp=r&sig=SXJbCQ8vL0YTQrDvTTDF%2Fh3lr%2FnU8Qo3%2F7A1RB26qWE%3D)
2026-03-28 22:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147144/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH70HRN/42810982?sv=2020-08-04&st=2026-03-28T22%3A03%3A50Z&se=2026-03-28T22%3A28%3A50Z&sr=b&sp=r&sig=z772%2BQEc4Xe%2FDYwJDwuoncqvDgwdMOZOP65i6cisEww%3D)
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547204550>
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55409954-1173-5276-a10a-2f132fbeb032/55409954-1173-5276-a10a-2f132fbeb032_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLG72UJY%252F699145222%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145222/600 saved to cache
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55409954-1173-5276-a10a-2f132fbeb032
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547495010>
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55409954-1173-5276-a10a-2f132fbeb032/55409954-1173-5276-a10a-2f132fbeb032_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLG72UJY%252F699145182%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145182/600 saved to cache
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55409954-1173-5276-a10a-2f132fbeb032
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554345110>
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fa3513c-d7c1-5913-b481-6acfffd741bf/6fa3513c-d7c1-5913-b481-6acfffd741bf_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH70HRN%252F699147098%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147098/600 saved to cache
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6fa3513c-d7c1-5913-b481-6acfffd741bf
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554ba2a90>
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e86ebe18-a2b5-52bb-9b19-9683b6ffda08/e86ebe18-a2b5-52bb-9b19-9683b6ffda08_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK68WZS%252F699146397%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146397/600 saved to cache
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e86ebe18-a2b5-52bb-9b19-9683b6ffda08
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547447350>
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fa3513c-d7c1-5913-b481-6acfffd741bf/6fa3513c-d7c1-5913-b481-6acfffd741bf_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH70HRN%252F699147082%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147082/600 saved to cache
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6fa3513c-d7c1-5913-b481-6acfffd741bf
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471cf3d0>
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55409954-1173-5276-a10a-2f132fbeb032/55409954-1173-5276-a10a-2f132fbeb032_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLG72UJY%252F699145207%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145207/600 saved to cache
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55409954-1173-5276-a10a-2f132fbeb032
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547445d50>
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55409954-1173-5276-a10a-2f132fbeb032/55409954-1173-5276-a10a-2f132fbeb032_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLG72UJY%252F699145177%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145177/600 saved to cache
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55409954-1173-5276-a10a-2f132fbeb032
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b28050>
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e86ebe18-a2b5-52bb-9b19-9683b6ffda08/e86ebe18-a2b5-52bb-9b19-9683b6ffda08_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK68WZS%252F699146379%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146379/600 saved to cache
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e86ebe18-a2b5-52bb-9b19-9683b6ffda08
2026-03-28 22:03:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146374/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146374>
2026-03-28 22:03:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147074/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147074>
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554ba1e10>
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fa3513c-d7c1-5913-b481-6acfffd741bf/6fa3513c-d7c1-5913-b481-6acfffd741bf_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH70HRN%252F699147115%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147115/600 saved to cache
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6fa3513c-d7c1-5913-b481-6acfffd741bf
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554806850>
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fa3513c-d7c1-5913-b481-6acfffd741bf/6fa3513c-d7c1-5913-b481-6acfffd741bf_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH70HRN%252F699147130%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147130/600 saved to cache
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6fa3513c-d7c1-5913-b481-6acfffd741bf
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544e22d0>
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55409954-1173-5276-a10a-2f132fbeb032/55409954-1173-5276-a10a-2f132fbeb032_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLG72UJY%252F699145238%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145238/600 saved to cache
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55409954-1173-5276-a10a-2f132fbeb032
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543458d0>
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e86ebe18-a2b5-52bb-9b19-9683b6ffda08/e86ebe18-a2b5-52bb-9b19-9683b6ffda08_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK68WZS%252F699146438%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146438/600 saved to cache
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e86ebe18-a2b5-52bb-9b19-9683b6ffda08
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554338c90>
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e86ebe18-a2b5-52bb-9b19-9683b6ffda08/e86ebe18-a2b5-52bb-9b19-9683b6ffda08_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK68WZS%252F699146428%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146428/600 saved to cache
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e86ebe18-a2b5-52bb-9b19-9683b6ffda08
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54762aa10>
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55409954-1173-5276-a10a-2f132fbeb032/55409954-1173-5276-a10a-2f132fbeb032_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLG72UJY%252F699145250%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145250/600 saved to cache
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55409954-1173-5276-a10a-2f132fbeb032
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554380910>
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fa3513c-d7c1-5913-b481-6acfffd741bf/6fa3513c-d7c1-5913-b481-6acfffd741bf_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH70HRN%252F699147144%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147144/600 saved to cache
2026-03-28 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6fa3513c-d7c1-5913-b481-6acfffd741bf
2026-03-28 22:03:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147067/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147067>
2026-03-28 22:03:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146364/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146364>
2026-03-28 22:03:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145158/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145158>
2026-03-28 22:03:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147058/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147058>
2026-03-28 22:03:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145166/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145166>
2026-03-28 22:03:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146369/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146369>
2026-03-28 22:03:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969442/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698969442>
2026-03-28 22:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146412/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK68WZS/42810938?sv=2020-08-04&st=2026-03-28T22%3A03%3A51Z&se=2026-03-28T22%3A28%3A51Z&sr=b&sp=r&sig=RIKAWuJBzwkqe2GFufXdWIdytCoD47TJXidmKusSd5U%3D)
2026-03-28 22:03:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002931/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002931>
2026-03-28 22:03:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147051/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147051>
2026-03-28 22:03:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015822/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015822>
2026-03-28 22:03:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011532/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011532>
2026-03-28 22:03:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145152/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LG72UJY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:03:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146357/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146357>
2026-03-28 22:03:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549cbc90>
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e86ebe18-a2b5-52bb-9b19-9683b6ffda08/e86ebe18-a2b5-52bb-9b19-9683b6ffda08_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK68WZS%252F699146412%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146412/600 saved to cache
2026-03-28 22:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e86ebe18-a2b5-52bb-9b19-9683b6ffda08
2026-03-28 22:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146374/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK68WZS/42810938?sv=2020-08-04&st=2026-03-28T22%3A03%3A51Z&se=2026-03-28T22%3A28%3A51Z&sr=b&sp=r&sig=RIKAWuJBzwkqe2GFufXdWIdytCoD47TJXidmKusSd5U%3D)
2026-03-28 22:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145166/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG72UJY/42810751?sv=2020-08-04&st=2026-03-28T22%3A03%3A51Z&se=2026-03-28T22%3A28%3A51Z&sr=b&sp=r&sig=SXJbCQ8vL0YTQrDvTTDF%2Fh3lr%2FnU8Qo3%2F7A1RB26qWE%3D)
2026-03-28 22:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147058/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH70HRN/42810982?sv=2020-08-04&st=2026-03-28T22%3A03%3A50Z&se=2026-03-28T22%3A28%3A50Z&sr=b&sp=r&sig=z772%2BQEc4Xe%2FDYwJDwuoncqvDgwdMOZOP65i6cisEww%3D)
2026-03-28 22:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146364/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK68WZS/42810938?sv=2020-08-04&st=2026-03-28T22%3A03%3A51Z&se=2026-03-28T22%3A28%3A51Z&sr=b&sp=r&sig=RIKAWuJBzwkqe2GFufXdWIdytCoD47TJXidmKusSd5U%3D)
2026-03-28 22:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145158/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG72UJY/42810751?sv=2020-08-04&st=2026-03-28T22%3A03%3A51Z&se=2026-03-28T22%3A28%3A51Z&sr=b&sp=r&sig=SXJbCQ8vL0YTQrDvTTDF%2Fh3lr%2FnU8Qo3%2F7A1RB26qWE%3D)
2026-03-28 22:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147074/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH70HRN/42810982?sv=2020-08-04&st=2026-03-28T22%3A03%3A50Z&se=2026-03-28T22%3A28%3A50Z&sr=b&sp=r&sig=z772%2BQEc4Xe%2FDYwJDwuoncqvDgwdMOZOP65i6cisEww%3D)
2026-03-28 22:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146369/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK68WZS/42810938?sv=2020-08-04&st=2026-03-28T22%3A03%3A51Z&se=2026-03-28T22%3A28%3A51Z&sr=b&sp=r&sig=RIKAWuJBzwkqe2GFufXdWIdytCoD47TJXidmKusSd5U%3D)
2026-03-28 22:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969442/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RGZ2258/42810452?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=kBITiyfs97TuYzs7g7kH25vciSHF5hJ%2FRLgR6cReuFI%3D)
2026-03-28 22:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147067/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH70HRN/42810982?sv=2020-08-04&st=2026-03-28T22%3A03%3A50Z&se=2026-03-28T22%3A28%3A50Z&sr=b&sp=r&sig=z772%2BQEc4Xe%2FDYwJDwuoncqvDgwdMOZOP65i6cisEww%3D)
2026-03-28 22:03:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969433/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698969433>
2026-03-28 22:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147051/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH70HRN/42810982?sv=2020-08-04&st=2026-03-28T22%3A03%3A50Z&se=2026-03-28T22%3A28%3A50Z&sr=b&sp=r&sig=z772%2BQEc4Xe%2FDYwJDwuoncqvDgwdMOZOP65i6cisEww%3D)
2026-03-28 22:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002931/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK69NEO/42810650?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=MCQCSbXeIV%2FoZtdBllblp3i0Xi85S2CxDag2PQM%2Br94%3D)
2026-03-28 22:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145152/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG72UJY/42810751?sv=2020-08-04&st=2026-03-28T22%3A03%3A51Z&se=2026-03-28T22%3A28%3A51Z&sr=b&sp=r&sig=SXJbCQ8vL0YTQrDvTTDF%2Fh3lr%2FnU8Qo3%2F7A1RB26qWE%3D)
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f929d0>
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e86ebe18-a2b5-52bb-9b19-9683b6ffda08/e86ebe18-a2b5-52bb-9b19-9683b6ffda08_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK68WZS%252F699146374%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146374/600 saved to cache
2026-03-28 22:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e86ebe18-a2b5-52bb-9b19-9683b6ffda08
2026-03-28 22:03:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002890/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002890>
2026-03-28 22:03:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011489/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011489>
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555033d50>
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55409954-1173-5276-a10a-2f132fbeb032/55409954-1173-5276-a10a-2f132fbeb032_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLG72UJY%252F699145166%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145166/600 saved to cache
2026-03-28 22:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55409954-1173-5276-a10a-2f132fbeb032
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554815a50>
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fa3513c-d7c1-5913-b481-6acfffd741bf/6fa3513c-d7c1-5913-b481-6acfffd741bf_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH70HRN%252F699147058%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147058/600 saved to cache
2026-03-28 22:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6fa3513c-d7c1-5913-b481-6acfffd741bf
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547610510>
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e86ebe18-a2b5-52bb-9b19-9683b6ffda08/e86ebe18-a2b5-52bb-9b19-9683b6ffda08_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK68WZS%252F699146364%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146364/600 saved to cache
2026-03-28 22:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e86ebe18-a2b5-52bb-9b19-9683b6ffda08
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54732c790>
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55409954-1173-5276-a10a-2f132fbeb032/55409954-1173-5276-a10a-2f132fbeb032_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLG72UJY%252F699145158%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145158/600 saved to cache
2026-03-28 22:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55409954-1173-5276-a10a-2f132fbeb032
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471cf250>
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fa3513c-d7c1-5913-b481-6acfffd741bf/6fa3513c-d7c1-5913-b481-6acfffd741bf_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH70HRN%252F699147074%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147074/600 saved to cache
2026-03-28 22:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6fa3513c-d7c1-5913-b481-6acfffd741bf
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554acd850>
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e86ebe18-a2b5-52bb-9b19-9683b6ffda08/e86ebe18-a2b5-52bb-9b19-9683b6ffda08_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK68WZS%252F699146369%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146369/600 saved to cache
2026-03-28 22:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e86ebe18-a2b5-52bb-9b19-9683b6ffda08
2026-03-28 22:03:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471ce410>
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df646afa-cd7d-59ba-af23-e32bf2546109/df646afa-cd7d-59ba-af23-e32bf2546109_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRGZ2258%252F698969442%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969442/600 saved to cache
2026-03-28 22:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item df646afa-cd7d-59ba-af23-e32bf2546109
2026-03-28 22:03:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015789/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015789>
2026-03-28 22:03:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011456/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011456>
2026-03-28 22:03:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015754/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015754>
2026-03-28 22:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015822/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ19JYG/42810741?sv=2020-08-04&st=2026-03-28T22%3A03%3A48Z&se=2026-03-28T22%3A28%3A48Z&sr=b&sp=r&sig=w1dVOm9NlUvvpCkKDpL5NSUYZ809EAUFO2pNnfq9jVU%3D)
2026-03-28 22:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011532/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MH19RHF/42810725?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=Kg%2BtIUY9mVuB07ZcMhSvfMrr0cRTs83uUt6BXIeXvuI%3D)
2026-03-28 22:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146357/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK68WZS/42810938?sv=2020-08-04&st=2026-03-28T22%3A03%3A51Z&se=2026-03-28T22%3A28%3A51Z&sr=b&sp=r&sig=RIKAWuJBzwkqe2GFufXdWIdytCoD47TJXidmKusSd5U%3D)
2026-03-28 22:03:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015695/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015695>
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547248290>
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fa3513c-d7c1-5913-b481-6acfffd741bf/6fa3513c-d7c1-5913-b481-6acfffd741bf_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH70HRN%252F699147067%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147067/600 saved to cache
2026-03-28 22:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6fa3513c-d7c1-5913-b481-6acfffd741bf
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472608d0>
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fa3513c-d7c1-5913-b481-6acfffd741bf/6fa3513c-d7c1-5913-b481-6acfffd741bf_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH70HRN%252F699147051%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147051/600 saved to cache
2026-03-28 22:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6fa3513c-d7c1-5913-b481-6acfffd741bf
2026-03-28 22:03:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6fa3513c-d7c1-5913-b481-6acfffd741bf, skipping ID generation
2026-03-28 22:03:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6fa3513c-d7c1-5913-b481-6acfffd741bf sending to next pipeline
2026-03-28 22:03:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6fa3513c-d7c1-5913-b481-6acfffd741bf, identifier: YH70%20HRN
2026-03-28 22:03:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5573046d0>
2026-03-28 22:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6/4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK69NEO%252F699002931%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002931/600 saved to cache
2026-03-28 22:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6
2026-03-28 22:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547367150>
2026-03-28 22:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55409954-1173-5276-a10a-2f132fbeb032/55409954-1173-5276-a10a-2f132fbeb032_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLG72UJY%252F699145152%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145152/600 saved to cache
2026-03-28 22:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55409954-1173-5276-a10a-2f132fbeb032
2026-03-28 22:03:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55409954-1173-5276-a10a-2f132fbeb032, skipping ID generation
2026-03-28 22:03:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55409954-1173-5276-a10a-2f132fbeb032 sending to next pipeline
2026-03-28 22:03:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 55409954-1173-5276-a10a-2f132fbeb032, identifier: LG72%20UJY
2026-03-28 22:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6fa3513c-d7c1-5913-b481-6acfffd741bf with identifier: YH70%20HRN
2026-03-28 22:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6fa3513c-d7c1-5913-b481-6acfffd741bf with identifier: YH70%20HRN
2026-03-28 22:03:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6fa3513c-d7c1-5913-b481-6acfffd741bf with identifier: YH70%20HRN to the API
2026-03-28 22:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147051/600>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fa3513c-d7c1-5913-b481-6acfffd741bf/6fa3513c-d7c1-5913-b481-6acfffd741bf_expert_report_file_043ce6ae-9ae9-4ff3-a96a-781edb662c42.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YH70%20HRN-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6fa3513c-d7c1-5913-b481-6acfffd741bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YH70 HRN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YH70%20HRN&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'SEAT',
'model': 'IBIZA',
'odometer': 45227,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fa3513c-d7c1-5913-b481-6acfffd741bf/6fa3513c-d7c1-5913-b481-6acfffd741bf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49149,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147044/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fa3513c-d7c1-5913-b481-6acfffd741bf/6fa3513c-d7c1-5913-b481-6acfffd741bf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45514,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147051/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fa3513c-d7c1-5913-b481-6acfffd741bf/6fa3513c-d7c1-5913-b481-6acfffd741bf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45864,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147058/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fa3513c-d7c1-5913-b481-6acfffd741bf/6fa3513c-d7c1-5913-b481-6acfffd741bf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46200,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147067/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fa3513c-d7c1-5913-b481-6acfffd741bf/6fa3513c-d7c1-5913-b481-6acfffd741bf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47963,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147074/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fa3513c-d7c1-5913-b481-6acfffd741bf/6fa3513c-d7c1-5913-b481-6acfffd741bf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45305,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147082/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fa3513c-d7c1-5913-b481-6acfffd741bf/6fa3513c-d7c1-5913-b481-6acfffd741bf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88368,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147098/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fa3513c-d7c1-5913-b481-6acfffd741bf/6fa3513c-d7c1-5913-b481-6acfffd741bf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62250,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147115/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fa3513c-d7c1-5913-b481-6acfffd741bf/6fa3513c-d7c1-5913-b481-6acfffd741bf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82746,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147130/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fa3513c-d7c1-5913-b481-6acfffd741bf/6fa3513c-d7c1-5913-b481-6acfffd741bf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71610,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70HRN/699147144/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'SEAT IBIZA 1.0 TSI 115 FR EZ Hatchback',
'transmission': 'manual',
'trim': 'TSI 115 FR EZ',
'vin': 'VSSZZZKJZLR157377',
'year': 2020}
2026-03-28 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH70%2520HRN%27 HTTP/1.1" 200 None
2026-03-28 22:03:58 [bca.uk] INFO: Saving data for YH70%20HRN: {'created_time': 1774735438.65293, 'last_price_update_time': 1774735438.65294, 'auction_closing_time': 1774864800.0}
2026-03-28 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YH70%2520HRN') HTTP/1.1" 204 0
2026-03-28 22:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 55409954-1173-5276-a10a-2f132fbeb032 with identifier: LG72%20UJY
2026-03-28 22:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 55409954-1173-5276-a10a-2f132fbeb032 with identifier: LG72%20UJY
2026-03-28 22:03:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 55409954-1173-5276-a10a-2f132fbeb032 with identifier: LG72%20UJY to the API
2026-03-28 22:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145152/600>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55409954-1173-5276-a10a-2f132fbeb032/55409954-1173-5276-a10a-2f132fbeb032_expert_report_file_886f2db9-433b-464a-ab13-6b2619985339.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LG72%20UJY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '55409954-1173-5276-a10a-2f132fbeb032',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LG72 UJY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LG72%20UJY&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MINI',
'model': 'COOPER',
'odometer': 52994,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55409954-1173-5276-a10a-2f132fbeb032/55409954-1173-5276-a10a-2f132fbeb032_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50392,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145152/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55409954-1173-5276-a10a-2f132fbeb032/55409954-1173-5276-a10a-2f132fbeb032_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47029,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145158/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55409954-1173-5276-a10a-2f132fbeb032/55409954-1173-5276-a10a-2f132fbeb032_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47995,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145166/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55409954-1173-5276-a10a-2f132fbeb032/55409954-1173-5276-a10a-2f132fbeb032_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49161,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145177/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55409954-1173-5276-a10a-2f132fbeb032/55409954-1173-5276-a10a-2f132fbeb032_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46961,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145182/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55409954-1173-5276-a10a-2f132fbeb032/55409954-1173-5276-a10a-2f132fbeb032_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45222,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145191/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55409954-1173-5276-a10a-2f132fbeb032/55409954-1173-5276-a10a-2f132fbeb032_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84677,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145207/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55409954-1173-5276-a10a-2f132fbeb032/55409954-1173-5276-a10a-2f132fbeb032_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57687,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145222/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55409954-1173-5276-a10a-2f132fbeb032/55409954-1173-5276-a10a-2f132fbeb032_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87184,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145238/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55409954-1173-5276-a10a-2f132fbeb032/55409954-1173-5276-a10a-2f132fbeb032_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74534,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG72UJY/699145250/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'MINI COOPER 1.5 EXCLUSIVE STEP Convertible',
'transmission': 'automatic',
'trim': 'EXCLUSIVE STEP',
'vin': 'WMW22DL0603P57860',
'year': 2022}
2026-03-28 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG72%2520UJY%27 HTTP/1.1" 200 None
2026-03-28 22:03:59 [bca.uk] INFO: Saving data for LG72%20UJY: {'created_time': 1774735439.003889, 'last_price_update_time': 1774735439.003901, 'auction_closing_time': 1774864800.0}
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LG72%2520UJY') HTTP/1.1" 204 0
2026-03-28 22:03:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002747/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002747>
2026-03-28 22:03:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015688/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015688>
2026-03-28 22:03:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015681/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015681>
2026-03-28 22:03:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011369/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011369>
2026-03-28 22:03:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011353/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011353>
2026-03-28 22:03:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002719/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002719>
2026-03-28 22:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969433/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RGZ2258/42810452?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=kBITiyfs97TuYzs7g7kH25vciSHF5hJ%2FRLgR6cReuFI%3D)
2026-03-28 22:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002890/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK69NEO/42810650?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=MCQCSbXeIV%2FoZtdBllblp3i0Xi85S2CxDag2PQM%2Br94%3D)
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547296450>
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7c54e9b-c505-5a1c-96f8-efc7e46f0480/a7c54e9b-c505-5a1c-96f8-efc7e46f0480_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ19JYG%252F699015822%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015822/600 saved to cache
2026-03-28 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a7c54e9b-c505-5a1c-96f8-efc7e46f0480
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b22e90>
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7bbb95c-34a4-508c-9af6-6415bfd76278/f7bbb95c-34a4-508c-9af6-6415bfd76278_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMH19RHF%252F699011532%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011532/600 saved to cache
2026-03-28 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f7bbb95c-34a4-508c-9af6-6415bfd76278
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54761d810>
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e86ebe18-a2b5-52bb-9b19-9683b6ffda08/e86ebe18-a2b5-52bb-9b19-9683b6ffda08_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK68WZS%252F699146357%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146357/600 saved to cache
2026-03-28 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e86ebe18-a2b5-52bb-9b19-9683b6ffda08
2026-03-28 22:03:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e86ebe18-a2b5-52bb-9b19-9683b6ffda08, skipping ID generation
2026-03-28 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e86ebe18-a2b5-52bb-9b19-9683b6ffda08 sending to next pipeline
2026-03-28 22:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e86ebe18-a2b5-52bb-9b19-9683b6ffda08, identifier: RK68%20WZS
2026-03-28 22:03:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e86ebe18-a2b5-52bb-9b19-9683b6ffda08 with identifier: RK68%20WZS
2026-03-28 22:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e86ebe18-a2b5-52bb-9b19-9683b6ffda08 with identifier: RK68%20WZS
2026-03-28 22:03:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e86ebe18-a2b5-52bb-9b19-9683b6ffda08 with identifier: RK68%20WZS to the API
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:03:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146357/600>
{'auction_title': '',
'c_o_2_emission_value': 175,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86ebe18-a2b5-52bb-9b19-9683b6ffda08/e86ebe18-a2b5-52bb-9b19-9683b6ffda08_expert_report_file_d27dff29-b937-4a77-bfda-ede0e86eb4b1.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RK68%20WZS-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e86ebe18-a2b5-52bb-9b19-9683b6ffda08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RK68 WZS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RK68%20WZS&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'HONDA',
'model': 'CR-V',
'odometer': 45933,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86ebe18-a2b5-52bb-9b19-9683b6ffda08/e86ebe18-a2b5-52bb-9b19-9683b6ffda08_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51507,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146345/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86ebe18-a2b5-52bb-9b19-9683b6ffda08/e86ebe18-a2b5-52bb-9b19-9683b6ffda08_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50438,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146357/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86ebe18-a2b5-52bb-9b19-9683b6ffda08/e86ebe18-a2b5-52bb-9b19-9683b6ffda08_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48328,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146364/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86ebe18-a2b5-52bb-9b19-9683b6ffda08/e86ebe18-a2b5-52bb-9b19-9683b6ffda08_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48089,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146369/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86ebe18-a2b5-52bb-9b19-9683b6ffda08/e86ebe18-a2b5-52bb-9b19-9683b6ffda08_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45304,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146374/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86ebe18-a2b5-52bb-9b19-9683b6ffda08/e86ebe18-a2b5-52bb-9b19-9683b6ffda08_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47168,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146379/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86ebe18-a2b5-52bb-9b19-9683b6ffda08/e86ebe18-a2b5-52bb-9b19-9683b6ffda08_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83783,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146397/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86ebe18-a2b5-52bb-9b19-9683b6ffda08/e86ebe18-a2b5-52bb-9b19-9683b6ffda08_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68173,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146412/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86ebe18-a2b5-52bb-9b19-9683b6ffda08/e86ebe18-a2b5-52bb-9b19-9683b6ffda08_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87005,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146428/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86ebe18-a2b5-52bb-9b19-9683b6ffda08/e86ebe18-a2b5-52bb-9b19-9683b6ffda08_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79966,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK68WZS/699146438/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'HONDA CR-V 2.0 I-VTEC SE PLUS 4WD StationWagon',
'transmission': 'automatic',
'trim': 'I-VTEC SE PLUS 4WD',
'vin': 'SHSRE5850JU005875',
'year': 2018}
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK68%2520WZS%27 HTTP/1.1" 200 None
2026-03-28 22:03:59 [bca.uk] INFO: Saving data for RK68%20WZS: {'created_time': 1774735439.639241, 'last_price_update_time': 1774735439.639253, 'auction_closing_time': 1774864800.0}
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RK68%2520WZS') HTTP/1.1" 204 0
2026-03-28 22:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015695/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ19JYG/42810741?sv=2020-08-04&st=2026-03-28T22%3A03%3A48Z&se=2026-03-28T22%3A28%3A48Z&sr=b&sp=r&sig=w1dVOm9NlUvvpCkKDpL5NSUYZ809EAUFO2pNnfq9jVU%3D)
2026-03-28 22:03:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015672/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015672>
2026-03-28 22:03:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969352/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698969352>
2026-03-28 22:03:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002708/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002708>
2026-03-28 22:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011489/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MH19RHF/42810725?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=Kg%2BtIUY9mVuB07ZcMhSvfMrr0cRTs83uUt6BXIeXvuI%3D)
2026-03-28 22:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015789/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ19JYG/42810741?sv=2020-08-04&st=2026-03-28T22%3A03%3A48Z&se=2026-03-28T22%3A28%3A48Z&sr=b&sp=r&sig=w1dVOm9NlUvvpCkKDpL5NSUYZ809EAUFO2pNnfq9jVU%3D)
2026-03-28 22:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011456/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MH19RHF/42810725?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=Kg%2BtIUY9mVuB07ZcMhSvfMrr0cRTs83uUt6BXIeXvuI%3D)
2026-03-28 22:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015754/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ19JYG/42810741?sv=2020-08-04&st=2026-03-28T22%3A03%3A48Z&se=2026-03-28T22%3A28%3A48Z&sr=b&sp=r&sig=w1dVOm9NlUvvpCkKDpL5NSUYZ809EAUFO2pNnfq9jVU%3D)
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5573788d0>
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df646afa-cd7d-59ba-af23-e32bf2546109/df646afa-cd7d-59ba-af23-e32bf2546109_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRGZ2258%252F698969433%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969433/600 saved to cache
2026-03-28 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item df646afa-cd7d-59ba-af23-e32bf2546109
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554833610>
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6/4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK69NEO%252F699002890%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002890/600 saved to cache
2026-03-28 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471c3190>
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7c54e9b-c505-5a1c-96f8-efc7e46f0480/a7c54e9b-c505-5a1c-96f8-efc7e46f0480_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ19JYG%252F699015695%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015695/600 saved to cache
2026-03-28 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7c54e9b-c505-5a1c-96f8-efc7e46f0480
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5578cf810>
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7bbb95c-34a4-508c-9af6-6415bfd76278/f7bbb95c-34a4-508c-9af6-6415bfd76278_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMH19RHF%252F699011489%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011489/600 saved to cache
2026-03-28 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f7bbb95c-34a4-508c-9af6-6415bfd76278
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b38d50>
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7c54e9b-c505-5a1c-96f8-efc7e46f0480/a7c54e9b-c505-5a1c-96f8-efc7e46f0480_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ19JYG%252F699015789%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015789/600 saved to cache
2026-03-28 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a7c54e9b-c505-5a1c-96f8-efc7e46f0480
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547295d50>
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7bbb95c-34a4-508c-9af6-6415bfd76278/f7bbb95c-34a4-508c-9af6-6415bfd76278_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMH19RHF%252F699011456%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011456/600 saved to cache
2026-03-28 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f7bbb95c-34a4-508c-9af6-6415bfd76278
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b01dd0>
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7c54e9b-c505-5a1c-96f8-efc7e46f0480/a7c54e9b-c505-5a1c-96f8-efc7e46f0480_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ19JYG%252F699015754%252F600') HTTP/1.1" 204 0
2026-03-28 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015754/600 saved to cache
2026-03-28 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7c54e9b-c505-5a1c-96f8-efc7e46f0480
2026-03-28 22:03:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015664/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015664>
2026-03-28 22:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015681/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ19JYG/42810741?sv=2020-08-04&st=2026-03-28T22%3A03%3A48Z&se=2026-03-28T22%3A28%3A48Z&sr=b&sp=r&sig=w1dVOm9NlUvvpCkKDpL5NSUYZ809EAUFO2pNnfq9jVU%3D)
2026-03-28 22:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002747/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK69NEO/42810650?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=MCQCSbXeIV%2FoZtdBllblp3i0Xi85S2CxDag2PQM%2Br94%3D)
2026-03-28 22:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002719/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK69NEO/42810650?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=MCQCSbXeIV%2FoZtdBllblp3i0Xi85S2CxDag2PQM%2Br94%3D)
2026-03-28 22:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015688/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ19JYG/42810741?sv=2020-08-04&st=2026-03-28T22%3A03%3A48Z&se=2026-03-28T22%3A28%3A48Z&sr=b&sp=r&sig=w1dVOm9NlUvvpCkKDpL5NSUYZ809EAUFO2pNnfq9jVU%3D)
2026-03-28 22:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011353/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MH19RHF/42810725?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=Kg%2BtIUY9mVuB07ZcMhSvfMrr0cRTs83uUt6BXIeXvuI%3D)
2026-03-28 22:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011369/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MH19RHF/42810725?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=Kg%2BtIUY9mVuB07ZcMhSvfMrr0cRTs83uUt6BXIeXvuI%3D)
2026-03-28 22:03:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011347/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011347>
2026-03-28 22:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015672/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ19JYG/42810741?sv=2020-08-04&st=2026-03-28T22%3A03%3A48Z&se=2026-03-28T22%3A28%3A48Z&sr=b&sp=r&sig=w1dVOm9NlUvvpCkKDpL5NSUYZ809EAUFO2pNnfq9jVU%3D)
2026-03-28 22:04:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699146018/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146018>
2026-03-28 22:04:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011340/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MH19RHF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015658/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MJ19JYG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969343/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RGZ2258-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969352/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RGZ2258/42810452?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=kBITiyfs97TuYzs7g7kH25vciSHF5hJ%2FRLgR6cReuFI%3D)
2026-03-28 22:04:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002701/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DK69NEO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547296ed0>
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7c54e9b-c505-5a1c-96f8-efc7e46f0480/a7c54e9b-c505-5a1c-96f8-efc7e46f0480_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ19JYG%252F699015681%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015681/600 saved to cache
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7c54e9b-c505-5a1c-96f8-efc7e46f0480
2026-03-28 22:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011347/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MH19RHF/42810725?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=Kg%2BtIUY9mVuB07ZcMhSvfMrr0cRTs83uUt6BXIeXvuI%3D)
2026-03-28 22:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015664/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ19JYG/42810741?sv=2020-08-04&st=2026-03-28T22%3A03%3A48Z&se=2026-03-28T22%3A28%3A48Z&sr=b&sp=r&sig=w1dVOm9NlUvvpCkKDpL5NSUYZ809EAUFO2pNnfq9jVU%3D)
2026-03-28 22:04:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189278/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189278>
2026-03-28 22:04:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158291/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158291>
2026-03-28 22:04:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994549/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994549>
2026-03-28 22:04:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251684/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251684>
2026-03-28 22:04:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KF19DKY/42811022?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=GplG9%2B9pTiJzji8cnGr7dMEKJveU9wcdMyJ7SINpu5U%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KF19%20DKY-GB>
2026-03-28 22:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002708/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK69NEO/42810650?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=MCQCSbXeIV%2FoZtdBllblp3i0Xi85S2CxDag2PQM%2Br94%3D)
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54761e890>
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6/4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK69NEO%252F699002747%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002747/600 saved to cache
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554800690>
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6/4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK69NEO%252F699002719%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002719/600 saved to cache
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474bb590>
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7c54e9b-c505-5a1c-96f8-efc7e46f0480/a7c54e9b-c505-5a1c-96f8-efc7e46f0480_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ19JYG%252F699015688%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015688/600 saved to cache
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7c54e9b-c505-5a1c-96f8-efc7e46f0480
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547610450>
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7bbb95c-34a4-508c-9af6-6415bfd76278/f7bbb95c-34a4-508c-9af6-6415bfd76278_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMH19RHF%252F699011353%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011353/600 saved to cache
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f7bbb95c-34a4-508c-9af6-6415bfd76278
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474b9fd0>
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7bbb95c-34a4-508c-9af6-6415bfd76278/f7bbb95c-34a4-508c-9af6-6415bfd76278_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMH19RHF%252F699011369%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011369/600 saved to cache
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f7bbb95c-34a4-508c-9af6-6415bfd76278
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543b4a90>
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7c54e9b-c505-5a1c-96f8-efc7e46f0480/a7c54e9b-c505-5a1c-96f8-efc7e46f0480_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ19JYG%252F699015672%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015672/600 saved to cache
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7c54e9b-c505-5a1c-96f8-efc7e46f0480
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b22cd0>
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df646afa-cd7d-59ba-af23-e32bf2546109/df646afa-cd7d-59ba-af23-e32bf2546109_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRGZ2258%252F698969352%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969352/600 saved to cache
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df646afa-cd7d-59ba-af23-e32bf2546109
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5573ac950>
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7bbb95c-34a4-508c-9af6-6415bfd76278/f7bbb95c-34a4-508c-9af6-6415bfd76278_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMH19RHF%252F699011347%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011347/600 saved to cache
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f7bbb95c-34a4-508c-9af6-6415bfd76278
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547478290>
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7c54e9b-c505-5a1c-96f8-efc7e46f0480/a7c54e9b-c505-5a1c-96f8-efc7e46f0480_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ19JYG%252F699015664%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015664/600 saved to cache
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7c54e9b-c505-5a1c-96f8-efc7e46f0480
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543b6bd0>
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6/4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK69NEO%252F699002708%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002708/600 saved to cache
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6
2026-03-28 22:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015658/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ19JYG/42810741?sv=2020-08-04&st=2026-03-28T22%3A03%3A48Z&se=2026-03-28T22%3A28%3A48Z&sr=b&sp=r&sig=w1dVOm9NlUvvpCkKDpL5NSUYZ809EAUFO2pNnfq9jVU%3D)
2026-03-28 22:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969343/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RGZ2258/42810452?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=kBITiyfs97TuYzs7g7kH25vciSHF5hJ%2FRLgR6cReuFI%3D)
2026-03-28 22:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002701/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK69NEO/42810650?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=MCQCSbXeIV%2FoZtdBllblp3i0Xi85S2CxDag2PQM%2Br94%3D)
2026-03-28 22:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011340/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MH19RHF/42810725?sv=2020-08-04&st=2026-03-28T22%3A03%3A49Z&se=2026-03-28T22%3A28%3A49Z&sr=b&sp=r&sig=Kg%2BtIUY9mVuB07ZcMhSvfMrr0cRTs83uUt6BXIeXvuI%3D)
2026-03-28 22:04:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HL19RNJ/42810752?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=T0nG6Oujza%2FUCalPtLB6bJCrPtKcwMpFh7hZ0OseMMM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HL19%20RNJ-GB>
2026-03-28 22:04:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251669/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251669>
2026-03-28 22:04:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699146002/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146002>
2026-03-28 22:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699146018/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OU64UPA/42811127?sv=2020-08-04&st=2026-03-28T22%3A03%3A31Z&se=2026-03-28T22%3A28%3A31Z&sr=b&sp=r&sig=8BqSQERI1JQCVBe1x8fbzIsYG%2BShES3mtYstvdJ8vEg%3D)
2026-03-28 22:04:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA19YWE/42811048?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=%2FIQ4owGkNsmgqpFNmRKT%2BGPKpJD1xlY%2FICUYJYRqwLA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CA19%20YWE-GB>
2026-03-28 22:04:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145984/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145984>
2026-03-28 22:04:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF07MDE/42810388?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=t8wnLmqHAyqKgYxckcklhBRV9Z3X1%2BiDJQPjMtUJpT0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF07%20MDE-GB>
2026-03-28 22:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189278/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU67EBV/42807577?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=Dc9GP37lnEoc8Ucnf7mZMpnnsmm75eM47cbqeVO4%2BUo%3D)
2026-03-28 22:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251684/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW67HUY/42806780?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=IjccUHM%2BUsRolC4agemnjyYj%2By8q%2BaL%2Bv6NarfY2Bpc%3D)
2026-03-28 22:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994549/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV65GFU/42810585?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=Uw05gug7lwLgV7s2MX8pmDxdS7jFiOh93SlRxrnK0ts%3D)
2026-03-28 22:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158291/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY66XSJ/42810063?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=n4o%2FwpUrt5NmnHO4b%2FuTK0GIrxHv%2BFYQBHPaaSLhQm0%3D)
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549ca890>
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7c54e9b-c505-5a1c-96f8-efc7e46f0480/a7c54e9b-c505-5a1c-96f8-efc7e46f0480_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ19JYG%252F699015658%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015658/600 saved to cache
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7c54e9b-c505-5a1c-96f8-efc7e46f0480
2026-03-28 22:04:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7c54e9b-c505-5a1c-96f8-efc7e46f0480, skipping ID generation
2026-03-28 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7c54e9b-c505-5a1c-96f8-efc7e46f0480 sending to next pipeline
2026-03-28 22:04:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a7c54e9b-c505-5a1c-96f8-efc7e46f0480, identifier: MJ19%20JYG
2026-03-28 22:04:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a7c54e9b-c505-5a1c-96f8-efc7e46f0480 with identifier: MJ19%20JYG
2026-03-28 22:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a7c54e9b-c505-5a1c-96f8-efc7e46f0480 with identifier: MJ19%20JYG
2026-03-28 22:04:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a7c54e9b-c505-5a1c-96f8-efc7e46f0480 with identifier: MJ19%20JYG to the API
2026-03-28 22:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015658/600>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7c54e9b-c505-5a1c-96f8-efc7e46f0480/a7c54e9b-c505-5a1c-96f8-efc7e46f0480_expert_report_file_6672d68d-88e2-4d84-b160-6d6dc6aeebaf.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MJ19%20JYG-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a7c54e9b-c505-5a1c-96f8-efc7e46f0480',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MJ19 JYG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MJ19%20JYG&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 39322,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7c54e9b-c505-5a1c-96f8-efc7e46f0480/a7c54e9b-c505-5a1c-96f8-efc7e46f0480_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41974,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015658/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7c54e9b-c505-5a1c-96f8-efc7e46f0480/a7c54e9b-c505-5a1c-96f8-efc7e46f0480_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40714,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015664/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7c54e9b-c505-5a1c-96f8-efc7e46f0480/a7c54e9b-c505-5a1c-96f8-efc7e46f0480_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41691,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015672/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7c54e9b-c505-5a1c-96f8-efc7e46f0480/a7c54e9b-c505-5a1c-96f8-efc7e46f0480_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41163,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015681/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7c54e9b-c505-5a1c-96f8-efc7e46f0480/a7c54e9b-c505-5a1c-96f8-efc7e46f0480_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37901,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015688/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7c54e9b-c505-5a1c-96f8-efc7e46f0480/a7c54e9b-c505-5a1c-96f8-efc7e46f0480_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35918,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015695/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7c54e9b-c505-5a1c-96f8-efc7e46f0480/a7c54e9b-c505-5a1c-96f8-efc7e46f0480_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104991,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015713/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7c54e9b-c505-5a1c-96f8-efc7e46f0480/a7c54e9b-c505-5a1c-96f8-efc7e46f0480_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83176,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015754/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7c54e9b-c505-5a1c-96f8-efc7e46f0480/a7c54e9b-c505-5a1c-96f8-efc7e46f0480_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97154,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015789/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7c54e9b-c505-5a1c-96f8-efc7e46f0480/a7c54e9b-c505-5a1c-96f8-efc7e46f0480_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91929,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ19JYG/699015822/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.5 VVT-I ICON Hatchback',
'transmission': 'automatic',
'trim': 'VVT-I ICON',
'vin': 'VNKKG3D320A146010',
'year': 2019}
2026-03-28 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ19%2520JYG%27 HTTP/1.1" 200 None
2026-03-28 22:04:01 [bca.uk] INFO: Saving data for MJ19%20JYG: {'created_time': 1774735441.368449, 'last_price_update_time': 1774735441.368462, 'auction_closing_time': 1774951200.0}
2026-03-28 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MJ19%2520JYG') HTTP/1.1" 204 0
2026-03-28 22:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994507/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994507>
2026-03-28 22:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145971/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145971>
2026-03-28 22:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189252/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189252>
2026-03-28 22:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251656/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251656>
2026-03-28 22:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554380250>
2026-03-28 22:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df646afa-cd7d-59ba-af23-e32bf2546109/df646afa-cd7d-59ba-af23-e32bf2546109_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRGZ2258%252F698969343%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969343/600 saved to cache
2026-03-28 22:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df646afa-cd7d-59ba-af23-e32bf2546109
2026-03-28 22:04:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df646afa-cd7d-59ba-af23-e32bf2546109, skipping ID generation
2026-03-28 22:04:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df646afa-cd7d-59ba-af23-e32bf2546109 sending to next pipeline
2026-03-28 22:04:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: df646afa-cd7d-59ba-af23-e32bf2546109, identifier: RGZ%202258
2026-03-28 22:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699146002/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OU64UPA/42811127?sv=2020-08-04&st=2026-03-28T22%3A03%3A31Z&se=2026-03-28T22%3A28%3A31Z&sr=b&sp=r&sig=8BqSQERI1JQCVBe1x8fbzIsYG%2BShES3mtYstvdJ8vEg%3D)
2026-03-28 22:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251669/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW67HUY/42806780?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=IjccUHM%2BUsRolC4agemnjyYj%2By8q%2BaL%2Bv6NarfY2Bpc%3D)
2026-03-28 22:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: df646afa-cd7d-59ba-af23-e32bf2546109 with identifier: RGZ%202258
2026-03-28 22:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: df646afa-cd7d-59ba-af23-e32bf2546109 with identifier: RGZ%202258
2026-03-28 22:04:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: df646afa-cd7d-59ba-af23-e32bf2546109 with identifier: RGZ%202258 to the API
2026-03-28 22:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969343/600>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df646afa-cd7d-59ba-af23-e32bf2546109/df646afa-cd7d-59ba-af23-e32bf2546109_expert_report_file_4a54dea4-4198-4fb1-a0e7-dea4fa99d8b8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RGZ%202258-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'df646afa-cd7d-59ba-af23-e32bf2546109',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RGZ 2258',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RGZ%202258&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'KIA',
'model': 'NIRO',
'odometer': 51865,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df646afa-cd7d-59ba-af23-e32bf2546109/df646afa-cd7d-59ba-af23-e32bf2546109_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41873,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969343/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df646afa-cd7d-59ba-af23-e32bf2546109/df646afa-cd7d-59ba-af23-e32bf2546109_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41297,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969352/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df646afa-cd7d-59ba-af23-e32bf2546109/df646afa-cd7d-59ba-af23-e32bf2546109_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41264,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969363/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df646afa-cd7d-59ba-af23-e32bf2546109/df646afa-cd7d-59ba-af23-e32bf2546109_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42189,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969375/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df646afa-cd7d-59ba-af23-e32bf2546109/df646afa-cd7d-59ba-af23-e32bf2546109_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36619,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969388/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df646afa-cd7d-59ba-af23-e32bf2546109/df646afa-cd7d-59ba-af23-e32bf2546109_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34292,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969396/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df646afa-cd7d-59ba-af23-e32bf2546109/df646afa-cd7d-59ba-af23-e32bf2546109_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92089,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969410/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df646afa-cd7d-59ba-af23-e32bf2546109/df646afa-cd7d-59ba-af23-e32bf2546109_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89792,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969422/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df646afa-cd7d-59ba-af23-e32bf2546109/df646afa-cd7d-59ba-af23-e32bf2546109_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101218,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969433/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df646afa-cd7d-59ba-af23-e32bf2546109/df646afa-cd7d-59ba-af23-e32bf2546109_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79105,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RGZ2258/698969442/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'KIA NIRO 1.6 GDI HYBRID 2 DCT Hatchback',
'transmission': 'automatic',
'trim': 'GDI HYBRID 2 DCT',
'vin': 'KNACC81CVL5391687',
'year': 2020}
2026-03-28 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RGZ%25202258%27 HTTP/1.1" 200 None
2026-03-28 22:04:01 [bca.uk] INFO: Saving data for RGZ%202258: {'created_time': 1774735441.932704, 'last_price_update_time': 1774735441.932716, 'auction_closing_time': 1774951200.0}
2026-03-28 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RGZ%25202258') HTTP/1.1" 204 0
2026-03-28 22:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HL19RNJ/42810752?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=T0nG6Oujza%2FUCalPtLB6bJCrPtKcwMpFh7hZ0OseMMM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554804610>
2026-03-28 22:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6/4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK69NEO%252F699002701%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002701/600 saved to cache
2026-03-28 22:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6
2026-03-28 22:04:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6, skipping ID generation
2026-03-28 22:04:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6 sending to next pipeline
2026-03-28 22:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6, identifier: DK69%20NEO
2026-03-28 22:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477daad0>
2026-03-28 22:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7bbb95c-34a4-508c-9af6-6415bfd76278/f7bbb95c-34a4-508c-9af6-6415bfd76278_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMH19RHF%252F699011340%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011340/600 saved to cache
2026-03-28 22:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f7bbb95c-34a4-508c-9af6-6415bfd76278
2026-03-28 22:04:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f7bbb95c-34a4-508c-9af6-6415bfd76278, skipping ID generation
2026-03-28 22:04:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f7bbb95c-34a4-508c-9af6-6415bfd76278 sending to next pipeline
2026-03-28 22:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f7bbb95c-34a4-508c-9af6-6415bfd76278, identifier: MH19%20RHF
2026-03-28 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54761c0d0>
2026-03-28 22:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4f2d0a0-2885-57c7-ae21-ea61c25273d9/d4f2d0a0-2885-57c7-ae21-ea61c25273d9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOU64UPA%252F699146018%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699146018/600 saved to cache
2026-03-28 22:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d4f2d0a0-2885-57c7-ae21-ea61c25273d9
2026-03-28 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a17910>
2026-03-28 22:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d00f4d6-3827-55c1-a06a-583364af76a6/2d00f4d6-3827-55c1-a06a-583364af76a6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU67EBV%252F699189278%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189278/600 saved to cache
2026-03-28 22:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2d00f4d6-3827-55c1-a06a-583364af76a6
2026-03-28 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473b8a90>
2026-03-28 22:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3649b9f8-64ee-584f-9d2b-f46b1db86e38/3649b9f8-64ee-584f-9d2b-f46b1db86e38_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKW67HUY%252F699251684%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251684/600 saved to cache
2026-03-28 22:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3649b9f8-64ee-584f-9d2b-f46b1db86e38
2026-03-28 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54727a190>
2026-03-28 22:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63a9213b-9753-5663-b464-16226cca8eb4/63a9213b-9753-5663-b464-16226cca8eb4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV65GFU%252F698994549%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994549/600 saved to cache
2026-03-28 22:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 63a9213b-9753-5663-b464-16226cca8eb4
2026-03-28 22:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54761dd50>
2026-03-28 22:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b40829-d997-5432-a0e4-0fd30767ce9e/43b40829-d997-5432-a0e4-0fd30767ce9e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY66XSJ%252F699158291%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158291/600 saved to cache
2026-03-28 22:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43b40829-d997-5432-a0e4-0fd30767ce9e
2026-03-28 22:04:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW21EVR/42811037?sv=2020-08-04&st=2026-03-28T22%3A04%3A01Z&se=2026-03-28T22%3A29%3A01Z&sr=b&sp=r&sig=eP9bkedy6SDizyM2Av%2FvVq0wPdkgVC8QlLepM%2B3jGV4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BW21%20EVR-GB>
2026-03-28 22:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6 with identifier: DK69%20NEO
2026-03-28 22:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6 with identifier: DK69%20NEO
2026-03-28 22:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6 with identifier: DK69%20NEO to the API
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002701/600>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6/4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6_expert_report_file_81df544f-1ee1-45ac-825d-04134a5ded1d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DK69%20NEO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DK69 NEO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DK69%20NEO&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 81446,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6/4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39090,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002701/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6/4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38354,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002708/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6/4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38705,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002719/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6/4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39761,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002733/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6/4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35777,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002747/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6/4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34311,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002769/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6/4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69128,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002813/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6/4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75744,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002836/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6/4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83939,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002890/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6/4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80483,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK69NEO/699002931/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.5 EBL 120 ST-LINE P/S Hatchback',
'transmission': 'automatic',
'trim': 'EBL 120 ST-LINE P/S',
'vin': 'WF0NXXGCHNKT16990',
'year': 2019}
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK69%2520NEO%27 HTTP/1.1" 200 None
2026-03-28 22:04:02 [bca.uk] INFO: Saving data for DK69%20NEO: {'created_time': 1774735442.819371, 'last_price_update_time': 1774735442.819383, 'auction_closing_time': 1774951200.0}
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DK69%2520NEO') HTTP/1.1" 204 0
2026-03-28 22:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f7bbb95c-34a4-508c-9af6-6415bfd76278 with identifier: MH19%20RHF
2026-03-28 22:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f7bbb95c-34a4-508c-9af6-6415bfd76278 with identifier: MH19%20RHF
2026-03-28 22:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f7bbb95c-34a4-508c-9af6-6415bfd76278 with identifier: MH19%20RHF to the API
2026-03-28 22:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011340/600>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7bbb95c-34a4-508c-9af6-6415bfd76278/f7bbb95c-34a4-508c-9af6-6415bfd76278_expert_report_file_16f7b7fa-fe31-4a0d-ae0a-98726fba2c38.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MH19%20RHF-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f7bbb95c-34a4-508c-9af6-6415bfd76278',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MH19 RHF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MH19%20RHF&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'AUDI',
'model': 'A4',
'odometer': 60922,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7bbb95c-34a4-508c-9af6-6415bfd76278/f7bbb95c-34a4-508c-9af6-6415bfd76278_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41209,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011340/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7bbb95c-34a4-508c-9af6-6415bfd76278/f7bbb95c-34a4-508c-9af6-6415bfd76278_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39848,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011347/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7bbb95c-34a4-508c-9af6-6415bfd76278/f7bbb95c-34a4-508c-9af6-6415bfd76278_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39811,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011353/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7bbb95c-34a4-508c-9af6-6415bfd76278/f7bbb95c-34a4-508c-9af6-6415bfd76278_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39910,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011362/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7bbb95c-34a4-508c-9af6-6415bfd76278/f7bbb95c-34a4-508c-9af6-6415bfd76278_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35070,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011369/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7bbb95c-34a4-508c-9af6-6415bfd76278/f7bbb95c-34a4-508c-9af6-6415bfd76278_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32976,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011388/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7bbb95c-34a4-508c-9af6-6415bfd76278/f7bbb95c-34a4-508c-9af6-6415bfd76278_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87059,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011421/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7bbb95c-34a4-508c-9af6-6415bfd76278/f7bbb95c-34a4-508c-9af6-6415bfd76278_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84106,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011456/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7bbb95c-34a4-508c-9af6-6415bfd76278/f7bbb95c-34a4-508c-9af6-6415bfd76278_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96298,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011489/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7bbb95c-34a4-508c-9af6-6415bfd76278/f7bbb95c-34a4-508c-9af6-6415bfd76278_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87587,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MH19RHF/699011532/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'AUDI A4 2.0 35 TFSI S LINE S-T Saloon',
'transmission': 'automatic',
'trim': '35 TFSI S LINE S-T',
'vin': 'WAUZZZF47KA060332',
'year': 2019}
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MH19%2520RHF%27 HTTP/1.1" 200 None
2026-03-28 22:04:03 [bca.uk] INFO: Saving data for MH19%20RHF: {'created_time': 1774735443.192865, 'last_price_update_time': 1774735443.192878, 'auction_closing_time': 1774951200.0}
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MH19%2520RHF') HTTP/1.1" 204 0
2026-03-28 22:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KF19DKY/42811022?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=GplG9%2B9pTiJzji8cnGr7dMEKJveU9wcdMyJ7SINpu5U%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145984/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OU64UPA/42811127?sv=2020-08-04&st=2026-03-28T22%3A03%3A31Z&se=2026-03-28T22%3A28%3A31Z&sr=b&sp=r&sig=8BqSQERI1JQCVBe1x8fbzIsYG%2BShES3mtYstvdJ8vEg%3D)
2026-03-28 22:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF07MDE/42810388?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=t8wnLmqHAyqKgYxckcklhBRV9Z3X1%2BiDJQPjMtUJpT0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189247/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189247>
2026-03-28 22:04:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028280/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699028280>
2026-03-28 22:04:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158266/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158266>
2026-03-28 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555032dd0>
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4f2d0a0-2885-57c7-ae21-ea61c25273d9/d4f2d0a0-2885-57c7-ae21-ea61c25273d9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOU64UPA%252F699146002%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699146002/600 saved to cache
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d4f2d0a0-2885-57c7-ae21-ea61c25273d9
2026-03-28 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54710f850>
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3649b9f8-64ee-584f-9d2b-f46b1db86e38/3649b9f8-64ee-584f-9d2b-f46b1db86e38_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKW67HUY%252F699251669%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251669/600 saved to cache
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3649b9f8-64ee-584f-9d2b-f46b1db86e38
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54710d610>
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f3b828e-d75c-5ff7-a14e-22edf0b6b900/1f3b828e-d75c-5ff7-a14e-22edf0b6b900_expert_report_file_1791ebac-3f42-4a05-a9e1-ce0921094c5c.pdf HTTP/1.1" 201 0
2026-03-28 22:04:03 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1f3b828e-d75c-5ff7-a14e-22edf0b6b900
2026-03-28 22:04:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f3b828e-d75c-5ff7-a14e-22edf0b6b900, skipping ID generation
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f3b828e-d75c-5ff7-a14e-22edf0b6b900
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHL19RNJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HL19RNJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994491/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994491>
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144403%27 HTTP/1.1" 200 None
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144403 not downloaded yet
2026-03-28 22:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA19YWE/42811048?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=%2FIQ4owGkNsmgqpFNmRKT%2BGPKpJD1xlY%2FICUYJYRqwLA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144410%27 HTTP/1.1" 200 None
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144410 not downloaded yet
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554ba0910>
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f29b60-3863-5769-bd32-0a73da36e20b/f3f29b60-3863-5769-bd32-0a73da36e20b_expert_report_file_bcac3cb6-78fd-411e-aea4-d7daf5c9915d.pdf HTTP/1.1" 201 0
2026-03-28 22:04:03 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f3f29b60-3863-5769-bd32-0a73da36e20b
2026-03-28 22:04:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3f29b60-3863-5769-bd32-0a73da36e20b, skipping ID generation
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f3f29b60-3863-5769-bd32-0a73da36e20b
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKF19DKY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KF19DKY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fbc810>
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4f2d0a0-2885-57c7-ae21-ea61c25273d9/d4f2d0a0-2885-57c7-ae21-ea61c25273d9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOU64UPA%252F699145984%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145984/600 saved to cache
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d4f2d0a0-2885-57c7-ae21-ea61c25273d9
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472a8bd0>
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d65eaf-0634-5a3f-9af8-91f997434603/37d65eaf-0634-5a3f-9af8-91f997434603_expert_report_file_36d8eca3-6012-48dc-a5bd-c3d460f987fe.pdf HTTP/1.1" 201 0
2026-03-28 22:04:03 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 37d65eaf-0634-5a3f-9af8-91f997434603
2026-03-28 22:04:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37d65eaf-0634-5a3f-9af8-91f997434603, skipping ID generation
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 37d65eaf-0634-5a3f-9af8-91f997434603
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGF07MDE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GF07MDE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251656/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW67HUY/42806780?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=IjccUHM%2BUsRolC4agemnjyYj%2By8q%2BaL%2Bv6NarfY2Bpc%3D)
2026-03-28 22:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189252/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU67EBV/42807577?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=Dc9GP37lnEoc8Ucnf7mZMpnnsmm75eM47cbqeVO4%2BUo%3D)
2026-03-28 22:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994507/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV65GFU/42810585?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=Uw05gug7lwLgV7s2MX8pmDxdS7jFiOh93SlRxrnK0ts%3D)
2026-03-28 22:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145971/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OU64UPA/42811127?sv=2020-08-04&st=2026-03-28T22%3A03%3A31Z&se=2026-03-28T22%3A28%3A31Z&sr=b&sp=r&sig=8BqSQERI1JQCVBe1x8fbzIsYG%2BShES3mtYstvdJ8vEg%3D)
2026-03-28 22:04:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251648/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251648>
2026-03-28 22:04:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145965/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145965>
2026-03-28 22:04:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189239/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189239>
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144416%27 HTTP/1.1" 200 None
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144416 not downloaded yet
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144716%27 HTTP/1.1" 200 None
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144716 not downloaded yet
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699289356%27 HTTP/1.1" 200 None
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699289356 not downloaded yet
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144420%27 HTTP/1.1" 200 None
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144420 not downloaded yet
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144722%27 HTTP/1.1" 200 None
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144722 not downloaded yet
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699289364%27 HTTP/1.1" 200 None
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699289364 not downloaded yet
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472aae50>
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_425c7b94-e605-550f-9362-6af12cc1998a/425c7b94-e605-550f-9362-6af12cc1998a_expert_report_file_cc9db4bd-598c-4254-9bb7-b185a7a567bf.pdf HTTP/1.1" 201 0
2026-03-28 22:04:03 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 425c7b94-e605-550f-9362-6af12cc1998a
2026-03-28 22:04:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 425c7b94-e605-550f-9362-6af12cc1998a, skipping ID generation
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 425c7b94-e605-550f-9362-6af12cc1998a
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCA19YWE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CA19YWE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158266/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY66XSJ/42810063?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=n4o%2FwpUrt5NmnHO4b%2FuTK0GIrxHv%2BFYQBHPaaSLhQm0%3D)
2026-03-28 22:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189247/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU67EBV/42807577?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=Dc9GP37lnEoc8Ucnf7mZMpnnsmm75eM47cbqeVO4%2BUo%3D)
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144425%27 HTTP/1.1" 200 None
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144425 not downloaded yet
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144726%27 HTTP/1.1" 200 None
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144726 not downloaded yet
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699289370%27 HTTP/1.1" 200 None
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699289370 not downloaded yet
2026-03-28 22:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994491/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV65GFU/42810585?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=Uw05gug7lwLgV7s2MX8pmDxdS7jFiOh93SlRxrnK0ts%3D)
2026-03-28 22:04:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994471/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994471>
2026-03-28 22:04:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251644/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251644>
2026-03-28 22:04:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145954/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145954>
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142593%27 HTTP/1.1" 200 None
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142593 not downloaded yet
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543deb90>
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3649b9f8-64ee-584f-9d2b-f46b1db86e38/3649b9f8-64ee-584f-9d2b-f46b1db86e38_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKW67HUY%252F699251656%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251656/600 saved to cache
2026-03-28 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3649b9f8-64ee-584f-9d2b-f46b1db86e38
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548d7010>
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d00f4d6-3827-55c1-a06a-583364af76a6/2d00f4d6-3827-55c1-a06a-583364af76a6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU67EBV%252F699189252%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189252/600 saved to cache
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2d00f4d6-3827-55c1-a06a-583364af76a6
2026-03-28 22:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542d4910>
2026-03-28 22:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63a9213b-9753-5663-b464-16226cca8eb4/63a9213b-9753-5663-b464-16226cca8eb4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV65GFU%252F698994507%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994507/600 saved to cache
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 63a9213b-9753-5663-b464-16226cca8eb4
2026-03-28 22:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554816710>
2026-03-28 22:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4f2d0a0-2885-57c7-ae21-ea61c25273d9/d4f2d0a0-2885-57c7-ae21-ea61c25273d9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOU64UPA%252F699145971%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145971/600 saved to cache
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d4f2d0a0-2885-57c7-ae21-ea61c25273d9
2026-03-28 22:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028280/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK11NXR/42811064?sv=2020-08-04&st=2026-03-28T22%3A03%3A33Z&se=2026-03-28T22%3A28%3A33Z&sr=b&sp=r&sig=WQwb7hHALscNLn8OXQjUUwD9ln4%2BEG5I6c0xHH7%2BOPc%3D)
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144438%27 HTTP/1.1" 200 None
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144438 not downloaded yet
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144731%27 HTTP/1.1" 200 None
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144731 not downloaded yet
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699289377%27 HTTP/1.1" 200 None
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699289377 not downloaded yet
2026-03-28 22:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW21EVR/42811037?sv=2020-08-04&st=2026-03-28T22%3A04%3A01Z&se=2026-03-28T22%3A29%3A01Z&sr=b&sp=r&sig=eP9bkedy6SDizyM2Av%2FvVq0wPdkgVC8QlLepM%2B3jGV4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142603%27 HTTP/1.1" 200 None
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142603 not downloaded yet
2026-03-28 22:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189239/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU67EBV/42807577?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=Dc9GP37lnEoc8Ucnf7mZMpnnsmm75eM47cbqeVO4%2BUo%3D)
2026-03-28 22:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251648/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW67HUY/42806780?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=IjccUHM%2BUsRolC4agemnjyYj%2By8q%2BaL%2Bv6NarfY2Bpc%3D)
2026-03-28 22:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145965/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OU64UPA/42811127?sv=2020-08-04&st=2026-03-28T22%3A03%3A31Z&se=2026-03-28T22%3A28%3A31Z&sr=b&sp=r&sig=8BqSQERI1JQCVBe1x8fbzIsYG%2BShES3mtYstvdJ8vEg%3D)
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144452%27 HTTP/1.1" 200 None
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144452 not downloaded yet
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144737%27 HTTP/1.1" 200 None
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144737 not downloaded yet
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699289385%27 HTTP/1.1" 200 None
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699289385 not downloaded yet
2026-03-28 22:04:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144403/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144403>
2026-03-28 22:04:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289351/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GF07MDE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144711/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KF19DKY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142614%27 HTTP/1.1" 200 None
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142614 not downloaded yet
2026-03-28 22:04:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144410/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144410>
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144464%27 HTTP/1.1" 200 None
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144464 not downloaded yet
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144747%27 HTTP/1.1" 200 None
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144747 not downloaded yet
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699289404%27 HTTP/1.1" 200 None
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699289404 not downloaded yet
2026-03-28 22:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554383590>
2026-03-28 22:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b40829-d997-5432-a0e4-0fd30767ce9e/43b40829-d997-5432-a0e4-0fd30767ce9e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY66XSJ%252F699158266%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158266/600 saved to cache
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43b40829-d997-5432-a0e4-0fd30767ce9e
2026-03-28 22:04:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43b40829-d997-5432-a0e4-0fd30767ce9e, skipping ID generation
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43b40829-d997-5432-a0e4-0fd30767ce9e sending to next pipeline
2026-03-28 22:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 43b40829-d997-5432-a0e4-0fd30767ce9e, identifier: KY66%20XSJ
2026-03-28 22:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473de010>
2026-03-28 22:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d00f4d6-3827-55c1-a06a-583364af76a6/2d00f4d6-3827-55c1-a06a-583364af76a6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU67EBV%252F699189247%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189247/600 saved to cache
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2d00f4d6-3827-55c1-a06a-583364af76a6
2026-03-28 22:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555031950>
2026-03-28 22:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63a9213b-9753-5663-b464-16226cca8eb4/63a9213b-9753-5663-b464-16226cca8eb4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV65GFU%252F698994491%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994491/600 saved to cache
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 63a9213b-9753-5663-b464-16226cca8eb4
2026-03-28 22:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fa8a50>
2026-03-28 22:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f/cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK11NXR%252F699028280%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028280/600 saved to cache
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f
2026-03-28 22:04:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f, skipping ID generation
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f sending to next pipeline
2026-03-28 22:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f, identifier: AK11%20NXR
2026-03-28 22:04:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144396/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HL19RNJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142626%27 HTTP/1.1" 200 None
2026-03-28 22:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142626 not downloaded yet
2026-03-28 22:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 43b40829-d997-5432-a0e4-0fd30767ce9e with identifier: KY66%20XSJ
2026-03-28 22:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 43b40829-d997-5432-a0e4-0fd30767ce9e with identifier: KY66%20XSJ
2026-03-28 22:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 43b40829-d997-5432-a0e4-0fd30767ce9e with identifier: KY66%20XSJ to the API
2026-03-28 22:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158266/600>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b40829-d997-5432-a0e4-0fd30767ce9e/43b40829-d997-5432-a0e4-0fd30767ce9e_expert_report_file_f124eec1-e91d-4d0e-b0d2-82e282594bfb.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KY66%20XSJ-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '43b40829-d997-5432-a0e4-0fd30767ce9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KY66 XSJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KY66%20XSJ&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'PEUGEOT',
'model': '108',
'odometer': 45874,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b40829-d997-5432-a0e4-0fd30767ce9e/43b40829-d997-5432-a0e4-0fd30767ce9e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51070,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158258/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b40829-d997-5432-a0e4-0fd30767ce9e/43b40829-d997-5432-a0e4-0fd30767ce9e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51072,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158266/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b40829-d997-5432-a0e4-0fd30767ce9e/43b40829-d997-5432-a0e4-0fd30767ce9e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48139,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158274/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b40829-d997-5432-a0e4-0fd30767ce9e/43b40829-d997-5432-a0e4-0fd30767ce9e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48516,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158281/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b40829-d997-5432-a0e4-0fd30767ce9e/43b40829-d997-5432-a0e4-0fd30767ce9e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44296,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158291/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b40829-d997-5432-a0e4-0fd30767ce9e/43b40829-d997-5432-a0e4-0fd30767ce9e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44828,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158295/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b40829-d997-5432-a0e4-0fd30767ce9e/43b40829-d997-5432-a0e4-0fd30767ce9e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109370,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158308/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b40829-d997-5432-a0e4-0fd30767ce9e/43b40829-d997-5432-a0e4-0fd30767ce9e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71576,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158321/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b40829-d997-5432-a0e4-0fd30767ce9e/43b40829-d997-5432-a0e4-0fd30767ce9e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86295,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158334/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b40829-d997-5432-a0e4-0fd30767ce9e/43b40829-d997-5432-a0e4-0fd30767ce9e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86985,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY66XSJ/699158346/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'PEUGEOT 108 1.2 P/T ALLURE Hatchback',
'transmission': 'manual',
'trim': 'P/T ALLURE',
'vin': 'VF3PAHMTCGR289449',
'year': 2016}
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY66%2520XSJ%27 HTTP/1.1" 200 None
2026-03-28 22:04:05 [bca.uk] INFO: Saving data for KY66%20XSJ: {'created_time': 1774735445.232188, 'last_price_update_time': 1774735445.232199, 'auction_closing_time': 1774778400.0}
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KY66%2520XSJ') HTTP/1.1" 204 0
2026-03-28 22:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f with identifier: AK11%20NXR
2026-03-28 22:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f with identifier: AK11%20NXR
2026-03-28 22:04:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f with identifier: AK11%20NXR to the API
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028280/600>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f/cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f_expert_report_file_9b59bebc-d6dc-4a74-affb-896bf8b4e860.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AK11%20NXR-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AK11 NXR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AK11%20NXR&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'KA',
'odometer': 113101,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f/cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175454,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028279/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f/cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173165,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028280/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f/cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178965,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028281/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f/cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182029,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028282/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f/cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159245,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028283/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f/cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 135070,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028284/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f/cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 160280,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028285/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f/cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151899,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028286/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f/cdc6c2ed-3f08-5aad-b116-ff4b36ee3d0f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 157751,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK11NXR/699028287/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'FORD KA 1.2 STUDIO S/S Hatchback',
'transmission': 'manual',
'trim': 'STUDIO S/S',
'vin': 'WF0UXXLTRUBK69713',
'year': 2011}
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK11%2520NXR%27 HTTP/1.1" 200 None
2026-03-28 22:04:05 [bca.uk] INFO: Saving data for AK11%20NXR: {'created_time': 1774735445.617764, 'last_price_update_time': 1774735445.617774, 'auction_closing_time': 1774778400.0}
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AK11%2520NXR') HTTP/1.1" 204 0
2026-03-28 22:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251644/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW67HUY/42806780?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=IjccUHM%2BUsRolC4agemnjyYj%2By8q%2BaL%2Bv6NarfY2Bpc%3D)
2026-03-28 22:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994471/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV65GFU/42810585?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=Uw05gug7lwLgV7s2MX8pmDxdS7jFiOh93SlRxrnK0ts%3D)
2026-03-28 22:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145954/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OU64UPA/42811127?sv=2020-08-04&st=2026-03-28T22%3A03%3A31Z&se=2026-03-28T22%3A28%3A31Z&sr=b&sp=r&sig=8BqSQERI1JQCVBe1x8fbzIsYG%2BShES3mtYstvdJ8vEg%3D)
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144473%27 HTTP/1.1" 200 None
2026-03-28 22:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144473 not downloaded yet
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144760%27 HTTP/1.1" 200 None
2026-03-28 22:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144760 not downloaded yet
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699289420%27 HTTP/1.1" 200 None
2026-03-28 22:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699289420 not downloaded yet
2026-03-28 22:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477ce110>
2026-03-28 22:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c4f924-7308-5bd2-b24d-6916e1a7f917/96c4f924-7308-5bd2-b24d-6916e1a7f917_expert_report_file_d073190b-a11b-43a4-9d05-390560d02d45.pdf HTTP/1.1" 201 0
2026-03-28 22:04:05 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 96c4f924-7308-5bd2-b24d-6916e1a7f917
2026-03-28 22:04:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96c4f924-7308-5bd2-b24d-6916e1a7f917, skipping ID generation
2026-03-28 22:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96c4f924-7308-5bd2-b24d-6916e1a7f917
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBW21EVR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BW21EVR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144722/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144722>
2026-03-28 22:04:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289364/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699289364>
2026-03-28 22:04:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142573/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CA19YWE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142593/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142593>
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142640%27 HTTP/1.1" 200 None
2026-03-28 22:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142640 not downloaded yet
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144770%27 HTTP/1.1" 200 None
2026-03-28 22:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144770 not downloaded yet
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699289445%27 HTTP/1.1" 200 None
2026-03-28 22:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699289445 not downloaded yet
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142565%27 HTTP/1.1" 200 None
2026-03-28 22:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142565 not downloaded yet
2026-03-28 22:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554926550>
2026-03-28 22:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d00f4d6-3827-55c1-a06a-583364af76a6/2d00f4d6-3827-55c1-a06a-583364af76a6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU67EBV%252F699189239%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189239/600 saved to cache
2026-03-28 22:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2d00f4d6-3827-55c1-a06a-583364af76a6
2026-03-28 22:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556f865d0>
2026-03-28 22:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3649b9f8-64ee-584f-9d2b-f46b1db86e38/3649b9f8-64ee-584f-9d2b-f46b1db86e38_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKW67HUY%252F699251648%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251648/600 saved to cache
2026-03-28 22:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3649b9f8-64ee-584f-9d2b-f46b1db86e38
2026-03-28 22:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548d7cd0>
2026-03-28 22:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4f2d0a0-2885-57c7-ae21-ea61c25273d9/d4f2d0a0-2885-57c7-ae21-ea61c25273d9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOU64UPA%252F699145965%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145965/600 saved to cache
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d4f2d0a0-2885-57c7-ae21-ea61c25273d9
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142667%27 HTTP/1.1" 200 None
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142667 not downloaded yet
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f91d50>
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3649b9f8-64ee-584f-9d2b-f46b1db86e38/3649b9f8-64ee-584f-9d2b-f46b1db86e38_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKW67HUY%252F699251644%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251644/600 saved to cache
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3649b9f8-64ee-584f-9d2b-f46b1db86e38
2026-03-28 22:04:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144731/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144731>
2026-03-28 22:04:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144438/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144438>
2026-03-28 22:04:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289370/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699289370>
2026-03-28 22:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144711/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KF19DKY/42811022?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=GplG9%2B9pTiJzji8cnGr7dMEKJveU9wcdMyJ7SINpu5U%3D)
2026-03-28 22:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144403/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HL19RNJ/42810752?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=T0nG6Oujza%2FUCalPtLB6bJCrPtKcwMpFh7hZ0OseMMM%3D)
2026-03-28 22:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289351/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF07MDE/42810388?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=t8wnLmqHAyqKgYxckcklhBRV9Z3X1%2BiDJQPjMtUJpT0%3D)
2026-03-28 22:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144410/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HL19RNJ/42810752?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=T0nG6Oujza%2FUCalPtLB6bJCrPtKcwMpFh7hZ0OseMMM%3D)
2026-03-28 22:04:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289377/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699289377>
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144780%27 HTTP/1.1" 200 None
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144780 not downloaded yet
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699289462%27 HTTP/1.1" 200 None
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699289462 not downloaded yet
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142581%27 HTTP/1.1" 200 None
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142581 not downloaded yet
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142691%27 HTTP/1.1" 200 None
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142691 not downloaded yet
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b2090>
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63a9213b-9753-5663-b464-16226cca8eb4/63a9213b-9753-5663-b464-16226cca8eb4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV65GFU%252F698994471%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994471/600 saved to cache
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 63a9213b-9753-5663-b464-16226cca8eb4
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554345ad0>
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4f2d0a0-2885-57c7-ae21-ea61c25273d9/d4f2d0a0-2885-57c7-ae21-ea61c25273d9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOU64UPA%252F699145954%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145954/600 saved to cache
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d4f2d0a0-2885-57c7-ae21-ea61c25273d9
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142588%27 HTTP/1.1" 200 None
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142588 not downloaded yet
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142720%27 HTTP/1.1" 200 None
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142720 not downloaded yet
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142602%27 HTTP/1.1" 200 None
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142602 not downloaded yet
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548f7f90>
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f29b60-3863-5769-bd32-0a73da36e20b/f3f29b60-3863-5769-bd32-0a73da36e20b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKF19DKY%252F699144711%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144711/600 saved to cache
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f3f29b60-3863-5769-bd32-0a73da36e20b
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547741a50>
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f3b828e-d75c-5ff7-a14e-22edf0b6b900/1f3b828e-d75c-5ff7-a14e-22edf0b6b900_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHL19RNJ%252F699144403%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144403/600 saved to cache
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f3b828e-d75c-5ff7-a14e-22edf0b6b900
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477c7590>
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d65eaf-0634-5a3f-9af8-91f997434603/37d65eaf-0634-5a3f-9af8-91f997434603_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF07MDE%252F699289351%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289351/600 saved to cache
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37d65eaf-0634-5a3f-9af8-91f997434603
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547740090>
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f3b828e-d75c-5ff7-a14e-22edf0b6b900/1f3b828e-d75c-5ff7-a14e-22edf0b6b900_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHL19RNJ%252F699144410%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144410/600 saved to cache
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f3b828e-d75c-5ff7-a14e-22edf0b6b900
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142751%27 HTTP/1.1" 200 None
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142751 not downloaded yet
2026-03-28 22:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144396/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HL19RNJ/42810752?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=T0nG6Oujza%2FUCalPtLB6bJCrPtKcwMpFh7hZ0OseMMM%3D)
2026-03-28 22:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142593/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA19YWE/42811048?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=%2FIQ4owGkNsmgqpFNmRKT%2BGPKpJD1xlY%2FICUYJYRqwLA%3D)
2026-03-28 22:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142573/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA19YWE/42811048?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=%2FIQ4owGkNsmgqpFNmRKT%2BGPKpJD1xlY%2FICUYJYRqwLA%3D)
2026-03-28 22:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289364/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF07MDE/42810388?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=t8wnLmqHAyqKgYxckcklhBRV9Z3X1%2BiDJQPjMtUJpT0%3D)
2026-03-28 22:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144722/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KF19DKY/42811022?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=GplG9%2B9pTiJzji8cnGr7dMEKJveU9wcdMyJ7SINpu5U%3D)
2026-03-28 22:04:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144464/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144464>
2026-03-28 22:04:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289404/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699289404>
2026-03-28 22:04:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144747/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144747>
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142613%27 HTTP/1.1" 200 None
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142613 not downloaded yet
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142627%27 HTTP/1.1" 200 None
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142627 not downloaded yet
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142646%27 HTTP/1.1" 200 None
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142646 not downloaded yet
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142665%27 HTTP/1.1" 200 None
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142665 not downloaded yet
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142684%27 HTTP/1.1" 200 None
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142684 not downloaded yet
2026-03-28 22:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289370/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF07MDE/42810388?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=t8wnLmqHAyqKgYxckcklhBRV9Z3X1%2BiDJQPjMtUJpT0%3D)
2026-03-28 22:04:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144770/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144770>
2026-03-28 22:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289377/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF07MDE/42810388?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=t8wnLmqHAyqKgYxckcklhBRV9Z3X1%2BiDJQPjMtUJpT0%3D)
2026-03-28 22:04:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142667/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142667>
2026-03-28 22:04:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289445/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699289445>
2026-03-28 22:04:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142565/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142565>
2026-03-28 22:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144731/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KF19DKY/42811022?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=GplG9%2B9pTiJzji8cnGr7dMEKJveU9wcdMyJ7SINpu5U%3D)
2026-03-28 22:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144438/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HL19RNJ/42810752?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=T0nG6Oujza%2FUCalPtLB6bJCrPtKcwMpFh7hZ0OseMMM%3D)
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547630cd0>
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f3b828e-d75c-5ff7-a14e-22edf0b6b900/1f3b828e-d75c-5ff7-a14e-22edf0b6b900_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHL19RNJ%252F699144396%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144396/600 saved to cache
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f3b828e-d75c-5ff7-a14e-22edf0b6b900
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b28ed0>
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_425c7b94-e605-550f-9362-6af12cc1998a/425c7b94-e605-550f-9362-6af12cc1998a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA19YWE%252F699142593%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142593/600 saved to cache
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 425c7b94-e605-550f-9362-6af12cc1998a
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547297bd0>
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_425c7b94-e605-550f-9362-6af12cc1998a/425c7b94-e605-550f-9362-6af12cc1998a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA19YWE%252F699142573%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142573/600 saved to cache
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 425c7b94-e605-550f-9362-6af12cc1998a
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473b8e10>
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d65eaf-0634-5a3f-9af8-91f997434603/37d65eaf-0634-5a3f-9af8-91f997434603_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF07MDE%252F699289364%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289364/600 saved to cache
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 37d65eaf-0634-5a3f-9af8-91f997434603
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547294050>
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f29b60-3863-5769-bd32-0a73da36e20b/f3f29b60-3863-5769-bd32-0a73da36e20b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKF19DKY%252F699144722%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144722/600 saved to cache
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f3f29b60-3863-5769-bd32-0a73da36e20b
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547291250>
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d65eaf-0634-5a3f-9af8-91f997434603/37d65eaf-0634-5a3f-9af8-91f997434603_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF07MDE%252F699289370%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289370/600 saved to cache
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 37d65eaf-0634-5a3f-9af8-91f997434603
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54713e0d0>
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d65eaf-0634-5a3f-9af8-91f997434603/37d65eaf-0634-5a3f-9af8-91f997434603_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF07MDE%252F699289377%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289377/600 saved to cache
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 37d65eaf-0634-5a3f-9af8-91f997434603
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543e1610>
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f29b60-3863-5769-bd32-0a73da36e20b/f3f29b60-3863-5769-bd32-0a73da36e20b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKF19DKY%252F699144731%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144731/600 saved to cache
2026-03-28 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f3f29b60-3863-5769-bd32-0a73da36e20b
2026-03-28 22:04:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54710d410>
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f3b828e-d75c-5ff7-a14e-22edf0b6b900/1f3b828e-d75c-5ff7-a14e-22edf0b6b900_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHL19RNJ%252F699144438%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144438/600 saved to cache
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1f3b828e-d75c-5ff7-a14e-22edf0b6b900
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142751/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142751>
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142588/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142588>
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142602/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142602>
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142691/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142691>
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142720/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142720>
2026-03-28 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289404/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF07MDE/42810388?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=t8wnLmqHAyqKgYxckcklhBRV9Z3X1%2BiDJQPjMtUJpT0%3D)
2026-03-28 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144464/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HL19RNJ/42810752?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=T0nG6Oujza%2FUCalPtLB6bJCrPtKcwMpFh7hZ0OseMMM%3D)
2026-03-28 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144747/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KF19DKY/42811022?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=GplG9%2B9pTiJzji8cnGr7dMEKJveU9wcdMyJ7SINpu5U%3D)
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142627/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142627>
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142646/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142646>
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142665/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142665>
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142684/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142684>
2026-03-28 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142565/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW21EVR/42811037?sv=2020-08-04&st=2026-03-28T22%3A04%3A01Z&se=2026-03-28T22%3A29%3A01Z&sr=b&sp=r&sig=eP9bkedy6SDizyM2Av%2FvVq0wPdkgVC8QlLepM%2B3jGV4%3D)
2026-03-28 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289445/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF07MDE/42810388?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=t8wnLmqHAyqKgYxckcklhBRV9Z3X1%2BiDJQPjMtUJpT0%3D)
2026-03-28 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144770/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KF19DKY/42811022?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=GplG9%2B9pTiJzji8cnGr7dMEKJveU9wcdMyJ7SINpu5U%3D)
2026-03-28 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142667/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA19YWE/42811048?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=%2FIQ4owGkNsmgqpFNmRKT%2BGPKpJD1xlY%2FICUYJYRqwLA%3D)
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543e2e10>
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d65eaf-0634-5a3f-9af8-91f997434603/37d65eaf-0634-5a3f-9af8-91f997434603_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF07MDE%252F699289404%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289404/600 saved to cache
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 37d65eaf-0634-5a3f-9af8-91f997434603
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b731d0>
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f3b828e-d75c-5ff7-a14e-22edf0b6b900/1f3b828e-d75c-5ff7-a14e-22edf0b6b900_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHL19RNJ%252F699144464%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144464/600 saved to cache
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1f3b828e-d75c-5ff7-a14e-22edf0b6b900
2026-03-28 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142691/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA19YWE/42811048?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=%2FIQ4owGkNsmgqpFNmRKT%2BGPKpJD1xlY%2FICUYJYRqwLA%3D)
2026-03-28 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142602/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW21EVR/42811037?sv=2020-08-04&st=2026-03-28T22%3A04%3A01Z&se=2026-03-28T22%3A29%3A01Z&sr=b&sp=r&sig=eP9bkedy6SDizyM2Av%2FvVq0wPdkgVC8QlLepM%2B3jGV4%3D)
2026-03-28 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142588/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW21EVR/42811037?sv=2020-08-04&st=2026-03-28T22%3A04%3A01Z&se=2026-03-28T22%3A29%3A01Z&sr=b&sp=r&sig=eP9bkedy6SDizyM2Av%2FvVq0wPdkgVC8QlLepM%2B3jGV4%3D)
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142613/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142613>
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142581/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142581>
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289462/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699289462>
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a6eb10>
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f29b60-3863-5769-bd32-0a73da36e20b/f3f29b60-3863-5769-bd32-0a73da36e20b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKF19DKY%252F699144747%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144747/600 saved to cache
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f3f29b60-3863-5769-bd32-0a73da36e20b
2026-03-28 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142720/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA19YWE/42811048?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=%2FIQ4owGkNsmgqpFNmRKT%2BGPKpJD1xlY%2FICUYJYRqwLA%3D)
2026-03-28 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142751/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA19YWE/42811048?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=%2FIQ4owGkNsmgqpFNmRKT%2BGPKpJD1xlY%2FICUYJYRqwLA%3D)
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b83810>
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c4f924-7308-5bd2-b24d-6916e1a7f917/96c4f924-7308-5bd2-b24d-6916e1a7f917_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW21EVR%252F699142565%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142565/600 saved to cache
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96c4f924-7308-5bd2-b24d-6916e1a7f917
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554357ed0>
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d65eaf-0634-5a3f-9af8-91f997434603/37d65eaf-0634-5a3f-9af8-91f997434603_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF07MDE%252F699289445%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289445/600 saved to cache
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 37d65eaf-0634-5a3f-9af8-91f997434603
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b03890>
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f29b60-3863-5769-bd32-0a73da36e20b/f3f29b60-3863-5769-bd32-0a73da36e20b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKF19DKY%252F699144770%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144770/600 saved to cache
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f3f29b60-3863-5769-bd32-0a73da36e20b
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555031b10>
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_425c7b94-e605-550f-9362-6af12cc1998a/425c7b94-e605-550f-9362-6af12cc1998a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA19YWE%252F699142667%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142667/600 saved to cache
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 425c7b94-e605-550f-9362-6af12cc1998a
2026-03-28 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142646/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW21EVR/42811037?sv=2020-08-04&st=2026-03-28T22%3A04%3A01Z&se=2026-03-28T22%3A29%3A01Z&sr=b&sp=r&sig=eP9bkedy6SDizyM2Av%2FvVq0wPdkgVC8QlLepM%2B3jGV4%3D)
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142640/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142640>
2026-03-28 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142684/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW21EVR/42811037?sv=2020-08-04&st=2026-03-28T22%3A04%3A01Z&se=2026-03-28T22%3A29%3A01Z&sr=b&sp=r&sig=eP9bkedy6SDizyM2Av%2FvVq0wPdkgVC8QlLepM%2B3jGV4%3D)
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144780/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144780>
2026-03-28 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142627/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW21EVR/42811037?sv=2020-08-04&st=2026-03-28T22%3A04%3A01Z&se=2026-03-28T22%3A29%3A01Z&sr=b&sp=r&sig=eP9bkedy6SDizyM2Av%2FvVq0wPdkgVC8QlLepM%2B3jGV4%3D)
2026-03-28 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142665/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW21EVR/42811037?sv=2020-08-04&st=2026-03-28T22%3A04%3A01Z&se=2026-03-28T22%3A29%3A01Z&sr=b&sp=r&sig=eP9bkedy6SDizyM2Av%2FvVq0wPdkgVC8QlLepM%2B3jGV4%3D)
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554555250>
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_425c7b94-e605-550f-9362-6af12cc1998a/425c7b94-e605-550f-9362-6af12cc1998a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA19YWE%252F699142691%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142691/600 saved to cache
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 425c7b94-e605-550f-9362-6af12cc1998a
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474dd910>
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c4f924-7308-5bd2-b24d-6916e1a7f917/96c4f924-7308-5bd2-b24d-6916e1a7f917_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW21EVR%252F699142602%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142602/600 saved to cache
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96c4f924-7308-5bd2-b24d-6916e1a7f917
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5541fdb50>
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c4f924-7308-5bd2-b24d-6916e1a7f917/96c4f924-7308-5bd2-b24d-6916e1a7f917_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW21EVR%252F699142588%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142588/600 saved to cache
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96c4f924-7308-5bd2-b24d-6916e1a7f917
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474dfc90>
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_425c7b94-e605-550f-9362-6af12cc1998a/425c7b94-e605-550f-9362-6af12cc1998a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA19YWE%252F699142720%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142720/600 saved to cache
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 425c7b94-e605-550f-9362-6af12cc1998a
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472b0450>
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_425c7b94-e605-550f-9362-6af12cc1998a/425c7b94-e605-550f-9362-6af12cc1998a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA19YWE%252F699142751%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142751/600 saved to cache
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 425c7b94-e605-550f-9362-6af12cc1998a
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142550/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BW21EVR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289420/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699289420>
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548170d0>
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c4f924-7308-5bd2-b24d-6916e1a7f917/96c4f924-7308-5bd2-b24d-6916e1a7f917_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW21EVR%252F699142646%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142646/600 saved to cache
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 96c4f924-7308-5bd2-b24d-6916e1a7f917
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542fda10>
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c4f924-7308-5bd2-b24d-6916e1a7f917/96c4f924-7308-5bd2-b24d-6916e1a7f917_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW21EVR%252F699142684%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142684/600 saved to cache
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 96c4f924-7308-5bd2-b24d-6916e1a7f917
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5572a0050>
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c4f924-7308-5bd2-b24d-6916e1a7f917/96c4f924-7308-5bd2-b24d-6916e1a7f917_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW21EVR%252F699142627%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142627/600 saved to cache
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 96c4f924-7308-5bd2-b24d-6916e1a7f917
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54717e2d0>
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c4f924-7308-5bd2-b24d-6916e1a7f917/96c4f924-7308-5bd2-b24d-6916e1a7f917_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW21EVR%252F699142665%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142665/600 saved to cache
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 96c4f924-7308-5bd2-b24d-6916e1a7f917
2026-03-28 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289462/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF07MDE/42810388?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=t8wnLmqHAyqKgYxckcklhBRV9Z3X1%2BiDJQPjMtUJpT0%3D)
2026-03-28 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142613/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW21EVR/42811037?sv=2020-08-04&st=2026-03-28T22%3A04%3A01Z&se=2026-03-28T22%3A29%3A01Z&sr=b&sp=r&sig=eP9bkedy6SDizyM2Av%2FvVq0wPdkgVC8QlLepM%2B3jGV4%3D)
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142626/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142626>
2026-03-28 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142581/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW21EVR/42811037?sv=2020-08-04&st=2026-03-28T22%3A04%3A01Z&se=2026-03-28T22%3A29%3A01Z&sr=b&sp=r&sig=eP9bkedy6SDizyM2Av%2FvVq0wPdkgVC8QlLepM%2B3jGV4%3D)
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144473/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144473>
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144760/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144760>
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142614/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142614>
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289385/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699289385>
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144452/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144452>
2026-03-28 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142640/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA19YWE/42811048?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=%2FIQ4owGkNsmgqpFNmRKT%2BGPKpJD1xlY%2FICUYJYRqwLA%3D)
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142603/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142603>
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144726/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144726>
2026-03-28 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144737/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144737>
2026-03-28 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289420/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF07MDE/42810388?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=t8wnLmqHAyqKgYxckcklhBRV9Z3X1%2BiDJQPjMtUJpT0%3D)
2026-03-28 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142550/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW21EVR/42811037?sv=2020-08-04&st=2026-03-28T22%3A04%3A01Z&se=2026-03-28T22%3A29%3A01Z&sr=b&sp=r&sig=eP9bkedy6SDizyM2Av%2FvVq0wPdkgVC8QlLepM%2B3jGV4%3D)
2026-03-28 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144780/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KF19DKY/42811022?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=GplG9%2B9pTiJzji8cnGr7dMEKJveU9wcdMyJ7SINpu5U%3D)
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547361d10>
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d65eaf-0634-5a3f-9af8-91f997434603/37d65eaf-0634-5a3f-9af8-91f997434603_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF07MDE%252F699289462%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289462/600 saved to cache
2026-03-28 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 37d65eaf-0634-5a3f-9af8-91f997434603
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548dd890>
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c4f924-7308-5bd2-b24d-6916e1a7f917/96c4f924-7308-5bd2-b24d-6916e1a7f917_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW21EVR%252F699142613%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142613/600 saved to cache
2026-03-28 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96c4f924-7308-5bd2-b24d-6916e1a7f917
2026-03-28 22:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289385/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF07MDE/42810388?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=t8wnLmqHAyqKgYxckcklhBRV9Z3X1%2BiDJQPjMtUJpT0%3D)
2026-03-28 22:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142626/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA19YWE/42811048?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=%2FIQ4owGkNsmgqpFNmRKT%2BGPKpJD1xlY%2FICUYJYRqwLA%3D)
2026-03-28 22:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142614/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA19YWE/42811048?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=%2FIQ4owGkNsmgqpFNmRKT%2BGPKpJD1xlY%2FICUYJYRqwLA%3D)
2026-03-28 22:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144425/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144425>
2026-03-28 22:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144420/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144420>
2026-03-28 22:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472bc2d0>
2026-03-28 22:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c4f924-7308-5bd2-b24d-6916e1a7f917/96c4f924-7308-5bd2-b24d-6916e1a7f917_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW21EVR%252F699142581%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142581/600 saved to cache
2026-03-28 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96c4f924-7308-5bd2-b24d-6916e1a7f917
2026-03-28 22:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144473/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HL19RNJ/42810752?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=T0nG6Oujza%2FUCalPtLB6bJCrPtKcwMpFh7hZ0OseMMM%3D)
2026-03-28 22:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144760/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KF19DKY/42811022?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=GplG9%2B9pTiJzji8cnGr7dMEKJveU9wcdMyJ7SINpu5U%3D)
2026-03-28 22:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289356/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699289356>
2026-03-28 22:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5476318d0>
2026-03-28 22:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_425c7b94-e605-550f-9362-6af12cc1998a/425c7b94-e605-550f-9362-6af12cc1998a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA19YWE%252F699142640%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142640/600 saved to cache
2026-03-28 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 425c7b94-e605-550f-9362-6af12cc1998a
2026-03-28 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe558b72810>
2026-03-28 22:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d65eaf-0634-5a3f-9af8-91f997434603/37d65eaf-0634-5a3f-9af8-91f997434603_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF07MDE%252F699289420%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289420/600 saved to cache
2026-03-28 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 37d65eaf-0634-5a3f-9af8-91f997434603
2026-03-28 22:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542fc490>
2026-03-28 22:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c4f924-7308-5bd2-b24d-6916e1a7f917/96c4f924-7308-5bd2-b24d-6916e1a7f917_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW21EVR%252F699142550%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142550/600 saved to cache
2026-03-28 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96c4f924-7308-5bd2-b24d-6916e1a7f917
2026-03-28 22:04:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96c4f924-7308-5bd2-b24d-6916e1a7f917, skipping ID generation
2026-03-28 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96c4f924-7308-5bd2-b24d-6916e1a7f917 sending to next pipeline
2026-03-28 22:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 96c4f924-7308-5bd2-b24d-6916e1a7f917, identifier: BW21%20EVR
2026-03-28 22:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 96c4f924-7308-5bd2-b24d-6916e1a7f917 with identifier: BW21%20EVR
2026-03-28 22:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 96c4f924-7308-5bd2-b24d-6916e1a7f917 with identifier: BW21%20EVR
2026-03-28 22:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 96c4f924-7308-5bd2-b24d-6916e1a7f917 with identifier: BW21%20EVR to the API
2026-03-28 22:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142550/600>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c4f924-7308-5bd2-b24d-6916e1a7f917/96c4f924-7308-5bd2-b24d-6916e1a7f917_expert_report_file_d073190b-a11b-43a4-9d05-390560d02d45.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BW21%20EVR-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '96c4f924-7308-5bd2-b24d-6916e1a7f917',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BW21 EVR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BW21%20EVR&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LEXUS',
'model': 'UX 250H',
'odometer': 83462,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c4f924-7308-5bd2-b24d-6916e1a7f917/96c4f924-7308-5bd2-b24d-6916e1a7f917_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50328,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142550/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c4f924-7308-5bd2-b24d-6916e1a7f917/96c4f924-7308-5bd2-b24d-6916e1a7f917_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46716,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142565/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c4f924-7308-5bd2-b24d-6916e1a7f917/96c4f924-7308-5bd2-b24d-6916e1a7f917_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46785,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142581/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c4f924-7308-5bd2-b24d-6916e1a7f917/96c4f924-7308-5bd2-b24d-6916e1a7f917_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48108,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142588/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c4f924-7308-5bd2-b24d-6916e1a7f917/96c4f924-7308-5bd2-b24d-6916e1a7f917_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44604,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142602/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c4f924-7308-5bd2-b24d-6916e1a7f917/96c4f924-7308-5bd2-b24d-6916e1a7f917_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41823,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142613/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c4f924-7308-5bd2-b24d-6916e1a7f917/96c4f924-7308-5bd2-b24d-6916e1a7f917_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87155,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142627/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c4f924-7308-5bd2-b24d-6916e1a7f917/96c4f924-7308-5bd2-b24d-6916e1a7f917_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59134,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142646/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c4f924-7308-5bd2-b24d-6916e1a7f917/96c4f924-7308-5bd2-b24d-6916e1a7f917_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87566,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142665/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c4f924-7308-5bd2-b24d-6916e1a7f917/96c4f924-7308-5bd2-b24d-6916e1a7f917_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59108,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW21EVR/699142684/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'LEXUS UX 250H 2.0 Hatchback',
'transmission': 'automatic',
'trim': '',
'vin': 'JTHY65BH902103535',
'year': 2021}
2026-03-28 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW21%2520EVR%27 HTTP/1.1" 200 None
2026-03-28 22:04:08 [bca.uk] INFO: Saving data for BW21%20EVR: {'created_time': 1774735448.987025, 'last_price_update_time': 1774735448.987036, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BW21%2520EVR') HTTP/1.1" 204 0
2026-03-28 22:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142603/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA19YWE/42811048?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=%2FIQ4owGkNsmgqpFNmRKT%2BGPKpJD1xlY%2FICUYJYRqwLA%3D)
2026-03-28 22:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144716/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144716>
2026-03-28 22:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144726/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KF19DKY/42811022?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=GplG9%2B9pTiJzji8cnGr7dMEKJveU9wcdMyJ7SINpu5U%3D)
2026-03-28 22:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144737/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KF19DKY/42811022?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=GplG9%2B9pTiJzji8cnGr7dMEKJveU9wcdMyJ7SINpu5U%3D)
2026-03-28 22:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144416/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144416>
2026-03-28 22:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145949/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145949>
2026-03-28 22:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251640/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251640>
2026-03-28 22:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144452/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HL19RNJ/42810752?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=T0nG6Oujza%2FUCalPtLB6bJCrPtKcwMpFh7hZ0OseMMM%3D)
2026-03-28 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b1810>
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f29b60-3863-5769-bd32-0a73da36e20b/f3f29b60-3863-5769-bd32-0a73da36e20b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKF19DKY%252F699144780%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144780/600 saved to cache
2026-03-28 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f3f29b60-3863-5769-bd32-0a73da36e20b
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b3750>
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d65eaf-0634-5a3f-9af8-91f997434603/37d65eaf-0634-5a3f-9af8-91f997434603_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF07MDE%252F699289385%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289385/600 saved to cache
2026-03-28 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 37d65eaf-0634-5a3f-9af8-91f997434603
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556fdc510>
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_425c7b94-e605-550f-9362-6af12cc1998a/425c7b94-e605-550f-9362-6af12cc1998a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA19YWE%252F699142626%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142626/600 saved to cache
2026-03-28 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 425c7b94-e605-550f-9362-6af12cc1998a
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548b8250>
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_425c7b94-e605-550f-9362-6af12cc1998a/425c7b94-e605-550f-9362-6af12cc1998a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA19YWE%252F699142614%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142614/600 saved to cache
2026-03-28 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 425c7b94-e605-550f-9362-6af12cc1998a
2026-03-28 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547207190>
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f3b828e-d75c-5ff7-a14e-22edf0b6b900/1f3b828e-d75c-5ff7-a14e-22edf0b6b900_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHL19RNJ%252F699144473%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144473/600 saved to cache
2026-03-28 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1f3b828e-d75c-5ff7-a14e-22edf0b6b900
2026-03-28 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547728250>
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f29b60-3863-5769-bd32-0a73da36e20b/f3f29b60-3863-5769-bd32-0a73da36e20b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKF19DKY%252F699144760%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144760/600 saved to cache
2026-03-28 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f3f29b60-3863-5769-bd32-0a73da36e20b
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548b8250>
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_425c7b94-e605-550f-9362-6af12cc1998a/425c7b94-e605-550f-9362-6af12cc1998a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA19YWE%252F699142603%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142603/600 saved to cache
2026-03-28 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 425c7b94-e605-550f-9362-6af12cc1998a
2026-03-28 22:04:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 425c7b94-e605-550f-9362-6af12cc1998a, skipping ID generation
2026-03-28 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 425c7b94-e605-550f-9362-6af12cc1998a sending to next pipeline
2026-03-28 22:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 425c7b94-e605-550f-9362-6af12cc1998a, identifier: CA19%20YWE
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548f7f50>
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f29b60-3863-5769-bd32-0a73da36e20b/f3f29b60-3863-5769-bd32-0a73da36e20b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKF19DKY%252F699144726%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144726/600 saved to cache
2026-03-28 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f3f29b60-3863-5769-bd32-0a73da36e20b
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b1390>
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f29b60-3863-5769-bd32-0a73da36e20b/f3f29b60-3863-5769-bd32-0a73da36e20b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKF19DKY%252F699144737%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144737/600 saved to cache
2026-03-28 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f3f29b60-3863-5769-bd32-0a73da36e20b
2026-03-28 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542912d0>
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f3b828e-d75c-5ff7-a14e-22edf0b6b900/1f3b828e-d75c-5ff7-a14e-22edf0b6b900_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHL19RNJ%252F699144452%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144452/600 saved to cache
2026-03-28 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1f3b828e-d75c-5ff7-a14e-22edf0b6b900
2026-03-28 22:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 425c7b94-e605-550f-9362-6af12cc1998a with identifier: CA19%20YWE
2026-03-28 22:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 425c7b94-e605-550f-9362-6af12cc1998a with identifier: CA19%20YWE
2026-03-28 22:04:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 425c7b94-e605-550f-9362-6af12cc1998a with identifier: CA19%20YWE to the API
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142603/600>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425c7b94-e605-550f-9362-6af12cc1998a/425c7b94-e605-550f-9362-6af12cc1998a_expert_report_file_cc9db4bd-598c-4254-9bb7-b185a7a567bf.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CA19%20YWE-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '425c7b94-e605-550f-9362-6af12cc1998a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CA19 YWE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CA19%20YWE&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 90400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425c7b94-e605-550f-9362-6af12cc1998a/425c7b94-e605-550f-9362-6af12cc1998a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49086,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142573/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425c7b94-e605-550f-9362-6af12cc1998a/425c7b94-e605-550f-9362-6af12cc1998a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44999,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142593/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425c7b94-e605-550f-9362-6af12cc1998a/425c7b94-e605-550f-9362-6af12cc1998a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43832,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142603/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425c7b94-e605-550f-9362-6af12cc1998a/425c7b94-e605-550f-9362-6af12cc1998a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47183,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142614/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425c7b94-e605-550f-9362-6af12cc1998a/425c7b94-e605-550f-9362-6af12cc1998a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44959,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142626/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425c7b94-e605-550f-9362-6af12cc1998a/425c7b94-e605-550f-9362-6af12cc1998a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40508,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142640/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425c7b94-e605-550f-9362-6af12cc1998a/425c7b94-e605-550f-9362-6af12cc1998a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94059,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142667/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425c7b94-e605-550f-9362-6af12cc1998a/425c7b94-e605-550f-9362-6af12cc1998a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58307,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142691/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425c7b94-e605-550f-9362-6af12cc1998a/425c7b94-e605-550f-9362-6af12cc1998a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90091,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142720/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425c7b94-e605-550f-9362-6af12cc1998a/425c7b94-e605-550f-9362-6af12cc1998a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75852,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA19YWE/699142751/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.6 TDI 115 MATCH DSG Hatchback',
'transmission': 'automatic',
'trim': 'TDI 115 MATCH DSG',
'vin': 'WVWZZZAUZKW155532',
'year': 2019}
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA19%2520YWE%27 HTTP/1.1" 200 None
2026-03-28 22:04:10 [bca.uk] INFO: Saving data for CA19%20YWE: {'created_time': 1774735450.109105, 'last_price_update_time': 1774735450.109117, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CA19%2520YWE') HTTP/1.1" 204 0
2026-03-28 22:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289356/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF07MDE/42810388?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=t8wnLmqHAyqKgYxckcklhBRV9Z3X1%2BiDJQPjMtUJpT0%3D)
2026-03-28 22:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144420/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HL19RNJ/42810752?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=T0nG6Oujza%2FUCalPtLB6bJCrPtKcwMpFh7hZ0OseMMM%3D)
2026-03-28 22:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144425/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HL19RNJ/42810752?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=T0nG6Oujza%2FUCalPtLB6bJCrPtKcwMpFh7hZ0OseMMM%3D)
2026-03-28 22:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189226/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189226>
2026-03-28 22:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145943/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145943>
2026-03-28 22:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994433/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994433>
2026-03-28 22:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251632/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251632>
2026-03-28 22:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX62RKE/42811098?sv=2020-08-04&st=2026-03-28T22%3A04%3A09Z&se=2026-03-28T22%3A29%3A09Z&sr=b&sp=r&sig=iHDTu6D4cBZ2Aj4oXB7FMKSgAqDL59mNlKIaTFVmQOE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LX62%20RKE-GB>
2026-03-28 22:04:10 [scrapy.extensions.logstats] INFO: Crawled 126 pages (at 46 pages/min), scraped 170 items (at 47 items/min)
2026-03-28 22:04:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 191MiB
2026-03-28 22:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994413/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OV65GFU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251640/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW67HUY/42806780?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=IjccUHM%2BUsRolC4agemnjyYj%2By8q%2BaL%2Bv6NarfY2Bpc%3D)
2026-03-28 22:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145949/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OU64UPA/42811127?sv=2020-08-04&st=2026-03-28T22%3A03%3A31Z&se=2026-03-28T22%3A28%3A31Z&sr=b&sp=r&sig=8BqSQERI1JQCVBe1x8fbzIsYG%2BShES3mtYstvdJ8vEg%3D)
2026-03-28 22:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144416/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HL19RNJ/42810752?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=T0nG6Oujza%2FUCalPtLB6bJCrPtKcwMpFh7hZ0OseMMM%3D)
2026-03-28 22:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189221/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NU67EBV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145934/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OU64UPA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251625/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KW67HUY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547732790>
2026-03-28 22:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d65eaf-0634-5a3f-9af8-91f997434603/37d65eaf-0634-5a3f-9af8-91f997434603_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF07MDE%252F699289356%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289356/600 saved to cache
2026-03-28 22:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 37d65eaf-0634-5a3f-9af8-91f997434603
2026-03-28 22:04:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37d65eaf-0634-5a3f-9af8-91f997434603, skipping ID generation
2026-03-28 22:04:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37d65eaf-0634-5a3f-9af8-91f997434603 sending to next pipeline
2026-03-28 22:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 37d65eaf-0634-5a3f-9af8-91f997434603, identifier: GF07%20MDE
2026-03-28 22:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5541fcc10>
2026-03-28 22:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f3b828e-d75c-5ff7-a14e-22edf0b6b900/1f3b828e-d75c-5ff7-a14e-22edf0b6b900_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHL19RNJ%252F699144420%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144420/600 saved to cache
2026-03-28 22:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f3b828e-d75c-5ff7-a14e-22edf0b6b900
2026-03-28 22:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 37d65eaf-0634-5a3f-9af8-91f997434603 with identifier: GF07%20MDE
2026-03-28 22:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 37d65eaf-0634-5a3f-9af8-91f997434603 with identifier: GF07%20MDE
2026-03-28 22:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 37d65eaf-0634-5a3f-9af8-91f997434603 with identifier: GF07%20MDE to the API
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289356/600>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d65eaf-0634-5a3f-9af8-91f997434603/37d65eaf-0634-5a3f-9af8-91f997434603_expert_report_file_36d8eca3-6012-48dc-a5bd-c3d460f987fe.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF07%20MDE-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.3L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '37d65eaf-0634-5a3f-9af8-91f997434603',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GF07 MDE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GF07%20MDE&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 27273,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d65eaf-0634-5a3f-9af8-91f997434603/37d65eaf-0634-5a3f-9af8-91f997434603_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43774,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289351/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d65eaf-0634-5a3f-9af8-91f997434603/37d65eaf-0634-5a3f-9af8-91f997434603_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42111,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289356/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d65eaf-0634-5a3f-9af8-91f997434603/37d65eaf-0634-5a3f-9af8-91f997434603_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41304,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289364/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d65eaf-0634-5a3f-9af8-91f997434603/37d65eaf-0634-5a3f-9af8-91f997434603_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39130,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289370/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d65eaf-0634-5a3f-9af8-91f997434603/37d65eaf-0634-5a3f-9af8-91f997434603_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37999,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289377/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d65eaf-0634-5a3f-9af8-91f997434603/37d65eaf-0634-5a3f-9af8-91f997434603_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38819,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289385/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d65eaf-0634-5a3f-9af8-91f997434603/37d65eaf-0634-5a3f-9af8-91f997434603_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96254,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289404/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d65eaf-0634-5a3f-9af8-91f997434603/37d65eaf-0634-5a3f-9af8-91f997434603_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73229,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289420/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d65eaf-0634-5a3f-9af8-91f997434603/37d65eaf-0634-5a3f-9af8-91f997434603_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74874,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289445/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d65eaf-0634-5a3f-9af8-91f997434603/37d65eaf-0634-5a3f-9af8-91f997434603_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59146,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF07MDE/699289462/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.3 VVT-I ZINC MMT Hatchback',
'transmission': 'automatic',
'trim': 'VVT-I ZINC MMT',
'vin': 'VNKJL96350A155971',
'year': 2007}
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF07%2520MDE%27 HTTP/1.1" 200 None
2026-03-28 22:04:10 [bca.uk] INFO: Saving data for GF07%20MDE: {'created_time': 1774735450.883106, 'last_price_update_time': 1774735450.883116, 'auction_closing_time': 1774778400.0}
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GF07%2520MDE') HTTP/1.1" 204 0
2026-03-28 22:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144716/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KF19DKY/42811022?sv=2020-08-04&st=2026-03-28T22%3A04%3A00Z&se=2026-03-28T22%3A29%3A00Z&sr=b&sp=r&sig=GplG9%2B9pTiJzji8cnGr7dMEKJveU9wcdMyJ7SINpu5U%3D)
2026-03-28 22:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251632/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW67HUY/42806780?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=IjccUHM%2BUsRolC4agemnjyYj%2By8q%2BaL%2Bv6NarfY2Bpc%3D)
2026-03-28 22:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994433/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV65GFU/42810585?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=Uw05gug7lwLgV7s2MX8pmDxdS7jFiOh93SlRxrnK0ts%3D)
2026-03-28 22:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189226/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU67EBV/42807577?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=Dc9GP37lnEoc8Ucnf7mZMpnnsmm75eM47cbqeVO4%2BUo%3D)
2026-03-28 22:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145943/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OU64UPA/42811127?sv=2020-08-04&st=2026-03-28T22%3A03%3A31Z&se=2026-03-28T22%3A28%3A31Z&sr=b&sp=r&sig=8BqSQERI1JQCVBe1x8fbzIsYG%2BShES3mtYstvdJ8vEg%3D)
2026-03-28 22:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010936/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010936>
2026-03-28 22:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5545a1590>
2026-03-28 22:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f3b828e-d75c-5ff7-a14e-22edf0b6b900/1f3b828e-d75c-5ff7-a14e-22edf0b6b900_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHL19RNJ%252F699144425%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144425/600 saved to cache
2026-03-28 22:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1f3b828e-d75c-5ff7-a14e-22edf0b6b900
2026-03-28 22:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU57WZP/42810866?sv=2020-08-04&st=2026-03-28T22%3A04%3A10Z&se=2026-03-28T22%3A29%3A10Z&sr=b&sp=r&sig=BdqUVMV5HLpv0FUkAEzx0eUko7TKBiE8aXeZbvRAXoI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KU57%20WZP-GB>
2026-03-28 22:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474797d0>
2026-03-28 22:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3649b9f8-64ee-584f-9d2b-f46b1db86e38/3649b9f8-64ee-584f-9d2b-f46b1db86e38_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKW67HUY%252F699251640%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251640/600 saved to cache
2026-03-28 22:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3649b9f8-64ee-584f-9d2b-f46b1db86e38
2026-03-28 22:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547606a10>
2026-03-28 22:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4f2d0a0-2885-57c7-ae21-ea61c25273d9/d4f2d0a0-2885-57c7-ae21-ea61c25273d9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOU64UPA%252F699145949%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145949/600 saved to cache
2026-03-28 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d4f2d0a0-2885-57c7-ae21-ea61c25273d9
2026-03-28 22:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554803f10>
2026-03-28 22:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f3b828e-d75c-5ff7-a14e-22edf0b6b900/1f3b828e-d75c-5ff7-a14e-22edf0b6b900_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHL19RNJ%252F699144416%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144416/600 saved to cache
2026-03-28 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f3b828e-d75c-5ff7-a14e-22edf0b6b900
2026-03-28 22:04:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f3b828e-d75c-5ff7-a14e-22edf0b6b900, skipping ID generation
2026-03-28 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f3b828e-d75c-5ff7-a14e-22edf0b6b900 sending to next pipeline
2026-03-28 22:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1f3b828e-d75c-5ff7-a14e-22edf0b6b900, identifier: HL19%20RNJ
2026-03-28 22:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX62RKE/42811098?sv=2020-08-04&st=2026-03-28T22%3A04%3A09Z&se=2026-03-28T22%3A29%3A09Z&sr=b&sp=r&sig=iHDTu6D4cBZ2Aj4oXB7FMKSgAqDL59mNlKIaTFVmQOE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1f3b828e-d75c-5ff7-a14e-22edf0b6b900 with identifier: HL19%20RNJ
2026-03-28 22:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1f3b828e-d75c-5ff7-a14e-22edf0b6b900 with identifier: HL19%20RNJ
2026-03-28 22:04:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1f3b828e-d75c-5ff7-a14e-22edf0b6b900 with identifier: HL19%20RNJ to the API
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144416/600>
{'auction_title': '',
'c_o_2_emission_value': 142,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f3b828e-d75c-5ff7-a14e-22edf0b6b900/1f3b828e-d75c-5ff7-a14e-22edf0b6b900_expert_report_file_1791ebac-3f42-4a05-a9e1-ce0921094c5c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HL19%20RNJ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1f3b828e-d75c-5ff7-a14e-22edf0b6b900',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HL19 RNJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HL19%20RNJ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'BMW',
'model': '320I',
'odometer': 34039,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f3b828e-d75c-5ff7-a14e-22edf0b6b900/1f3b828e-d75c-5ff7-a14e-22edf0b6b900_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50283,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144396/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f3b828e-d75c-5ff7-a14e-22edf0b6b900/1f3b828e-d75c-5ff7-a14e-22edf0b6b900_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47650,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144403/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f3b828e-d75c-5ff7-a14e-22edf0b6b900/1f3b828e-d75c-5ff7-a14e-22edf0b6b900_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46623,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144410/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f3b828e-d75c-5ff7-a14e-22edf0b6b900/1f3b828e-d75c-5ff7-a14e-22edf0b6b900_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50390,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144416/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f3b828e-d75c-5ff7-a14e-22edf0b6b900/1f3b828e-d75c-5ff7-a14e-22edf0b6b900_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46076,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144420/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f3b828e-d75c-5ff7-a14e-22edf0b6b900/1f3b828e-d75c-5ff7-a14e-22edf0b6b900_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42074,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144425/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f3b828e-d75c-5ff7-a14e-22edf0b6b900/1f3b828e-d75c-5ff7-a14e-22edf0b6b900_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89164,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144438/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f3b828e-d75c-5ff7-a14e-22edf0b6b900/1f3b828e-d75c-5ff7-a14e-22edf0b6b900_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71231,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144452/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f3b828e-d75c-5ff7-a14e-22edf0b6b900/1f3b828e-d75c-5ff7-a14e-22edf0b6b900_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97249,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144464/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f3b828e-d75c-5ff7-a14e-22edf0b6b900/1f3b828e-d75c-5ff7-a14e-22edf0b6b900_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77020,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HL19RNJ/699144473/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'BMW 320I 2.0 T SPORT TOURING STEP Estate',
'transmission': 'automatic',
'trim': 'T SPORT TOURING STEP',
'vin': 'WBA8G32040FH13753',
'year': 2019}
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HL19%2520RNJ%27 HTTP/1.1" 200 None
2026-03-28 22:04:11 [bca.uk] INFO: Saving data for HL19%20RNJ: {'created_time': 1774735451.543431, 'last_price_update_time': 1774735451.543444, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HL19%2520RNJ') HTTP/1.1" 204 0
2026-03-28 22:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189221/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU67EBV/42807577?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=Dc9GP37lnEoc8Ucnf7mZMpnnsmm75eM47cbqeVO4%2BUo%3D)
2026-03-28 22:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994413/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV65GFU/42810585?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=Uw05gug7lwLgV7s2MX8pmDxdS7jFiOh93SlRxrnK0ts%3D)
2026-03-28 22:04:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010885/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010885>
2026-03-28 22:04:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/686249382/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=686249382>
2026-03-28 22:04:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814049/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=684814049>
2026-03-28 22:04:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK61ZMO/42810880?sv=2020-08-04&st=2026-03-28T22%3A04%3A11Z&se=2026-03-28T22%3A29%3A11Z&sr=b&sp=r&sig=tXKsc6KFy1G7PRlGhYPyReIi6itWUlZeKDNxouAd0K4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DK61%20ZMO-GB>
2026-03-28 22:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145934/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OU64UPA/42811127?sv=2020-08-04&st=2026-03-28T22%3A03%3A31Z&se=2026-03-28T22%3A28%3A31Z&sr=b&sp=r&sig=8BqSQERI1JQCVBe1x8fbzIsYG%2BShES3mtYstvdJ8vEg%3D)
2026-03-28 22:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556f84ad0>
2026-03-28 22:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f29b60-3863-5769-bd32-0a73da36e20b/f3f29b60-3863-5769-bd32-0a73da36e20b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKF19DKY%252F699144716%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144716/600 saved to cache
2026-03-28 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f3f29b60-3863-5769-bd32-0a73da36e20b
2026-03-28 22:04:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3f29b60-3863-5769-bd32-0a73da36e20b, skipping ID generation
2026-03-28 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f3f29b60-3863-5769-bd32-0a73da36e20b sending to next pipeline
2026-03-28 22:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f3f29b60-3863-5769-bd32-0a73da36e20b, identifier: KF19%20DKY
2026-03-28 22:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474781d0>
2026-03-28 22:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3649b9f8-64ee-584f-9d2b-f46b1db86e38/3649b9f8-64ee-584f-9d2b-f46b1db86e38_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKW67HUY%252F699251632%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251632/600 saved to cache
2026-03-28 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3649b9f8-64ee-584f-9d2b-f46b1db86e38
2026-03-28 22:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554346a50>
2026-03-28 22:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63a9213b-9753-5663-b464-16226cca8eb4/63a9213b-9753-5663-b464-16226cca8eb4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV65GFU%252F698994433%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994433/600 saved to cache
2026-03-28 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 63a9213b-9753-5663-b464-16226cca8eb4
2026-03-28 22:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554805990>
2026-03-28 22:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d00f4d6-3827-55c1-a06a-583364af76a6/2d00f4d6-3827-55c1-a06a-583364af76a6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU67EBV%252F699189226%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189226/600 saved to cache
2026-03-28 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2d00f4d6-3827-55c1-a06a-583364af76a6
2026-03-28 22:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554940110>
2026-03-28 22:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4f2d0a0-2885-57c7-ae21-ea61c25273d9/d4f2d0a0-2885-57c7-ae21-ea61c25273d9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOU64UPA%252F699145943%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145943/600 saved to cache
2026-03-28 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d4f2d0a0-2885-57c7-ae21-ea61c25273d9
2026-03-28 22:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f3f29b60-3863-5769-bd32-0a73da36e20b with identifier: KF19%20DKY
2026-03-28 22:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f3f29b60-3863-5769-bd32-0a73da36e20b with identifier: KF19%20DKY
2026-03-28 22:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f3f29b60-3863-5769-bd32-0a73da36e20b with identifier: KF19%20DKY to the API
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144716/600>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f29b60-3863-5769-bd32-0a73da36e20b/f3f29b60-3863-5769-bd32-0a73da36e20b_expert_report_file_bcac3cb6-78fd-411e-aea4-d7daf5c9915d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KF19%20DKY-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f3f29b60-3863-5769-bd32-0a73da36e20b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KF19 DKY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KF19%20DKY&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 23622,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f29b60-3863-5769-bd32-0a73da36e20b/f3f29b60-3863-5769-bd32-0a73da36e20b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50707,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144711/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f29b60-3863-5769-bd32-0a73da36e20b/f3f29b60-3863-5769-bd32-0a73da36e20b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47411,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144716/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f29b60-3863-5769-bd32-0a73da36e20b/f3f29b60-3863-5769-bd32-0a73da36e20b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44644,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144722/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f29b60-3863-5769-bd32-0a73da36e20b/f3f29b60-3863-5769-bd32-0a73da36e20b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46007,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144726/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f29b60-3863-5769-bd32-0a73da36e20b/f3f29b60-3863-5769-bd32-0a73da36e20b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45565,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144731/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f29b60-3863-5769-bd32-0a73da36e20b/f3f29b60-3863-5769-bd32-0a73da36e20b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43426,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144737/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f29b60-3863-5769-bd32-0a73da36e20b/f3f29b60-3863-5769-bd32-0a73da36e20b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101499,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144747/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f29b60-3863-5769-bd32-0a73da36e20b/f3f29b60-3863-5769-bd32-0a73da36e20b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85707,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144760/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f29b60-3863-5769-bd32-0a73da36e20b/f3f29b60-3863-5769-bd32-0a73da36e20b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100432,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144770/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f29b60-3863-5769-bd32-0a73da36e20b/f3f29b60-3863-5769-bd32-0a73da36e20b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63602,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KF19DKY/699144780/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.0 TSI 95 BEATS DSG Hatchback',
'transmission': 'automatic',
'trim': 'TSI 95 BEATS DSG',
'vin': 'WVWZZZAWZKU027701',
'year': 2019}
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF19%2520DKY%27 HTTP/1.1" 200 None
2026-03-28 22:04:12 [bca.uk] INFO: Saving data for KF19%20DKY: {'created_time': 1774735452.296847, 'last_price_update_time': 1774735452.296858, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KF19%2520DKY') HTTP/1.1" 204 0
2026-03-28 22:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251625/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW67HUY/42806780?sv=2020-08-04&st=2026-03-28T22%3A03%3A32Z&se=2026-03-28T22%3A28%3A32Z&sr=b&sp=r&sig=IjccUHM%2BUsRolC4agemnjyYj%2By8q%2BaL%2Bv6NarfY2Bpc%3D)
2026-03-28 22:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547495a90>
2026-03-28 22:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ad57269-af6f-5f89-b6bd-0f6f92938d2b/2ad57269-af6f-5f89-b6bd-0f6f92938d2b_expert_report_file_a6b7805d-3298-44bc-bddd-3fff52457f98.pdf HTTP/1.1" 201 0
2026-03-28 22:04:12 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2ad57269-af6f-5f89-b6bd-0f6f92938d2b
2026-03-28 22:04:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ad57269-af6f-5f89-b6bd-0f6f92938d2b, skipping ID generation
2026-03-28 22:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2ad57269-af6f-5f89-b6bd-0f6f92938d2b
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLX62RKE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LX62RKE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039806/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689039806>
2026-03-28 22:04:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814022/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=684814022>
2026-03-28 22:04:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039795/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689039795>
2026-03-28 22:04:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110927/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110927>
2026-03-28 22:04:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010738/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KN68YYB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010936/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN68YYB/42810746?sv=2020-08-04&st=2026-03-28T22%3A03%3A29Z&se=2026-03-28T22%3A28%3A29Z&sr=b&sp=r&sig=wILsmg9cR%2BC5ELYsaDqFarEwRxBfh8Z9P1%2FXmbnSdGw%3D)
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699047011%27 HTTP/1.1" 200 None
2026-03-28 22:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047011 not downloaded yet
2026-03-28 22:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547496250>
2026-03-28 22:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d00f4d6-3827-55c1-a06a-583364af76a6/2d00f4d6-3827-55c1-a06a-583364af76a6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU67EBV%252F699189221%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189221/600 saved to cache
2026-03-28 22:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d00f4d6-3827-55c1-a06a-583364af76a6
2026-03-28 22:04:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d00f4d6-3827-55c1-a06a-583364af76a6, skipping ID generation
2026-03-28 22:04:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d00f4d6-3827-55c1-a06a-583364af76a6 sending to next pipeline
2026-03-28 22:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2d00f4d6-3827-55c1-a06a-583364af76a6, identifier: NU67%20EBV
2026-03-28 22:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554381210>
2026-03-28 22:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63a9213b-9753-5663-b464-16226cca8eb4/63a9213b-9753-5663-b464-16226cca8eb4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV65GFU%252F698994413%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994413/600 saved to cache
2026-03-28 22:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63a9213b-9753-5663-b464-16226cca8eb4
2026-03-28 22:04:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63a9213b-9753-5663-b464-16226cca8eb4, skipping ID generation
2026-03-28 22:04:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63a9213b-9753-5663-b464-16226cca8eb4 sending to next pipeline
2026-03-28 22:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 63a9213b-9753-5663-b464-16226cca8eb4, identifier: OV65%20GFU
2026-03-28 22:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554381790>
2026-03-28 22:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4f2d0a0-2885-57c7-ae21-ea61c25273d9/d4f2d0a0-2885-57c7-ae21-ea61c25273d9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOU64UPA%252F699145934%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145934/600 saved to cache
2026-03-28 22:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4f2d0a0-2885-57c7-ae21-ea61c25273d9
2026-03-28 22:04:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4f2d0a0-2885-57c7-ae21-ea61c25273d9, skipping ID generation
2026-03-28 22:04:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4f2d0a0-2885-57c7-ae21-ea61c25273d9 sending to next pipeline
2026-03-28 22:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d4f2d0a0-2885-57c7-ae21-ea61c25273d9, identifier: OU64%20UPA
2026-03-28 22:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2d00f4d6-3827-55c1-a06a-583364af76a6 with identifier: NU67%20EBV
2026-03-28 22:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2d00f4d6-3827-55c1-a06a-583364af76a6 with identifier: NU67%20EBV
2026-03-28 22:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2d00f4d6-3827-55c1-a06a-583364af76a6 with identifier: NU67%20EBV to the API
2026-03-28 22:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189221/600>
{'auction_title': '',
'c_o_2_emission_value': 97,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d00f4d6-3827-55c1-a06a-583364af76a6/2d00f4d6-3827-55c1-a06a-583364af76a6_expert_report_file_252fc9db-361e-4725-a692-a9dcb1641540.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NU67%20EBV-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2d00f4d6-3827-55c1-a06a-583364af76a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NU67 EBV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NU67%20EBV&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 52630,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d00f4d6-3827-55c1-a06a-583364af76a6/2d00f4d6-3827-55c1-a06a-583364af76a6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41531,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189221/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d00f4d6-3827-55c1-a06a-583364af76a6/2d00f4d6-3827-55c1-a06a-583364af76a6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40852,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189226/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d00f4d6-3827-55c1-a06a-583364af76a6/2d00f4d6-3827-55c1-a06a-583364af76a6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37855,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189232/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d00f4d6-3827-55c1-a06a-583364af76a6/2d00f4d6-3827-55c1-a06a-583364af76a6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38986,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189239/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d00f4d6-3827-55c1-a06a-583364af76a6/2d00f4d6-3827-55c1-a06a-583364af76a6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37531,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189247/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d00f4d6-3827-55c1-a06a-583364af76a6/2d00f4d6-3827-55c1-a06a-583364af76a6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36974,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189252/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d00f4d6-3827-55c1-a06a-583364af76a6/2d00f4d6-3827-55c1-a06a-583364af76a6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105386,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189266/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d00f4d6-3827-55c1-a06a-583364af76a6/2d00f4d6-3827-55c1-a06a-583364af76a6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78154,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189278/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d00f4d6-3827-55c1-a06a-583364af76a6/2d00f4d6-3827-55c1-a06a-583364af76a6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89321,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189292/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d00f4d6-3827-55c1-a06a-583364af76a6/2d00f4d6-3827-55c1-a06a-583364af76a6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71930,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU67EBV/699189301/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 100 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'E/B 100 ZETEC',
'vin': 'WF0JXXGAHJHC41375',
'year': 2017}
2026-03-28 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU67%2520EBV%27 HTTP/1.1" 200 None
2026-03-28 22:04:13 [bca.uk] INFO: Saving data for NU67%20EBV: {'created_time': 1774735453.216466, 'last_price_update_time': 1774735453.216476, 'auction_closing_time': 1774778400.0}
2026-03-28 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NU67%2520EBV') HTTP/1.1" 204 0
2026-03-28 22:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 63a9213b-9753-5663-b464-16226cca8eb4 with identifier: OV65%20GFU
2026-03-28 22:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 63a9213b-9753-5663-b464-16226cca8eb4 with identifier: OV65%20GFU
2026-03-28 22:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 63a9213b-9753-5663-b464-16226cca8eb4 with identifier: OV65%20GFU to the API
2026-03-28 22:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994413/600>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63a9213b-9753-5663-b464-16226cca8eb4/63a9213b-9753-5663-b464-16226cca8eb4_expert_report_file_0ac80d8a-b022-425c-a22a-925aad22c91f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV65%20GFU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '63a9213b-9753-5663-b464-16226cca8eb4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OV65 GFU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OV65%20GFU&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SKODA',
'model': 'FABIA',
'odometer': 22308,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63a9213b-9753-5663-b464-16226cca8eb4/63a9213b-9753-5663-b464-16226cca8eb4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38851,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994413/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63a9213b-9753-5663-b464-16226cca8eb4/63a9213b-9753-5663-b464-16226cca8eb4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38007,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994433/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63a9213b-9753-5663-b464-16226cca8eb4/63a9213b-9753-5663-b464-16226cca8eb4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37287,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994457/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63a9213b-9753-5663-b464-16226cca8eb4/63a9213b-9753-5663-b464-16226cca8eb4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38336,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994471/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63a9213b-9753-5663-b464-16226cca8eb4/63a9213b-9753-5663-b464-16226cca8eb4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37400,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994491/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63a9213b-9753-5663-b464-16226cca8eb4/63a9213b-9753-5663-b464-16226cca8eb4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35966,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994507/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63a9213b-9753-5663-b464-16226cca8eb4/63a9213b-9753-5663-b464-16226cca8eb4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86786,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994528/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63a9213b-9753-5663-b464-16226cca8eb4/63a9213b-9753-5663-b464-16226cca8eb4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69379,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994549/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63a9213b-9753-5663-b464-16226cca8eb4/63a9213b-9753-5663-b464-16226cca8eb4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77167,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994573/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63a9213b-9753-5663-b464-16226cca8eb4/63a9213b-9753-5663-b464-16226cca8eb4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84672,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV65GFU/698994592/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'SKODA FABIA 1.4 TDI 90 SE L DSG Estate',
'transmission': 'automatic',
'trim': 'TDI 90 SE L DSG',
'vin': 'TMBKJ6NJXGZ041719',
'year': 2015}
2026-03-28 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV65%2520GFU%27 HTTP/1.1" 200 None
2026-03-28 22:04:13 [bca.uk] INFO: Saving data for OV65%20GFU: {'created_time': 1774735453.625878, 'last_price_update_time': 1774735453.625888, 'auction_closing_time': 1774778400.0}
2026-03-28 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OV65%2520GFU') HTTP/1.1" 204 0
2026-03-28 22:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d4f2d0a0-2885-57c7-ae21-ea61c25273d9 with identifier: OU64%20UPA
2026-03-28 22:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d4f2d0a0-2885-57c7-ae21-ea61c25273d9 with identifier: OU64%20UPA
2026-03-28 22:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d4f2d0a0-2885-57c7-ae21-ea61c25273d9 with identifier: OU64%20UPA to the API
2026-03-28 22:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145934/600>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f2d0a0-2885-57c7-ae21-ea61c25273d9/d4f2d0a0-2885-57c7-ae21-ea61c25273d9_expert_report_file_dbc32de7-0b57-4cc5-80cf-5a33b1add5af.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OU64%20UPA-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd4f2d0a0-2885-57c7-ae21-ea61c25273d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OU64 UPA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OU64%20UPA&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 76184,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f2d0a0-2885-57c7-ae21-ea61c25273d9/d4f2d0a0-2885-57c7-ae21-ea61c25273d9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50451,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145934/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f2d0a0-2885-57c7-ae21-ea61c25273d9/d4f2d0a0-2885-57c7-ae21-ea61c25273d9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47626,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145943/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f2d0a0-2885-57c7-ae21-ea61c25273d9/d4f2d0a0-2885-57c7-ae21-ea61c25273d9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46652,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145949/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f2d0a0-2885-57c7-ae21-ea61c25273d9/d4f2d0a0-2885-57c7-ae21-ea61c25273d9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46972,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145954/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f2d0a0-2885-57c7-ae21-ea61c25273d9/d4f2d0a0-2885-57c7-ae21-ea61c25273d9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48421,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145965/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f2d0a0-2885-57c7-ae21-ea61c25273d9/d4f2d0a0-2885-57c7-ae21-ea61c25273d9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46082,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145971/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f2d0a0-2885-57c7-ae21-ea61c25273d9/d4f2d0a0-2885-57c7-ae21-ea61c25273d9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94643,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699145984/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f2d0a0-2885-57c7-ae21-ea61c25273d9/d4f2d0a0-2885-57c7-ae21-ea61c25273d9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69449,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699146002/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f2d0a0-2885-57c7-ae21-ea61c25273d9/d4f2d0a0-2885-57c7-ae21-ea61c25273d9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88397,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699146018/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f2d0a0-2885-57c7-ae21-ea61c25273d9/d4f2d0a0-2885-57c7-ae21-ea61c25273d9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79533,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU64UPA/699146028/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.2 DIG-S ACENTA PREMIUM Hatchback',
'transmission': 'manual',
'trim': 'DIG-S ACENTA PREMIUM',
'vin': 'SJNTBAE12U1081143',
'year': 2014}
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU64%2520UPA%27 HTTP/1.1" 200 None
2026-03-28 22:04:14 [bca.uk] INFO: Saving data for OU64%20UPA: {'created_time': 1774735454.023916, 'last_price_update_time': 1774735454.023926, 'auction_closing_time': 1774778400.0}
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OU64%2520UPA') HTTP/1.1" 204 0
2026-03-28 22:04:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038208/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038208>
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699047018%27 HTTP/1.1" 200 None
2026-03-28 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047018 not downloaded yet
2026-03-28 22:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU57WZP/42810866?sv=2020-08-04&st=2026-03-28T22%3A04%3A10Z&se=2026-03-28T22%3A29%3A10Z&sr=b&sp=r&sig=BdqUVMV5HLpv0FUkAEzx0eUko7TKBiE8aXeZbvRAXoI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252161/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252161>
2026-03-28 22:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010885/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN68YYB/42810746?sv=2020-08-04&st=2026-03-28T22%3A03%3A29Z&se=2026-03-28T22%3A28%3A29Z&sr=b&sp=r&sig=wILsmg9cR%2BC5ELYsaDqFarEwRxBfh8Z9P1%2FXmbnSdGw%3D)
2026-03-28 22:04:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG65SWK/42811090?sv=2020-08-04&st=2026-03-28T22%3A04%3A12Z&se=2026-03-28T22%3A29%3A12Z&sr=b&sp=r&sig=f530hohT%2B5Br5INwJyv5C3pquuhacxkKnY0Wkt6n%2FRo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DG65%20SWK-GB>
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548f79d0>
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3649b9f8-64ee-584f-9d2b-f46b1db86e38/3649b9f8-64ee-584f-9d2b-f46b1db86e38_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKW67HUY%252F699251625%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251625/600 saved to cache
2026-03-28 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3649b9f8-64ee-584f-9d2b-f46b1db86e38
2026-03-28 22:04:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3649b9f8-64ee-584f-9d2b-f46b1db86e38, skipping ID generation
2026-03-28 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3649b9f8-64ee-584f-9d2b-f46b1db86e38 sending to next pipeline
2026-03-28 22:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3649b9f8-64ee-584f-9d2b-f46b1db86e38, identifier: KW67%20HUY
2026-03-28 22:04:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b28c90>
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37980901-da86-559d-83e6-c8f73f7f2265/37980901-da86-559d-83e6-c8f73f7f2265_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN68YYB%252F699010936%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010936/600 saved to cache
2026-03-28 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 37980901-da86-559d-83e6-c8f73f7f2265
2026-03-28 22:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814049/600> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/686249382/600> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699047023%27 HTTP/1.1" 200 None
2026-03-28 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047023 not downloaded yet
2026-03-28 22:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3649b9f8-64ee-584f-9d2b-f46b1db86e38 with identifier: KW67%20HUY
2026-03-28 22:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3649b9f8-64ee-584f-9d2b-f46b1db86e38 with identifier: KW67%20HUY
2026-03-28 22:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3649b9f8-64ee-584f-9d2b-f46b1db86e38 with identifier: KW67%20HUY to the API
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251625/600>
{'auction_title': '',
'c_o_2_emission_value': 197,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3649b9f8-64ee-584f-9d2b-f46b1db86e38/3649b9f8-64ee-584f-9d2b-f46b1db86e38_expert_report_file_53ed197e-1052-476f-a879-094672ab0979.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KW67%20HUY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 2,
'engine': '4.7L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3649b9f8-64ee-584f-9d2b-f46b1db86e38',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KW67 HUY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KW67%20HUY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MERCEDES-BENZ',
'model': 'S500',
'odometer': 37239,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3649b9f8-64ee-584f-9d2b-f46b1db86e38/3649b9f8-64ee-584f-9d2b-f46b1db86e38_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41573,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251625/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3649b9f8-64ee-584f-9d2b-f46b1db86e38/3649b9f8-64ee-584f-9d2b-f46b1db86e38_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40685,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251632/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3649b9f8-64ee-584f-9d2b-f46b1db86e38/3649b9f8-64ee-584f-9d2b-f46b1db86e38_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38251,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251640/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3649b9f8-64ee-584f-9d2b-f46b1db86e38/3649b9f8-64ee-584f-9d2b-f46b1db86e38_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38578,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251644/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3649b9f8-64ee-584f-9d2b-f46b1db86e38/3649b9f8-64ee-584f-9d2b-f46b1db86e38_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35137,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251648/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3649b9f8-64ee-584f-9d2b-f46b1db86e38/3649b9f8-64ee-584f-9d2b-f46b1db86e38_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34161,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251656/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3649b9f8-64ee-584f-9d2b-f46b1db86e38/3649b9f8-64ee-584f-9d2b-f46b1db86e38_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84437,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251669/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3649b9f8-64ee-584f-9d2b-f46b1db86e38/3649b9f8-64ee-584f-9d2b-f46b1db86e38_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84715,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251684/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3649b9f8-64ee-584f-9d2b-f46b1db86e38/3649b9f8-64ee-584f-9d2b-f46b1db86e38_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91967,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251699/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3649b9f8-64ee-584f-9d2b-f46b1db86e38/3649b9f8-64ee-584f-9d2b-f46b1db86e38_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89819,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW67HUY/699251710/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ S500 4.7 AMG LINE PREMIUM Coupe',
'transmission': 'manual',
'trim': 'AMG LINE PREMIUM',
'vin': 'WDD2173822A032242',
'year': 2017}
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW67%2520HUY%27 HTTP/1.1" 200 None
2026-03-28 22:04:14 [bca.uk] INFO: Saving data for KW67%20HUY: {'created_time': 1774735454.615182, 'last_price_update_time': 1774735454.615194, 'auction_closing_time': 1774778400.0}
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KW67%2520HUY') HTTP/1.1" 204 0
2026-03-28 22:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK61ZMO/42810880?sv=2020-08-04&st=2026-03-28T22%3A04%3A11Z&se=2026-03-28T22%3A29%3A11Z&sr=b&sp=r&sig=tXKsc6KFy1G7PRlGhYPyReIi6itWUlZeKDNxouAd0K4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039795/600> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110906/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110906>
2026-03-28 22:04:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039793/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689039793>
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699047030%27 HTTP/1.1" 200 None
2026-03-28 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047030 not downloaded yet
2026-03-28 22:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110927/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/B10PGJ/42811203?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=EuD%2Bp1HvVP2JXHqKU%2B8jitx6XlktdJcPsUn2sF2sJ6k%3D)
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699047041%27 HTTP/1.1" 200 None
2026-03-28 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047041 not downloaded yet
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54772a710>
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb13ef4-19c8-586c-a4d2-93af637cef56/bbb13ef4-19c8-586c-a4d2-93af637cef56_expert_report_file_74650cfc-80a2-4a24-99d1-931a63f08d2d.pdf HTTP/1.1" 201 0
2026-03-28 22:04:14 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item bbb13ef4-19c8-586c-a4d2-93af637cef56
2026-03-28 22:04:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbb13ef4-19c8-586c-a4d2-93af637cef56, skipping ID generation
2026-03-28 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bbb13ef4-19c8-586c-a4d2-93af637cef56
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKU57WZP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KU57WZP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547602bd0>
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37980901-da86-559d-83e6-c8f73f7f2265/37980901-da86-559d-83e6-c8f73f7f2265_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN68YYB%252F699010885%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010885/600 saved to cache
2026-03-28 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 37980901-da86-559d-83e6-c8f73f7f2265
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542ade90>
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c98b2cc3-a1ec-5194-ae49-df6d05e42077/c98b2cc3-a1ec-5194-ae49-df6d05e42077_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST64MMV%252F684814049%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814049/600 saved to cache
2026-03-28 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c98b2cc3-a1ec-5194-ae49-df6d05e42077
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54713c590>
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c98b2cc3-a1ec-5194-ae49-df6d05e42077/c98b2cc3-a1ec-5194-ae49-df6d05e42077_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST64MMV%252F686249382%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/686249382/600 saved to cache
2026-03-28 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c98b2cc3-a1ec-5194-ae49-df6d05e42077
2026-03-28 22:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039806/600> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047007/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LX62RKE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038208/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK23XXL/42810961?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=HIraPhBD5waa9seHUB8yTzip4V%2BkelIT5vdZTBzO1L4%3D)
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699047061%27 HTTP/1.1" 200 None
2026-03-28 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047061 not downloaded yet
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994585%27 HTTP/1.1" 200 None
2026-03-28 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994585 not downloaded yet
2026-03-28 22:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252161/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF19KHM/42806820?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=sr8AUvzfzyG0aLirfPlv3wY7sqotPL2UPVrzrL33HII%3D)
2026-03-28 22:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814022/600> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699047076%27 HTTP/1.1" 200 None
2026-03-28 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047076 not downloaded yet
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994597%27 HTTP/1.1" 200 None
2026-03-28 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994597 not downloaded yet
2026-03-28 22:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG65SWK/42811090?sv=2020-08-04&st=2026-03-28T22%3A04%3A12Z&se=2026-03-28T22%3A29%3A12Z&sr=b&sp=r&sig=f530hohT%2B5Br5INwJyv5C3pquuhacxkKnY0Wkt6n%2FRo%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554354410>
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a22924-d609-517c-89c8-3ff469c2635b/68a22924-d609-517c-89c8-3ff469c2635b_expert_report_file_7a939f05-fd65-40e7-9b6c-3f4be767a2bf.pdf HTTP/1.1" 201 0
2026-03-28 22:04:14 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 68a22924-d609-517c-89c8-3ff469c2635b
2026-03-28 22:04:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68a22924-d609-517c-89c8-3ff469c2635b, skipping ID generation
2026-03-28 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 68a22924-d609-517c-89c8-3ff469c2635b
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDK61ZMO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DK61ZMO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547612010>
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bb0eb2-42f3-5cb2-b21b-580137f2554b/74bb0eb2-42f3-5cb2-b21b-580137f2554b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP15VFV%252F689039795%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039795/600 saved to cache
2026-03-28 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 74bb0eb2-42f3-5cb2-b21b-580137f2554b
2026-03-28 22:04:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554830110>
2026-03-28 22:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414fda2b-7a8b-5d29-ad43-b0e99521f4d6/414fda2b-7a8b-5d29-ad43-b0e99521f4d6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FB10PGJ%252F699110927%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110927/600 saved to cache
2026-03-28 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 414fda2b-7a8b-5d29-ad43-b0e99521f4d6
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699047089%27 HTTP/1.1" 200 None
2026-03-28 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047089 not downloaded yet
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994605%27 HTTP/1.1" 200 None
2026-03-28 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994605 not downloaded yet
2026-03-28 22:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039793/600> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994340%27 HTTP/1.1" 200 None
2026-03-28 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994340 not downloaded yet
2026-03-28 22:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110906/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/B10PGJ/42811203?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=EuD%2Bp1HvVP2JXHqKU%2B8jitx6XlktdJcPsUn2sF2sJ6k%3D)
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699047102%27 HTTP/1.1" 200 None
2026-03-28 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047102 not downloaded yet
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994613%27 HTTP/1.1" 200 None
2026-03-28 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994613 not downloaded yet
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994353%27 HTTP/1.1" 200 None
2026-03-28 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994353 not downloaded yet
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994630%27 HTTP/1.1" 200 None
2026-03-28 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994630 not downloaded yet
2026-03-28 22:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b2b490>
2026-03-28 22:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bb0eb2-42f3-5cb2-b21b-580137f2554b/74bb0eb2-42f3-5cb2-b21b-580137f2554b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP15VFV%252F689039806%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039806/600 saved to cache
2026-03-28 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 74bb0eb2-42f3-5cb2-b21b-580137f2554b
2026-03-28 22:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477cff90>
2026-03-28 22:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f78646-9cef-5fc7-bd80-803ea7a167c9/47f78646-9cef-5fc7-bd80-803ea7a167c9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK23XXL%252F699038208%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038208/600 saved to cache
2026-03-28 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 47f78646-9cef-5fc7-bd80-803ea7a167c9
2026-03-28 22:04:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554916e90>
2026-03-28 22:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ba462d-c70d-5156-b443-d7d5e76250e2/a4ba462d-c70d-5156-b443-d7d5e76250e2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF19KHM%252F699252161%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252161/600 saved to cache
2026-03-28 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a4ba462d-c70d-5156-b443-d7d5e76250e2
2026-03-28 22:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b75b10>
2026-03-28 22:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c98b2cc3-a1ec-5194-ae49-df6d05e42077/c98b2cc3-a1ec-5194-ae49-df6d05e42077_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST64MMV%252F684814022%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814022/600 saved to cache
2026-03-28 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c98b2cc3-a1ec-5194-ae49-df6d05e42077
2026-03-28 22:04:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c98b2cc3-a1ec-5194-ae49-df6d05e42077, skipping ID generation
2026-03-28 22:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c98b2cc3-a1ec-5194-ae49-df6d05e42077 with scrape type 1
2026-03-28 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c98b2cc3-a1ec-5194-ae49-df6d05e42077 sending to next pipeline
2026-03-28 22:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c98b2cc3-a1ec-5194-ae49-df6d05e42077, identifier: ST64%20MMV
2026-03-28 22:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5545573d0>
2026-03-28 22:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d6d7c3-a2c7-5054-9780-fec8ad872fbe/30d6d7c3-a2c7-5054-9780-fec8ad872fbe_expert_report_file_7e1f2e0c-4c18-4929-b922-48daf2ad73cd.pdf HTTP/1.1" 201 0
2026-03-28 22:04:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 30d6d7c3-a2c7-5054-9780-fec8ad872fbe
2026-03-28 22:04:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30d6d7c3-a2c7-5054-9780-fec8ad872fbe, skipping ID generation
2026-03-28 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 30d6d7c3-a2c7-5054-9780-fec8ad872fbe
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDG65SWK-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DG65SWK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994367%27 HTTP/1.1" 200 None
2026-03-28 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994367 not downloaded yet
2026-03-28 22:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c98b2cc3-a1ec-5194-ae49-df6d05e42077 with identifier: ST64%20MMV
2026-03-28 22:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c98b2cc3-a1ec-5194-ae49-df6d05e42077 with identifier: ST64%20MMV
2026-03-28 22:04:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c98b2cc3-a1ec-5194-ae49-df6d05e42077 with identifier: ST64%20MMV to the API
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814022/600>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_source_url': None,
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c98b2cc3-a1ec-5194-ae49-df6d05e42077',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ST64 MMV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ST64%20MMV&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow',
'make': 'VOLKSWAGEN',
'model': 'GOLF SV',
'odometer': 103184,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c98b2cc3-a1ec-5194-ae49-df6d05e42077/c98b2cc3-a1ec-5194-ae49-df6d05e42077_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68624,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814014/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c98b2cc3-a1ec-5194-ae49-df6d05e42077/c98b2cc3-a1ec-5194-ae49-df6d05e42077_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69711,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814022/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c98b2cc3-a1ec-5194-ae49-df6d05e42077/c98b2cc3-a1ec-5194-ae49-df6d05e42077_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79847,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814026/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c98b2cc3-a1ec-5194-ae49-df6d05e42077/c98b2cc3-a1ec-5194-ae49-df6d05e42077_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73554,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814031/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c98b2cc3-a1ec-5194-ae49-df6d05e42077/c98b2cc3-a1ec-5194-ae49-df6d05e42077_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73115,
'Height': 417,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/686249341/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c98b2cc3-a1ec-5194-ae49-df6d05e42077/c98b2cc3-a1ec-5194-ae49-df6d05e42077_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64955,
'Height': 417,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/686249352/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c98b2cc3-a1ec-5194-ae49-df6d05e42077/c98b2cc3-a1ec-5194-ae49-df6d05e42077_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61053,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814041/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c98b2cc3-a1ec-5194-ae49-df6d05e42077/c98b2cc3-a1ec-5194-ae49-df6d05e42077_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75727,
'Height': 417,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/686249382/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c98b2cc3-a1ec-5194-ae49-df6d05e42077/c98b2cc3-a1ec-5194-ae49-df6d05e42077_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64192,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814047/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c98b2cc3-a1ec-5194-ae49-df6d05e42077/c98b2cc3-a1ec-5194-ae49-df6d05e42077_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66095,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST64MMV/684814049/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF SV 1.4 TSI 125 SE MPV',
'transmission': 'manual',
'trim': 'TSI 125 SE',
'vin': 'WVWZZZAUZFW557996',
'year': 2014}
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST64%2520MMV%27 HTTP/1.1" 200 None
2026-03-28 22:04:16 [bca.uk] INFO: Saving data for ST64%20MMV: {'created_time': 1774735456.103646, 'last_price_update_time': 1774735456.103657, 'auction_closing_time': 1775210400.0}
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ST64%2520MMV') HTTP/1.1" 204 0
2026-03-28 22:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047011/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047011>
2026-03-28 22:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047018/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047018>
2026-03-28 22:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252150/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252150>
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994649%27 HTTP/1.1" 200 None
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994649 not downloaded yet
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142905%27 HTTP/1.1" 200 None
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142905 not downloaded yet
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994391%27 HTTP/1.1" 200 None
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994391 not downloaded yet
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994661%27 HTTP/1.1" 200 None
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994661 not downloaded yet
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142912%27 HTTP/1.1" 200 None
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142912 not downloaded yet
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994401%27 HTTP/1.1" 200 None
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994401 not downloaded yet
2026-03-28 22:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548dff10>
2026-03-28 22:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bb0eb2-42f3-5cb2-b21b-580137f2554b/74bb0eb2-42f3-5cb2-b21b-580137f2554b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP15VFV%252F689039793%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039793/600 saved to cache
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 74bb0eb2-42f3-5cb2-b21b-580137f2554b
2026-03-28 22:04:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547702f50>
2026-03-28 22:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414fda2b-7a8b-5d29-ad43-b0e99521f4d6/414fda2b-7a8b-5d29-ad43-b0e99521f4d6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FB10PGJ%252F699110906%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110906/600 saved to cache
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 414fda2b-7a8b-5d29-ad43-b0e99521f4d6
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994687%27 HTTP/1.1" 200 None
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994687 not downloaded yet
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142916%27 HTTP/1.1" 200 None
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142916 not downloaded yet
2026-03-28 22:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047007/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX62RKE/42811098?sv=2020-08-04&st=2026-03-28T22%3A04%3A09Z&se=2026-03-28T22%3A29%3A09Z&sr=b&sp=r&sig=iHDTu6D4cBZ2Aj4oXB7FMKSgAqDL59mNlKIaTFVmQOE%3D)
2026-03-28 22:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038193/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038193>
2026-03-28 22:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023499/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023499>
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994444%27 HTTP/1.1" 200 None
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994444 not downloaded yet
2026-03-28 22:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047023/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047023>
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994714%27 HTTP/1.1" 200 None
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994714 not downloaded yet
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142922%27 HTTP/1.1" 200 None
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142922 not downloaded yet
2026-03-28 22:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047030/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047030>
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994473%27 HTTP/1.1" 200 None
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994473 not downloaded yet
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142929%27 HTTP/1.1" 200 None
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142929 not downloaded yet
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994506%27 HTTP/1.1" 200 None
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994506 not downloaded yet
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142941%27 HTTP/1.1" 200 None
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142941 not downloaded yet
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994534%27 HTTP/1.1" 200 None
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994534 not downloaded yet
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142954%27 HTTP/1.1" 200 None
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142954 not downloaded yet
2026-03-28 22:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473de5d0>
2026-03-28 22:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ad57269-af6f-5f89-b6bd-0f6f92938d2b/2ad57269-af6f-5f89-b6bd-0f6f92938d2b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX62RKE%252F699047007%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047007/600 saved to cache
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ad57269-af6f-5f89-b6bd-0f6f92938d2b
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142966%27 HTTP/1.1" 200 None
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142966 not downloaded yet
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142978%27 HTTP/1.1" 200 None
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142978 not downloaded yet
2026-03-28 22:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047041/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047041>
2026-03-28 22:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994576/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KU57WZP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039789/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689039789>
2026-03-28 22:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994585/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994585>
2026-03-28 22:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994333/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DK61ZMO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994605/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994605>
2026-03-28 22:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110888/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110888>
2026-03-28 22:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010738/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN68YYB/42810746?sv=2020-08-04&st=2026-03-28T22%3A03%3A29Z&se=2026-03-28T22%3A28%3A29Z&sr=b&sp=r&sig=wILsmg9cR%2BC5ELYsaDqFarEwRxBfh8Z9P1%2FXmbnSdGw%3D)
2026-03-28 22:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047018/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX62RKE/42811098?sv=2020-08-04&st=2026-03-28T22%3A04%3A09Z&se=2026-03-28T22%3A29%3A09Z&sr=b&sp=r&sig=iHDTu6D4cBZ2Aj4oXB7FMKSgAqDL59mNlKIaTFVmQOE%3D)
2026-03-28 22:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047011/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX62RKE/42811098?sv=2020-08-04&st=2026-03-28T22%3A04%3A09Z&se=2026-03-28T22%3A29%3A09Z&sr=b&sp=r&sig=iHDTu6D4cBZ2Aj4oXB7FMKSgAqDL59mNlKIaTFVmQOE%3D)
2026-03-28 22:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047023/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX62RKE/42811098?sv=2020-08-04&st=2026-03-28T22%3A04%3A09Z&se=2026-03-28T22%3A29%3A09Z&sr=b&sp=r&sig=iHDTu6D4cBZ2Aj4oXB7FMKSgAqDL59mNlKIaTFVmQOE%3D)
2026-03-28 22:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252150/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF19KHM/42806820?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=sr8AUvzfzyG0aLirfPlv3wY7sqotPL2UPVrzrL33HII%3D)
2026-03-28 22:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142916/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142916>
2026-03-28 22:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047030/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX62RKE/42811098?sv=2020-08-04&st=2026-03-28T22%3A04%3A09Z&se=2026-03-28T22%3A29%3A09Z&sr=b&sp=r&sig=iHDTu6D4cBZ2Aj4oXB7FMKSgAqDL59mNlKIaTFVmQOE%3D)
2026-03-28 22:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038193/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK23XXL/42810961?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=HIraPhBD5waa9seHUB8yTzip4V%2BkelIT5vdZTBzO1L4%3D)
2026-03-28 22:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023499/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT69OUG/42810791?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=Rkj%2FxkM1%2BIIgVTIeJOHfQd43I%2FeKECKsCGXnmowEFQk%3D)
2026-03-28 22:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548bb010>
2026-03-28 22:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37980901-da86-559d-83e6-c8f73f7f2265/37980901-da86-559d-83e6-c8f73f7f2265_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN68YYB%252F699010738%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010738/600 saved to cache
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37980901-da86-559d-83e6-c8f73f7f2265
2026-03-28 22:04:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37980901-da86-559d-83e6-c8f73f7f2265, skipping ID generation
2026-03-28 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37980901-da86-559d-83e6-c8f73f7f2265 sending to next pipeline
2026-03-28 22:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 37980901-da86-559d-83e6-c8f73f7f2265, identifier: KN68%20YYB
2026-03-28 22:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 37980901-da86-559d-83e6-c8f73f7f2265 with identifier: KN68%20YYB
2026-03-28 22:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 37980901-da86-559d-83e6-c8f73f7f2265 with identifier: KN68%20YYB
2026-03-28 22:04:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 37980901-da86-559d-83e6-c8f73f7f2265 with identifier: KN68%20YYB to the API
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010738/600>
{'auction_title': '',
'c_o_2_emission_value': 106,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37980901-da86-559d-83e6-c8f73f7f2265/37980901-da86-559d-83e6-c8f73f7f2265_expert_report_file_0a039026-4fe4-4c71-b9a9-09845d0a700c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KN68%20YYB-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '37980901-da86-559d-83e6-c8f73f7f2265',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KN68 YYB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KN68%20YYB&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'KIA',
'model': 'PICANTO',
'odometer': 32964,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37980901-da86-559d-83e6-c8f73f7f2265/37980901-da86-559d-83e6-c8f73f7f2265_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44410,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010738/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37980901-da86-559d-83e6-c8f73f7f2265/37980901-da86-559d-83e6-c8f73f7f2265_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43044,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010763/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37980901-da86-559d-83e6-c8f73f7f2265/37980901-da86-559d-83e6-c8f73f7f2265_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40365,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010796/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37980901-da86-559d-83e6-c8f73f7f2265/37980901-da86-559d-83e6-c8f73f7f2265_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38117,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010816/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37980901-da86-559d-83e6-c8f73f7f2265/37980901-da86-559d-83e6-c8f73f7f2265_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37396,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010846/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37980901-da86-559d-83e6-c8f73f7f2265/37980901-da86-559d-83e6-c8f73f7f2265_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39144,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010858/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37980901-da86-559d-83e6-c8f73f7f2265/37980901-da86-559d-83e6-c8f73f7f2265_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62619,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010885/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37980901-da86-559d-83e6-c8f73f7f2265/37980901-da86-559d-83e6-c8f73f7f2265_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60121,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010906/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37980901-da86-559d-83e6-c8f73f7f2265/37980901-da86-559d-83e6-c8f73f7f2265_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81553,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010936/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37980901-da86-559d-83e6-c8f73f7f2265/37980901-da86-559d-83e6-c8f73f7f2265_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66569,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN68YYB/699010971/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'KIA PICANTO 1.2 GT-LINE S Hatchback',
'transmission': 'manual',
'trim': 'GT-LINE S',
'vin': 'KNAB3512LJT302467',
'year': 2018}
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN68%2520YYB%27 HTTP/1.1" 200 None
2026-03-28 22:04:17 [bca.uk] INFO: Saving data for KN68%20YYB: {'created_time': 1774735457.281008, 'last_price_update_time': 1774735457.28102, 'auction_closing_time': 1774951200.0}
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KN68%2520YYB') HTTP/1.1" 204 0
2026-03-28 22:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039789/600> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047041/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX62RKE/42811098?sv=2020-08-04&st=2026-03-28T22%3A04%3A09Z&se=2026-03-28T22%3A29%3A09Z&sr=b&sp=r&sig=iHDTu6D4cBZ2Aj4oXB7FMKSgAqDL59mNlKIaTFVmQOE%3D)
2026-03-28 22:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994333/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK61ZMO/42810880?sv=2020-08-04&st=2026-03-28T22%3A04%3A11Z&se=2026-03-28T22%3A29%3A11Z&sr=b&sp=r&sig=tXKsc6KFy1G7PRlGhYPyReIi6itWUlZeKDNxouAd0K4%3D)
2026-03-28 22:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994576/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU57WZP/42810866?sv=2020-08-04&st=2026-03-28T22%3A04%3A10Z&se=2026-03-28T22%3A29%3A10Z&sr=b&sp=r&sig=BdqUVMV5HLpv0FUkAEzx0eUko7TKBiE8aXeZbvRAXoI%3D)
2026-03-28 22:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994605/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU57WZP/42810866?sv=2020-08-04&st=2026-03-28T22%3A04%3A10Z&se=2026-03-28T22%3A29%3A10Z&sr=b&sp=r&sig=BdqUVMV5HLpv0FUkAEzx0eUko7TKBiE8aXeZbvRAXoI%3D)
2026-03-28 22:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994585/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU57WZP/42810866?sv=2020-08-04&st=2026-03-28T22%3A04%3A10Z&se=2026-03-28T22%3A29%3A10Z&sr=b&sp=r&sig=BdqUVMV5HLpv0FUkAEzx0eUko7TKBiE8aXeZbvRAXoI%3D)
2026-03-28 22:04:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142978/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142978>
2026-03-28 22:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110888/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/B10PGJ/42811203?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=EuD%2Bp1HvVP2JXHqKU%2B8jitx6XlktdJcPsUn2sF2sJ6k%3D)
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547304f90>
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ad57269-af6f-5f89-b6bd-0f6f92938d2b/2ad57269-af6f-5f89-b6bd-0f6f92938d2b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX62RKE%252F699047018%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047018/600 saved to cache
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2ad57269-af6f-5f89-b6bd-0f6f92938d2b
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554321e10>
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ad57269-af6f-5f89-b6bd-0f6f92938d2b/2ad57269-af6f-5f89-b6bd-0f6f92938d2b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX62RKE%252F699047011%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047011/600 saved to cache
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2ad57269-af6f-5f89-b6bd-0f6f92938d2b
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554300890>
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ad57269-af6f-5f89-b6bd-0f6f92938d2b/2ad57269-af6f-5f89-b6bd-0f6f92938d2b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX62RKE%252F699047023%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047023/600 saved to cache
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2ad57269-af6f-5f89-b6bd-0f6f92938d2b
2026-03-28 22:04:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b73dd0>
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ba462d-c70d-5156-b443-d7d5e76250e2/a4ba462d-c70d-5156-b443-d7d5e76250e2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF19KHM%252F699252150%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252150/600 saved to cache
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a4ba462d-c70d-5156-b443-d7d5e76250e2
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5545a3810>
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ad57269-af6f-5f89-b6bd-0f6f92938d2b/2ad57269-af6f-5f89-b6bd-0f6f92938d2b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX62RKE%252F699047030%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047030/600 saved to cache
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2ad57269-af6f-5f89-b6bd-0f6f92938d2b
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b70910>
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f78646-9cef-5fc7-bd80-803ea7a167c9/47f78646-9cef-5fc7-bd80-803ea7a167c9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK23XXL%252F699038193%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038193/600 saved to cache
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47f78646-9cef-5fc7-bd80-803ea7a167c9
2026-03-28 22:04:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b35090>
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1f5ee4c-4910-54f2-806e-fcee61f2b886/b1f5ee4c-4910-54f2-806e-fcee61f2b886_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT69OUG%252F699023499%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023499/600 saved to cache
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b1f5ee4c-4910-54f2-806e-fcee61f2b886
2026-03-28 22:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142916/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG65SWK/42811090?sv=2020-08-04&st=2026-03-28T22%3A04%3A12Z&se=2026-03-28T22%3A29%3A12Z&sr=b&sp=r&sig=f530hohT%2B5Br5INwJyv5C3pquuhacxkKnY0Wkt6n%2FRo%3D)
2026-03-28 22:04:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142954/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142954>
2026-03-28 22:04:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142966/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142966>
2026-03-28 22:04:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994506/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994506>
2026-03-28 22:04:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994534/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994534>
2026-03-28 22:04:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142929/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142929>
2026-03-28 22:04:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142941/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142941>
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542e2810>
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bb0eb2-42f3-5cb2-b21b-580137f2554b/74bb0eb2-42f3-5cb2-b21b-580137f2554b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP15VFV%252F689039789%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039789/600 saved to cache
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 74bb0eb2-42f3-5cb2-b21b-580137f2554b
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554832390>
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ad57269-af6f-5f89-b6bd-0f6f92938d2b/2ad57269-af6f-5f89-b6bd-0f6f92938d2b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX62RKE%252F699047041%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047041/600 saved to cache
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2ad57269-af6f-5f89-b6bd-0f6f92938d2b
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547206950>
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a22924-d609-517c-89c8-3ff469c2635b/68a22924-d609-517c-89c8-3ff469c2635b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK61ZMO%252F698994333%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994333/600 saved to cache
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68a22924-d609-517c-89c8-3ff469c2635b
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547248990>
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb13ef4-19c8-586c-a4d2-93af637cef56/bbb13ef4-19c8-586c-a4d2-93af637cef56_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU57WZP%252F698994576%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994576/600 saved to cache
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bbb13ef4-19c8-586c-a4d2-93af637cef56
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474de690>
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb13ef4-19c8-586c-a4d2-93af637cef56/bbb13ef4-19c8-586c-a4d2-93af637cef56_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU57WZP%252F698994605%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994605/600 saved to cache
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bbb13ef4-19c8-586c-a4d2-93af637cef56
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554ba2150>
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb13ef4-19c8-586c-a4d2-93af637cef56/bbb13ef4-19c8-586c-a4d2-93af637cef56_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU57WZP%252F698994585%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994585/600 saved to cache
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bbb13ef4-19c8-586c-a4d2-93af637cef56
2026-03-28 22:04:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554382610>
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414fda2b-7a8b-5d29-ad43-b0e99521f4d6/414fda2b-7a8b-5d29-ad43-b0e99521f4d6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FB10PGJ%252F699110888%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110888/600 saved to cache
2026-03-28 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 414fda2b-7a8b-5d29-ad43-b0e99521f4d6
2026-03-28 22:04:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142912/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142912>
2026-03-28 22:04:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994444/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994444>
2026-03-28 22:04:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994401/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994401>
2026-03-28 22:04:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994473/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994473>
2026-03-28 22:04:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142922/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142922>
2026-03-28 22:04:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994687/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994687>
2026-03-28 22:04:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994714/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994714>
2026-03-28 22:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142978/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG65SWK/42811090?sv=2020-08-04&st=2026-03-28T22%3A04%3A12Z&se=2026-03-28T22%3A29%3A12Z&sr=b&sp=r&sig=f530hohT%2B5Br5INwJyv5C3pquuhacxkKnY0Wkt6n%2FRo%3D)
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557132f10>
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d6d7c3-a2c7-5054-9780-fec8ad872fbe/30d6d7c3-a2c7-5054-9780-fec8ad872fbe_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG65SWK%252F699142916%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142916/600 saved to cache
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30d6d7c3-a2c7-5054-9780-fec8ad872fbe
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554316f50>
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d6d7c3-a2c7-5054-9780-fec8ad872fbe/30d6d7c3-a2c7-5054-9780-fec8ad872fbe_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG65SWK%252F699142978%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142978/600 saved to cache
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 30d6d7c3-a2c7-5054-9780-fec8ad872fbe
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142929/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG65SWK/42811090?sv=2020-08-04&st=2026-03-28T22%3A04%3A12Z&se=2026-03-28T22%3A29%3A12Z&sr=b&sp=r&sig=f530hohT%2B5Br5INwJyv5C3pquuhacxkKnY0Wkt6n%2FRo%3D)
2026-03-28 22:04:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994391/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994391>
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994534/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK61ZMO/42810880?sv=2020-08-04&st=2026-03-28T22%3A04%3A11Z&se=2026-03-28T22%3A29%3A11Z&sr=b&sp=r&sig=tXKsc6KFy1G7PRlGhYPyReIi6itWUlZeKDNxouAd0K4%3D)
2026-03-28 22:04:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994661/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994661>
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994506/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK61ZMO/42810880?sv=2020-08-04&st=2026-03-28T22%3A04%3A11Z&se=2026-03-28T22%3A29%3A11Z&sr=b&sp=r&sig=tXKsc6KFy1G7PRlGhYPyReIi6itWUlZeKDNxouAd0K4%3D)
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142966/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG65SWK/42811090?sv=2020-08-04&st=2026-03-28T22%3A04%3A12Z&se=2026-03-28T22%3A29%3A12Z&sr=b&sp=r&sig=f530hohT%2B5Br5INwJyv5C3pquuhacxkKnY0Wkt6n%2FRo%3D)
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142954/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG65SWK/42811090?sv=2020-08-04&st=2026-03-28T22%3A04%3A12Z&se=2026-03-28T22%3A29%3A12Z&sr=b&sp=r&sig=f530hohT%2B5Br5INwJyv5C3pquuhacxkKnY0Wkt6n%2FRo%3D)
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142941/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG65SWK/42811090?sv=2020-08-04&st=2026-03-28T22%3A04%3A12Z&se=2026-03-28T22%3A29%3A12Z&sr=b&sp=r&sig=f530hohT%2B5Br5INwJyv5C3pquuhacxkKnY0Wkt6n%2FRo%3D)
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994401/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK61ZMO/42810880?sv=2020-08-04&st=2026-03-28T22%3A04%3A11Z&se=2026-03-28T22%3A29%3A11Z&sr=b&sp=r&sig=tXKsc6KFy1G7PRlGhYPyReIi6itWUlZeKDNxouAd0K4%3D)
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142912/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG65SWK/42811090?sv=2020-08-04&st=2026-03-28T22%3A04%3A12Z&se=2026-03-28T22%3A29%3A12Z&sr=b&sp=r&sig=f530hohT%2B5Br5INwJyv5C3pquuhacxkKnY0Wkt6n%2FRo%3D)
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142922/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG65SWK/42811090?sv=2020-08-04&st=2026-03-28T22%3A04%3A12Z&se=2026-03-28T22%3A29%3A12Z&sr=b&sp=r&sig=f530hohT%2B5Br5INwJyv5C3pquuhacxkKnY0Wkt6n%2FRo%3D)
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994444/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK61ZMO/42810880?sv=2020-08-04&st=2026-03-28T22%3A04%3A11Z&se=2026-03-28T22%3A29%3A11Z&sr=b&sp=r&sig=tXKsc6KFy1G7PRlGhYPyReIi6itWUlZeKDNxouAd0K4%3D)
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994473/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK61ZMO/42810880?sv=2020-08-04&st=2026-03-28T22%3A04%3A11Z&se=2026-03-28T22%3A29%3A11Z&sr=b&sp=r&sig=tXKsc6KFy1G7PRlGhYPyReIi6itWUlZeKDNxouAd0K4%3D)
2026-03-28 22:04:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142905/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142905>
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994687/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU57WZP/42810866?sv=2020-08-04&st=2026-03-28T22%3A04%3A10Z&se=2026-03-28T22%3A29%3A10Z&sr=b&sp=r&sig=BdqUVMV5HLpv0FUkAEzx0eUko7TKBiE8aXeZbvRAXoI%3D)
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472f6a90>
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d6d7c3-a2c7-5054-9780-fec8ad872fbe/30d6d7c3-a2c7-5054-9780-fec8ad872fbe_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG65SWK%252F699142929%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142929/600 saved to cache
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30d6d7c3-a2c7-5054-9780-fec8ad872fbe
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994391/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK61ZMO/42810880?sv=2020-08-04&st=2026-03-28T22%3A04%3A11Z&se=2026-03-28T22%3A29%3A11Z&sr=b&sp=r&sig=tXKsc6KFy1G7PRlGhYPyReIi6itWUlZeKDNxouAd0K4%3D)
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994714/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU57WZP/42810866?sv=2020-08-04&st=2026-03-28T22%3A04%3A10Z&se=2026-03-28T22%3A29%3A10Z&sr=b&sp=r&sig=BdqUVMV5HLpv0FUkAEzx0eUko7TKBiE8aXeZbvRAXoI%3D)
2026-03-28 22:04:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994367/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994367>
2026-03-28 22:04:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142901/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DG65SWK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994649/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994649>
2026-03-28 22:04:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994630/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994630>
2026-03-28 22:04:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994353/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994353>
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994661/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU57WZP/42810866?sv=2020-08-04&st=2026-03-28T22%3A04%3A10Z&se=2026-03-28T22%3A29%3A10Z&sr=b&sp=r&sig=BdqUVMV5HLpv0FUkAEzx0eUko7TKBiE8aXeZbvRAXoI%3D)
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477da790>
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a22924-d609-517c-89c8-3ff469c2635b/68a22924-d609-517c-89c8-3ff469c2635b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK61ZMO%252F698994534%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994534/600 saved to cache
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 68a22924-d609-517c-89c8-3ff469c2635b
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473dd0d0>
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a22924-d609-517c-89c8-3ff469c2635b/68a22924-d609-517c-89c8-3ff469c2635b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK61ZMO%252F698994506%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994506/600 saved to cache
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 68a22924-d609-517c-89c8-3ff469c2635b
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554ba12d0>
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d6d7c3-a2c7-5054-9780-fec8ad872fbe/30d6d7c3-a2c7-5054-9780-fec8ad872fbe_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG65SWK%252F699142966%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142966/600 saved to cache
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 30d6d7c3-a2c7-5054-9780-fec8ad872fbe
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544e01d0>
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d6d7c3-a2c7-5054-9780-fec8ad872fbe/30d6d7c3-a2c7-5054-9780-fec8ad872fbe_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG65SWK%252F699142954%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142954/600 saved to cache
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30d6d7c3-a2c7-5054-9780-fec8ad872fbe
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b392d0>
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d6d7c3-a2c7-5054-9780-fec8ad872fbe/30d6d7c3-a2c7-5054-9780-fec8ad872fbe_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG65SWK%252F699142941%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142941/600 saved to cache
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30d6d7c3-a2c7-5054-9780-fec8ad872fbe
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542ffad0>
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a22924-d609-517c-89c8-3ff469c2635b/68a22924-d609-517c-89c8-3ff469c2635b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK61ZMO%252F698994401%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994401/600 saved to cache
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 68a22924-d609-517c-89c8-3ff469c2635b
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555c6dd10>
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d6d7c3-a2c7-5054-9780-fec8ad872fbe/30d6d7c3-a2c7-5054-9780-fec8ad872fbe_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG65SWK%252F699142912%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142912/600 saved to cache
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30d6d7c3-a2c7-5054-9780-fec8ad872fbe
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471c3dd0>
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d6d7c3-a2c7-5054-9780-fec8ad872fbe/30d6d7c3-a2c7-5054-9780-fec8ad872fbe_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG65SWK%252F699142922%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142922/600 saved to cache
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30d6d7c3-a2c7-5054-9780-fec8ad872fbe
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547740550>
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a22924-d609-517c-89c8-3ff469c2635b/68a22924-d609-517c-89c8-3ff469c2635b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK61ZMO%252F698994444%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994444/600 saved to cache
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 68a22924-d609-517c-89c8-3ff469c2635b
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471c0110>
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a22924-d609-517c-89c8-3ff469c2635b/68a22924-d609-517c-89c8-3ff469c2635b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK61ZMO%252F698994473%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994473/600 saved to cache
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 68a22924-d609-517c-89c8-3ff469c2635b
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142905/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG65SWK/42811090?sv=2020-08-04&st=2026-03-28T22%3A04%3A12Z&se=2026-03-28T22%3A29%3A12Z&sr=b&sp=r&sig=f530hohT%2B5Br5INwJyv5C3pquuhacxkKnY0Wkt6n%2FRo%3D)
2026-03-28 22:04:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994597/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994597>
2026-03-28 22:04:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994340/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994340>
2026-03-28 22:04:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047089/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047089>
2026-03-28 22:04:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047076/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047076>
2026-03-28 22:04:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047102/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047102>
2026-03-28 22:04:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994613/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994613>
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5541fca10>
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb13ef4-19c8-586c-a4d2-93af637cef56/bbb13ef4-19c8-586c-a4d2-93af637cef56_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU57WZP%252F698994687%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994687/600 saved to cache
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bbb13ef4-19c8-586c-a4d2-93af637cef56
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544c0b90>
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a22924-d609-517c-89c8-3ff469c2635b/68a22924-d609-517c-89c8-3ff469c2635b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK61ZMO%252F698994391%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994391/600 saved to cache
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 68a22924-d609-517c-89c8-3ff469c2635b
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548baa90>
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb13ef4-19c8-586c-a4d2-93af637cef56/bbb13ef4-19c8-586c-a4d2-93af637cef56_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU57WZP%252F698994714%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994714/600 saved to cache
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bbb13ef4-19c8-586c-a4d2-93af637cef56
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548ba750>
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb13ef4-19c8-586c-a4d2-93af637cef56/bbb13ef4-19c8-586c-a4d2-93af637cef56_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU57WZP%252F698994661%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994661/600 saved to cache
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bbb13ef4-19c8-586c-a4d2-93af637cef56
2026-03-28 22:04:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047061/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699047061>
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994630/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU57WZP/42810866?sv=2020-08-04&st=2026-03-28T22%3A04%3A10Z&se=2026-03-28T22%3A29%3A10Z&sr=b&sp=r&sig=BdqUVMV5HLpv0FUkAEzx0eUko7TKBiE8aXeZbvRAXoI%3D)
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994353/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK61ZMO/42810880?sv=2020-08-04&st=2026-03-28T22%3A04%3A11Z&se=2026-03-28T22%3A29%3A11Z&sr=b&sp=r&sig=tXKsc6KFy1G7PRlGhYPyReIi6itWUlZeKDNxouAd0K4%3D)
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142901/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DG65SWK/42811090?sv=2020-08-04&st=2026-03-28T22%3A04%3A12Z&se=2026-03-28T22%3A29%3A12Z&sr=b&sp=r&sig=f530hohT%2B5Br5INwJyv5C3pquuhacxkKnY0Wkt6n%2FRo%3D)
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994367/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK61ZMO/42810880?sv=2020-08-04&st=2026-03-28T22%3A04%3A11Z&se=2026-03-28T22%3A29%3A11Z&sr=b&sp=r&sig=tXKsc6KFy1G7PRlGhYPyReIi6itWUlZeKDNxouAd0K4%3D)
2026-03-28 22:04:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023479/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023479>
2026-03-28 22:04:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038177/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038177>
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994649/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU57WZP/42810866?sv=2020-08-04&st=2026-03-28T22%3A04%3A10Z&se=2026-03-28T22%3A29%3A10Z&sr=b&sp=r&sig=BdqUVMV5HLpv0FUkAEzx0eUko7TKBiE8aXeZbvRAXoI%3D)
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554382710>
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d6d7c3-a2c7-5054-9780-fec8ad872fbe/30d6d7c3-a2c7-5054-9780-fec8ad872fbe_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG65SWK%252F699142905%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142905/600 saved to cache
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30d6d7c3-a2c7-5054-9780-fec8ad872fbe
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994340/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK61ZMO/42810880?sv=2020-08-04&st=2026-03-28T22%3A04%3A11Z&se=2026-03-28T22%3A29%3A11Z&sr=b&sp=r&sig=tXKsc6KFy1G7PRlGhYPyReIi6itWUlZeKDNxouAd0K4%3D)
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994597/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU57WZP/42810866?sv=2020-08-04&st=2026-03-28T22%3A04%3A10Z&se=2026-03-28T22%3A29%3A10Z&sr=b&sp=r&sig=BdqUVMV5HLpv0FUkAEzx0eUko7TKBiE8aXeZbvRAXoI%3D)
2026-03-28 22:04:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252137/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252137>
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994613/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU57WZP/42810866?sv=2020-08-04&st=2026-03-28T22%3A04%3A10Z&se=2026-03-28T22%3A29%3A10Z&sr=b&sp=r&sig=BdqUVMV5HLpv0FUkAEzx0eUko7TKBiE8aXeZbvRAXoI%3D)
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047076/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX62RKE/42811098?sv=2020-08-04&st=2026-03-28T22%3A04%3A09Z&se=2026-03-28T22%3A29%3A09Z&sr=b&sp=r&sig=iHDTu6D4cBZ2Aj4oXB7FMKSgAqDL59mNlKIaTFVmQOE%3D)
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047102/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX62RKE/42811098?sv=2020-08-04&st=2026-03-28T22%3A04%3A09Z&se=2026-03-28T22%3A29%3A09Z&sr=b&sp=r&sig=iHDTu6D4cBZ2Aj4oXB7FMKSgAqDL59mNlKIaTFVmQOE%3D)
2026-03-28 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047089/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX62RKE/42811098?sv=2020-08-04&st=2026-03-28T22%3A04%3A09Z&se=2026-03-28T22%3A29%3A09Z&sr=b&sp=r&sig=iHDTu6D4cBZ2Aj4oXB7FMKSgAqDL59mNlKIaTFVmQOE%3D)
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554955c90>
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb13ef4-19c8-586c-a4d2-93af637cef56/bbb13ef4-19c8-586c-a4d2-93af637cef56_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU57WZP%252F698994630%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994630/600 saved to cache
2026-03-28 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bbb13ef4-19c8-586c-a4d2-93af637cef56
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554200c50>
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a22924-d609-517c-89c8-3ff469c2635b/68a22924-d609-517c-89c8-3ff469c2635b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK61ZMO%252F698994353%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994353/600 saved to cache
2026-03-28 22:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 68a22924-d609-517c-89c8-3ff469c2635b
2026-03-28 22:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ68ONK/42801456?sv=2020-08-04&st=2026-03-28T22%3A04%3A18Z&se=2026-03-28T22%3A29%3A18Z&sr=b&sp=r&sig=XrZIL0OGToca5kzuopEVeJBt%2B6pt8clxftXtvhBt4NQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ68%20ONK-GB>
2026-03-28 22:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038177/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK23XXL/42810961?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=HIraPhBD5waa9seHUB8yTzip4V%2BkelIT5vdZTBzO1L4%3D)
2026-03-28 22:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110872/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110872>
2026-03-28 22:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039783/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689039783>
2026-03-28 22:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253951/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253951>
2026-03-28 22:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554300dd0>
2026-03-28 22:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d6d7c3-a2c7-5054-9780-fec8ad872fbe/30d6d7c3-a2c7-5054-9780-fec8ad872fbe_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDG65SWK%252F699142901%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142901/600 saved to cache
2026-03-28 22:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30d6d7c3-a2c7-5054-9780-fec8ad872fbe
2026-03-28 22:04:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30d6d7c3-a2c7-5054-9780-fec8ad872fbe, skipping ID generation
2026-03-28 22:04:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30d6d7c3-a2c7-5054-9780-fec8ad872fbe sending to next pipeline
2026-03-28 22:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 30d6d7c3-a2c7-5054-9780-fec8ad872fbe, identifier: DG65%20SWK
2026-03-28 22:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477ed4d0>
2026-03-28 22:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a22924-d609-517c-89c8-3ff469c2635b/68a22924-d609-517c-89c8-3ff469c2635b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK61ZMO%252F698994367%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994367/600 saved to cache
2026-03-28 22:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 68a22924-d609-517c-89c8-3ff469c2635b
2026-03-28 22:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047061/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX62RKE/42811098?sv=2020-08-04&st=2026-03-28T22%3A04%3A09Z&se=2026-03-28T22%3A29%3A09Z&sr=b&sp=r&sig=iHDTu6D4cBZ2Aj4oXB7FMKSgAqDL59mNlKIaTFVmQOE%3D)
2026-03-28 22:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023479/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT69OUG/42810791?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=Rkj%2FxkM1%2BIIgVTIeJOHfQd43I%2FeKECKsCGXnmowEFQk%3D)
2026-03-28 22:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 30d6d7c3-a2c7-5054-9780-fec8ad872fbe with identifier: DG65%20SWK
2026-03-28 22:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 30d6d7c3-a2c7-5054-9780-fec8ad872fbe with identifier: DG65%20SWK
2026-03-28 22:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 30d6d7c3-a2c7-5054-9780-fec8ad872fbe with identifier: DG65%20SWK to the API
2026-03-28 22:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142901/600>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d6d7c3-a2c7-5054-9780-fec8ad872fbe/30d6d7c3-a2c7-5054-9780-fec8ad872fbe_expert_report_file_7e1f2e0c-4c18-4929-b922-48daf2ad73cd.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DG65%20SWK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '30d6d7c3-a2c7-5054-9780-fec8ad872fbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DG65 SWK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DG65%20SWK&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FIAT',
'model': '500',
'odometer': 58030,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d6d7c3-a2c7-5054-9780-fec8ad872fbe/30d6d7c3-a2c7-5054-9780-fec8ad872fbe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48708,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142901/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d6d7c3-a2c7-5054-9780-fec8ad872fbe/30d6d7c3-a2c7-5054-9780-fec8ad872fbe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46212,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142905/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d6d7c3-a2c7-5054-9780-fec8ad872fbe/30d6d7c3-a2c7-5054-9780-fec8ad872fbe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43970,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142912/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d6d7c3-a2c7-5054-9780-fec8ad872fbe/30d6d7c3-a2c7-5054-9780-fec8ad872fbe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46396,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142916/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d6d7c3-a2c7-5054-9780-fec8ad872fbe/30d6d7c3-a2c7-5054-9780-fec8ad872fbe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47350,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142922/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d6d7c3-a2c7-5054-9780-fec8ad872fbe/30d6d7c3-a2c7-5054-9780-fec8ad872fbe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44609,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142929/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d6d7c3-a2c7-5054-9780-fec8ad872fbe/30d6d7c3-a2c7-5054-9780-fec8ad872fbe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109644,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142941/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d6d7c3-a2c7-5054-9780-fec8ad872fbe/30d6d7c3-a2c7-5054-9780-fec8ad872fbe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78401,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142954/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d6d7c3-a2c7-5054-9780-fec8ad872fbe/30d6d7c3-a2c7-5054-9780-fec8ad872fbe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89379,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142966/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d6d7c3-a2c7-5054-9780-fec8ad872fbe/30d6d7c3-a2c7-5054-9780-fec8ad872fbe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88843,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DG65SWK/699142978/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FIAT 500 1.2 LOUNGE Hatchback',
'transmission': 'manual',
'trim': 'LOUNGE',
'vin': 'ZFA3120000J452199',
'year': 2015}
2026-03-28 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG65%2520SWK%27 HTTP/1.1" 200 None
2026-03-28 22:04:19 [bca.uk] INFO: Saving data for DG65%20SWK: {'created_time': 1774735459.826722, 'last_price_update_time': 1774735459.826733, 'auction_closing_time': 1774778400.0}
2026-03-28 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DG65%2520SWK') HTTP/1.1" 204 0
2026-03-28 22:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252387/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252387>
2026-03-28 22:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994521/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994521>
2026-03-28 22:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146573/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146573>
2026-03-28 22:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015821/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015821>
2026-03-28 22:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251924/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251924>
2026-03-28 22:04:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554300dd0>
2026-03-28 22:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb13ef4-19c8-586c-a4d2-93af637cef56/bbb13ef4-19c8-586c-a4d2-93af637cef56_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU57WZP%252F698994649%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994649/600 saved to cache
2026-03-28 22:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bbb13ef4-19c8-586c-a4d2-93af637cef56
2026-03-28 22:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54760e590>
2026-03-28 22:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a22924-d609-517c-89c8-3ff469c2635b/68a22924-d609-517c-89c8-3ff469c2635b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK61ZMO%252F698994340%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994340/600 saved to cache
2026-03-28 22:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 68a22924-d609-517c-89c8-3ff469c2635b
2026-03-28 22:04:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68a22924-d609-517c-89c8-3ff469c2635b, skipping ID generation
2026-03-28 22:04:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68a22924-d609-517c-89c8-3ff469c2635b sending to next pipeline
2026-03-28 22:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 68a22924-d609-517c-89c8-3ff469c2635b, identifier: DK61%20ZMO
2026-03-28 22:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547600e50>
2026-03-28 22:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb13ef4-19c8-586c-a4d2-93af637cef56/bbb13ef4-19c8-586c-a4d2-93af637cef56_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU57WZP%252F698994597%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994597/600 saved to cache
2026-03-28 22:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bbb13ef4-19c8-586c-a4d2-93af637cef56
2026-03-28 22:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54760f710>
2026-03-28 22:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb13ef4-19c8-586c-a4d2-93af637cef56/bbb13ef4-19c8-586c-a4d2-93af637cef56_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU57WZP%252F698994613%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994613/600 saved to cache
2026-03-28 22:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bbb13ef4-19c8-586c-a4d2-93af637cef56
2026-03-28 22:04:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbb13ef4-19c8-586c-a4d2-93af637cef56, skipping ID generation
2026-03-28 22:04:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bbb13ef4-19c8-586c-a4d2-93af637cef56 sending to next pipeline
2026-03-28 22:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bbb13ef4-19c8-586c-a4d2-93af637cef56, identifier: KU57%20WZP
2026-03-28 22:04:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542fca90>
2026-03-28 22:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ad57269-af6f-5f89-b6bd-0f6f92938d2b/2ad57269-af6f-5f89-b6bd-0f6f92938d2b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX62RKE%252F699047076%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047076/600 saved to cache
2026-03-28 22:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2ad57269-af6f-5f89-b6bd-0f6f92938d2b
2026-03-28 22:04:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547602950>
2026-03-28 22:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ad57269-af6f-5f89-b6bd-0f6f92938d2b/2ad57269-af6f-5f89-b6bd-0f6f92938d2b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX62RKE%252F699047102%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047102/600 saved to cache
2026-03-28 22:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2ad57269-af6f-5f89-b6bd-0f6f92938d2b
2026-03-28 22:04:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547304f10>
2026-03-28 22:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ad57269-af6f-5f89-b6bd-0f6f92938d2b/2ad57269-af6f-5f89-b6bd-0f6f92938d2b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX62RKE%252F699047089%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047089/600 saved to cache
2026-03-28 22:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2ad57269-af6f-5f89-b6bd-0f6f92938d2b
2026-03-28 22:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54760c150>
2026-03-28 22:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f78646-9cef-5fc7-bd80-803ea7a167c9/47f78646-9cef-5fc7-bd80-803ea7a167c9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK23XXL%252F699038177%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038177/600 saved to cache
2026-03-28 22:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47f78646-9cef-5fc7-bd80-803ea7a167c9
2026-03-28 22:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252137/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF19KHM/42806820?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=sr8AUvzfzyG0aLirfPlv3wY7sqotPL2UPVrzrL33HII%3D)
2026-03-28 22:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 68a22924-d609-517c-89c8-3ff469c2635b with identifier: DK61%20ZMO
2026-03-28 22:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 68a22924-d609-517c-89c8-3ff469c2635b with identifier: DK61%20ZMO
2026-03-28 22:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 68a22924-d609-517c-89c8-3ff469c2635b with identifier: DK61%20ZMO to the API
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994340/600>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68a22924-d609-517c-89c8-3ff469c2635b/68a22924-d609-517c-89c8-3ff469c2635b_expert_report_file_7a939f05-fd65-40e7-9b6c-3f4be767a2bf.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DK61%20ZMO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '68a22924-d609-517c-89c8-3ff469c2635b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DK61 ZMO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DK61%20ZMO&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 107968,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68a22924-d609-517c-89c8-3ff469c2635b/68a22924-d609-517c-89c8-3ff469c2635b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43718,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994333/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68a22924-d609-517c-89c8-3ff469c2635b/68a22924-d609-517c-89c8-3ff469c2635b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43581,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994340/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68a22924-d609-517c-89c8-3ff469c2635b/68a22924-d609-517c-89c8-3ff469c2635b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41852,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994353/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68a22924-d609-517c-89c8-3ff469c2635b/68a22924-d609-517c-89c8-3ff469c2635b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41475,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994367/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68a22924-d609-517c-89c8-3ff469c2635b/68a22924-d609-517c-89c8-3ff469c2635b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41091,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994391/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68a22924-d609-517c-89c8-3ff469c2635b/68a22924-d609-517c-89c8-3ff469c2635b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40802,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994401/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68a22924-d609-517c-89c8-3ff469c2635b/68a22924-d609-517c-89c8-3ff469c2635b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57189,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994444/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68a22924-d609-517c-89c8-3ff469c2635b/68a22924-d609-517c-89c8-3ff469c2635b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47119,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994473/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68a22924-d609-517c-89c8-3ff469c2635b/68a22924-d609-517c-89c8-3ff469c2635b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65124,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994506/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68a22924-d609-517c-89c8-3ff469c2635b/68a22924-d609-517c-89c8-3ff469c2635b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61398,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK61ZMO/698994534/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'RENAULT CLIO 1.2 I-MUSIC Hatchback',
'transmission': 'manual',
'trim': 'I-MUSIC',
'vin': 'VF1CR1S0H45879751',
'year': 2011}
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK61%2520ZMO%27 HTTP/1.1" 200 None
2026-03-28 22:04:20 [bca.uk] INFO: Saving data for DK61%20ZMO: {'created_time': 1774735460.833142, 'last_price_update_time': 1774735460.833172, 'auction_closing_time': 1774778400.0}
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DK61%2520ZMO') HTTP/1.1" 204 0
2026-03-28 22:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bbb13ef4-19c8-586c-a4d2-93af637cef56 with identifier: KU57%20WZP
2026-03-28 22:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bbb13ef4-19c8-586c-a4d2-93af637cef56 with identifier: KU57%20WZP
2026-03-28 22:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bbb13ef4-19c8-586c-a4d2-93af637cef56 with identifier: KU57%20WZP to the API
2026-03-28 22:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994613/600>
{'auction_title': '',
'c_o_2_emission_value': 193,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbb13ef4-19c8-586c-a4d2-93af637cef56/bbb13ef4-19c8-586c-a4d2-93af637cef56_expert_report_file_74650cfc-80a2-4a24-99d1-931a63f08d2d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KU57%20WZP-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bbb13ef4-19c8-586c-a4d2-93af637cef56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KU57 WZP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KU57%20WZP&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'C180',
'odometer': 159984,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbb13ef4-19c8-586c-a4d2-93af637cef56/bbb13ef4-19c8-586c-a4d2-93af637cef56_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50182,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994576/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbb13ef4-19c8-586c-a4d2-93af637cef56/bbb13ef4-19c8-586c-a4d2-93af637cef56_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46753,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994585/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbb13ef4-19c8-586c-a4d2-93af637cef56/bbb13ef4-19c8-586c-a4d2-93af637cef56_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45425,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994597/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbb13ef4-19c8-586c-a4d2-93af637cef56/bbb13ef4-19c8-586c-a4d2-93af637cef56_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42558,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994605/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbb13ef4-19c8-586c-a4d2-93af637cef56/bbb13ef4-19c8-586c-a4d2-93af637cef56_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36639,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994613/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbb13ef4-19c8-586c-a4d2-93af637cef56/bbb13ef4-19c8-586c-a4d2-93af637cef56_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35027,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994630/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbb13ef4-19c8-586c-a4d2-93af637cef56/bbb13ef4-19c8-586c-a4d2-93af637cef56_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82488,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994649/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbb13ef4-19c8-586c-a4d2-93af637cef56/bbb13ef4-19c8-586c-a4d2-93af637cef56_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74366,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994661/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbb13ef4-19c8-586c-a4d2-93af637cef56/bbb13ef4-19c8-586c-a4d2-93af637cef56_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82216,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994687/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbb13ef4-19c8-586c-a4d2-93af637cef56/bbb13ef4-19c8-586c-a4d2-93af637cef56_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52917,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU57WZP/698994714/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C180 1.8 K CLASSIC SE Saloon',
'transmission': 'manual',
'trim': 'K CLASSIC SE',
'vin': 'WDC2030462R257577',
'year': 2007}
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU57%2520WZP%27 HTTP/1.1" 200 None
2026-03-28 22:04:21 [bca.uk] INFO: Saving data for KU57%20WZP: {'created_time': 1774735461.214874, 'last_price_update_time': 1774735461.214888, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KU57%2520WZP') HTTP/1.1" 204 0
2026-03-28 22:04:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252120/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252120>
2026-03-28 22:04:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253754/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253754>
2026-03-28 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b02250>
2026-03-28 22:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ad57269-af6f-5f89-b6bd-0f6f92938d2b/2ad57269-af6f-5f89-b6bd-0f6f92938d2b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX62RKE%252F699047061%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047061/600 saved to cache
2026-03-28 22:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2ad57269-af6f-5f89-b6bd-0f6f92938d2b
2026-03-28 22:04:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ad57269-af6f-5f89-b6bd-0f6f92938d2b, skipping ID generation
2026-03-28 22:04:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ad57269-af6f-5f89-b6bd-0f6f92938d2b sending to next pipeline
2026-03-28 22:04:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2ad57269-af6f-5f89-b6bd-0f6f92938d2b, identifier: LX62%20RKE
2026-03-28 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471a2a90>
2026-03-28 22:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1f5ee4c-4910-54f2-806e-fcee61f2b886/b1f5ee4c-4910-54f2-806e-fcee61f2b886_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT69OUG%252F699023479%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023479/600 saved to cache
2026-03-28 22:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b1f5ee4c-4910-54f2-806e-fcee61f2b886
2026-03-28 22:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039783/600> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110840/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110840>
2026-03-28 22:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2ad57269-af6f-5f89-b6bd-0f6f92938d2b with identifier: LX62%20RKE
2026-03-28 22:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2ad57269-af6f-5f89-b6bd-0f6f92938d2b with identifier: LX62%20RKE
2026-03-28 22:04:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2ad57269-af6f-5f89-b6bd-0f6f92938d2b with identifier: LX62%20RKE to the API
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047061/600>
{'auction_title': '',
'c_o_2_emission_value': 94,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad57269-af6f-5f89-b6bd-0f6f92938d2b/2ad57269-af6f-5f89-b6bd-0f6f92938d2b_expert_report_file_a6b7805d-3298-44bc-bddd-3fff52457f98.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LX62%20RKE-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '2ad57269-af6f-5f89-b6bd-0f6f92938d2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LX62 RKE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LX62%20RKE&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'LEXUS',
'model': 'CT 200H',
'odometer': 85231,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad57269-af6f-5f89-b6bd-0f6f92938d2b/2ad57269-af6f-5f89-b6bd-0f6f92938d2b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50112,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047007/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad57269-af6f-5f89-b6bd-0f6f92938d2b/2ad57269-af6f-5f89-b6bd-0f6f92938d2b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49364,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047011/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad57269-af6f-5f89-b6bd-0f6f92938d2b/2ad57269-af6f-5f89-b6bd-0f6f92938d2b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49126,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047018/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad57269-af6f-5f89-b6bd-0f6f92938d2b/2ad57269-af6f-5f89-b6bd-0f6f92938d2b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47230,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047023/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad57269-af6f-5f89-b6bd-0f6f92938d2b/2ad57269-af6f-5f89-b6bd-0f6f92938d2b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41282,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047030/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad57269-af6f-5f89-b6bd-0f6f92938d2b/2ad57269-af6f-5f89-b6bd-0f6f92938d2b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41387,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047041/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad57269-af6f-5f89-b6bd-0f6f92938d2b/2ad57269-af6f-5f89-b6bd-0f6f92938d2b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103704,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047061/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad57269-af6f-5f89-b6bd-0f6f92938d2b/2ad57269-af6f-5f89-b6bd-0f6f92938d2b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91842,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047076/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad57269-af6f-5f89-b6bd-0f6f92938d2b/2ad57269-af6f-5f89-b6bd-0f6f92938d2b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96892,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047089/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad57269-af6f-5f89-b6bd-0f6f92938d2b/2ad57269-af6f-5f89-b6bd-0f6f92938d2b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70806,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX62RKE/699047102/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'LEXUS CT 200H 1.8 SE-L Hatchback',
'transmission': 'automatic',
'trim': 'SE-L',
'vin': 'JTHKD5BH102107414',
'year': 2012}
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX62%2520RKE%27 HTTP/1.1" 200 None
2026-03-28 22:04:21 [bca.uk] INFO: Saving data for LX62%20RKE: {'created_time': 1774735461.777918, 'last_price_update_time': 1774735461.777928, 'auction_closing_time': 1774951200.0}
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LX62%2520RKE') HTTP/1.1" 204 0
2026-03-28 22:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253951/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP11SXG/42810463?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=qkkbLatUiKU%2BsinzgsPhauDtkraDtbwZc7leOW58DOU%3D)
2026-03-28 22:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110872/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/B10PGJ/42811203?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=EuD%2Bp1HvVP2JXHqKU%2B8jitx6XlktdJcPsUn2sF2sJ6k%3D)
2026-03-28 22:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ68ONK/42801456?sv=2020-08-04&st=2026-03-28T22%3A04%3A18Z&se=2026-03-28T22%3A29%3A18Z&sr=b&sp=r&sig=XrZIL0OGToca5kzuopEVeJBt%2B6pt8clxftXtvhBt4NQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023402/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023402>
2026-03-28 22:04:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038130/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DK23XXL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AU02VYG/42810528?sv=2020-08-04&st=2026-03-28T22%3A04%3A21Z&se=2026-03-28T22%3A29%3A21Z&sr=b&sp=r&sig=l%2Fdb%2FB%2BBUeA0SChHayTsd1of3qhKRZHYBa2WamJxH7A%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AU02%20VYG-GB>
2026-03-28 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b402d0>
2026-03-28 22:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ba462d-c70d-5156-b443-d7d5e76250e2/a4ba462d-c70d-5156-b443-d7d5e76250e2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF19KHM%252F699252137%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252137/600 saved to cache
2026-03-28 22:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a4ba462d-c70d-5156-b443-d7d5e76250e2
2026-03-28 22:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547114750>
2026-03-28 22:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bb0eb2-42f3-5cb2-b21b-580137f2554b/74bb0eb2-42f3-5cb2-b21b-580137f2554b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP15VFV%252F689039783%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039783/600 saved to cache
2026-03-28 22:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 74bb0eb2-42f3-5cb2-b21b-580137f2554b
2026-03-28 22:04:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74bb0eb2-42f3-5cb2-b21b-580137f2554b, skipping ID generation
2026-03-28 22:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74bb0eb2-42f3-5cb2-b21b-580137f2554b with scrape type 1
2026-03-28 22:04:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74bb0eb2-42f3-5cb2-b21b-580137f2554b sending to next pipeline
2026-03-28 22:04:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 74bb0eb2-42f3-5cb2-b21b-580137f2554b, identifier: SP15%20VFV
2026-03-28 22:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 74bb0eb2-42f3-5cb2-b21b-580137f2554b with identifier: SP15%20VFV
2026-03-28 22:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 74bb0eb2-42f3-5cb2-b21b-580137f2554b with identifier: SP15%20VFV
2026-03-28 22:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 74bb0eb2-42f3-5cb2-b21b-580137f2554b with identifier: SP15%20VFV to the API
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039783/600>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': None,
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '74bb0eb2-42f3-5cb2-b21b-580137f2554b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SP15 VFV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SP15%20VFV&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 71501,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bb0eb2-42f3-5cb2-b21b-580137f2554b/74bb0eb2-42f3-5cb2-b21b-580137f2554b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48659,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039779/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bb0eb2-42f3-5cb2-b21b-580137f2554b/74bb0eb2-42f3-5cb2-b21b-580137f2554b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43549,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039783/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bb0eb2-42f3-5cb2-b21b-580137f2554b/74bb0eb2-42f3-5cb2-b21b-580137f2554b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48141,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039789/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bb0eb2-42f3-5cb2-b21b-580137f2554b/74bb0eb2-42f3-5cb2-b21b-580137f2554b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44452,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039793/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bb0eb2-42f3-5cb2-b21b-580137f2554b/74bb0eb2-42f3-5cb2-b21b-580137f2554b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37841,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039795/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bb0eb2-42f3-5cb2-b21b-580137f2554b/74bb0eb2-42f3-5cb2-b21b-580137f2554b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39258,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039798/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bb0eb2-42f3-5cb2-b21b-580137f2554b/74bb0eb2-42f3-5cb2-b21b-580137f2554b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41963,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039802/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bb0eb2-42f3-5cb2-b21b-580137f2554b/74bb0eb2-42f3-5cb2-b21b-580137f2554b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35612,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039804/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bb0eb2-42f3-5cb2-b21b-580137f2554b/74bb0eb2-42f3-5cb2-b21b-580137f2554b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49033,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039806/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bb0eb2-42f3-5cb2-b21b-580137f2554b/74bb0eb2-42f3-5cb2-b21b-580137f2554b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47992,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP15VFV/689039807/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 2.0 TDI 184 GTD Hatchback',
'transmission': 'manual',
'trim': 'TDI 184 GTD',
'vin': 'WVWZZZAUZFW131334',
'year': 2015}
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP15%2520VFV%27 HTTP/1.1" 200 None
2026-03-28 22:04:22 [bca.uk] INFO: Saving data for SP15%20VFV: {'created_time': 1774735462.340921, 'last_price_update_time': 1774735462.340933, 'auction_closing_time': 1775037600.0}
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SP15%2520VFV') HTTP/1.1" 204 0
2026-03-28 22:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253754/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YF07CJE/42784457?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=oeSdikiuOHhGcviJbgYya0Q8LTDoZVmeFjwoPj3o2js%3D)
2026-03-28 22:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252120/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF19KHM/42806820?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=sr8AUvzfzyG0aLirfPlv3wY7sqotPL2UPVrzrL33HII%3D)
2026-03-28 22:04:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253940/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253940>
2026-03-28 22:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015821/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA61BFY/42810775?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=tQax5P6adI54twzyoqdok6iIUxSzHDcLDwBb4%2BMoMFw%3D)
2026-03-28 22:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251924/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT64JYY/42807297?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=H09NJ6PkIwPyWfxNOYCddSHeDmQxr4Xr%2FaIklrKjYWY%3D)
2026-03-28 22:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146573/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL62VWY/42810894?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=DJfJtw6KwyhBPhnAY9QJ%2FtOYYSvRRaWGTAGIk0DU%2F%2BA%3D)
2026-03-28 22:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252387/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT12LJZ/42809616?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=ZCqeg%2BtAkN7zfvr8I5qdCyvEoyksA32%2Fdc9lEzPe%2BbI%3D)
2026-03-28 22:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994521/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS61FOF/42810605?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=CkwC%2BSn%2FHa5pvfLJnieo5YJn96MqgCZnNQ9bJG2t2ik%3D)
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549450d0>
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13188273-241e-5122-a324-f170682054c3/13188273-241e-5122-a324-f170682054c3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP11SXG%252F699253951%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253951/600 saved to cache
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 13188273-241e-5122-a324-f170682054c3
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472b3d50>
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414fda2b-7a8b-5d29-ad43-b0e99521f4d6/414fda2b-7a8b-5d29-ad43-b0e99521f4d6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FB10PGJ%252F699110872%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110872/600 saved to cache
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 414fda2b-7a8b-5d29-ad43-b0e99521f4d6
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471cfa50>
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_549aa2dc-22fb-53ad-ac56-4323c4ee2fe0/549aa2dc-22fb-53ad-ac56-4323c4ee2fe0_expert_report_file_37e503d4-4368-44d1-9b9d-2fab7f0859c4.pdf HTTP/1.1" 201 0
2026-03-28 22:04:22 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0
2026-03-28 22:04:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0, skipping ID generation
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWJ68ONK-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WJ68ONK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189543%27 HTTP/1.1" 200 None
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189543 not downloaded yet
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189548%27 HTTP/1.1" 200 None
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189548 not downloaded yet
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472b0a90>
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b77897-c825-556b-ba96-284dc5a81572/56b77897-c825-556b-ba96-284dc5a81572_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYF07CJE%252F699253754%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253754/600 saved to cache
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 56b77897-c825-556b-ba96-284dc5a81572
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544c2c90>
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ba462d-c70d-5156-b443-d7d5e76250e2/a4ba462d-c70d-5156-b443-d7d5e76250e2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF19KHM%252F699252120%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252120/600 saved to cache
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a4ba462d-c70d-5156-b443-d7d5e76250e2
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554203810>
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4baa05ed-fc6d-5ddf-8f83-9a745e89a05a/4baa05ed-fc6d-5ddf-8f83-9a745e89a05a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA61BFY%252F699015821%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015821/600 saved to cache
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544c1a90>
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e23659de-a271-571f-ad29-745e3ce94452/e23659de-a271-571f-ad29-745e3ce94452_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT64JYY%252F699251924%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251924/600 saved to cache
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e23659de-a271-571f-ad29-745e3ce94452
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543def90>
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de1b1d7c-0af9-5140-a37d-505dea797715/de1b1d7c-0af9-5140-a37d-505dea797715_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL62VWY%252F699146573%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146573/600 saved to cache
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item de1b1d7c-0af9-5140-a37d-505dea797715
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554957590>
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2a7ebc8-3779-5484-8073-7a1c6fb87969/c2a7ebc8-3779-5484-8073-7a1c6fb87969_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT12LJZ%252F699252387%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252387/600 saved to cache
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c2a7ebc8-3779-5484-8073-7a1c6fb87969
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543154d0>
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c3dd07d-5304-5ac0-80dc-e30cb298b7d6/5c3dd07d-5304-5ac0-80dc-e30cb298b7d6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS61FOF%252F698994521%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994521/600 saved to cache
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189556%27 HTTP/1.1" 200 None
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189556 not downloaded yet
2026-03-28 22:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038130/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DK23XXL/42810961?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=HIraPhBD5waa9seHUB8yTzip4V%2BkelIT5vdZTBzO1L4%3D)
2026-03-28 22:04:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015804/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015804>
2026-03-28 22:04:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252369/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252369>
2026-03-28 22:04:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994500/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994500>
2026-03-28 22:04:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251911/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251911>
2026-03-28 22:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023402/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT69OUG/42810791?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=Rkj%2FxkM1%2BIIgVTIeJOHfQd43I%2FeKECKsCGXnmowEFQk%3D)
2026-03-28 22:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110840/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/B10PGJ/42811203?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=EuD%2Bp1HvVP2JXHqKU%2B8jitx6XlktdJcPsUn2sF2sJ6k%3D)
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189562%27 HTTP/1.1" 200 None
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189562 not downloaded yet
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189567%27 HTTP/1.1" 200 None
2026-03-28 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189567 not downloaded yet
2026-03-28 22:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AU02VYG/42810528?sv=2020-08-04&st=2026-03-28T22%3A04%3A21Z&se=2026-03-28T22%3A29%3A21Z&sr=b&sp=r&sig=l%2Fdb%2FB%2BBUeA0SChHayTsd1of3qhKRZHYBa2WamJxH7A%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189579%27 HTTP/1.1" 200 None
2026-03-28 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189579 not downloaded yet
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189595%27 HTTP/1.1" 200 None
2026-03-28 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189595 not downloaded yet
2026-03-28 22:04:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146556/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146556>
2026-03-28 22:04:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253726/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253726>
2026-03-28 22:04:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253742/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253742>
2026-03-28 22:04:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252107/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252107>
2026-03-28 22:04:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146563/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146563>
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189605%27 HTTP/1.1" 200 None
2026-03-28 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189605 not downloaded yet
2026-03-28 22:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253940/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP11SXG/42810463?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=qkkbLatUiKU%2BsinzgsPhauDtkraDtbwZc7leOW58DOU%3D)
2026-03-28 22:04:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015770/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015770>
2026-03-28 22:04:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110820/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110820>
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189617%27 HTTP/1.1" 200 None
2026-03-28 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189617 not downloaded yet
2026-03-28 22:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472bd710>
2026-03-28 22:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f78646-9cef-5fc7-bd80-803ea7a167c9/47f78646-9cef-5fc7-bd80-803ea7a167c9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDK23XXL%252F699038130%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038130/600 saved to cache
2026-03-28 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47f78646-9cef-5fc7-bd80-803ea7a167c9
2026-03-28 22:04:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47f78646-9cef-5fc7-bd80-803ea7a167c9, skipping ID generation
2026-03-28 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47f78646-9cef-5fc7-bd80-803ea7a167c9 sending to next pipeline
2026-03-28 22:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 47f78646-9cef-5fc7-bd80-803ea7a167c9, identifier: DK23%20XXL
2026-03-28 22:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543171d0>
2026-03-28 22:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1f5ee4c-4910-54f2-806e-fcee61f2b886/b1f5ee4c-4910-54f2-806e-fcee61f2b886_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT69OUG%252F699023402%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023402/600 saved to cache
2026-03-28 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b1f5ee4c-4910-54f2-806e-fcee61f2b886
2026-03-28 22:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5578cff90>
2026-03-28 22:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414fda2b-7a8b-5d29-ad43-b0e99521f4d6/414fda2b-7a8b-5d29-ad43-b0e99521f4d6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FB10PGJ%252F699110840%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110840/600 saved to cache
2026-03-28 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 414fda2b-7a8b-5d29-ad43-b0e99521f4d6
2026-03-28 22:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 47f78646-9cef-5fc7-bd80-803ea7a167c9 with identifier: DK23%20XXL
2026-03-28 22:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 47f78646-9cef-5fc7-bd80-803ea7a167c9 with identifier: DK23%20XXL
2026-03-28 22:04:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 47f78646-9cef-5fc7-bd80-803ea7a167c9 with identifier: DK23%20XXL to the API
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038130/600>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f78646-9cef-5fc7-bd80-803ea7a167c9/47f78646-9cef-5fc7-bd80-803ea7a167c9_expert_report_file_34a84151-9719-4100-8015-a043dc9732cf.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DK23%20XXL-GB',
'category': 'Car',
'color': 'yellow',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '47f78646-9cef-5fc7-bd80-803ea7a167c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DK23 XXL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DK23%20XXL&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MG MOTOR UK',
'model': 'MG3',
'odometer': 41725,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f78646-9cef-5fc7-bd80-803ea7a167c9/47f78646-9cef-5fc7-bd80-803ea7a167c9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40563,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038130/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f78646-9cef-5fc7-bd80-803ea7a167c9/47f78646-9cef-5fc7-bd80-803ea7a167c9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40818,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038141/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f78646-9cef-5fc7-bd80-803ea7a167c9/47f78646-9cef-5fc7-bd80-803ea7a167c9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38570,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038160/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f78646-9cef-5fc7-bd80-803ea7a167c9/47f78646-9cef-5fc7-bd80-803ea7a167c9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38865,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038177/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f78646-9cef-5fc7-bd80-803ea7a167c9/47f78646-9cef-5fc7-bd80-803ea7a167c9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38079,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038193/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f78646-9cef-5fc7-bd80-803ea7a167c9/47f78646-9cef-5fc7-bd80-803ea7a167c9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37452,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038208/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f78646-9cef-5fc7-bd80-803ea7a167c9/47f78646-9cef-5fc7-bd80-803ea7a167c9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97045,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038232/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f78646-9cef-5fc7-bd80-803ea7a167c9/47f78646-9cef-5fc7-bd80-803ea7a167c9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79387,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038250/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f78646-9cef-5fc7-bd80-803ea7a167c9/47f78646-9cef-5fc7-bd80-803ea7a167c9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85367,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038268/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f78646-9cef-5fc7-bd80-803ea7a167c9/47f78646-9cef-5fc7-bd80-803ea7a167c9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90082,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DK23XXL/699038288/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'MG MOTOR UK MG3 1.5 VTI-TECH EXCLUSIVE Hatchback',
'transmission': 'manual',
'trim': 'VTI-TECH EXCLUSIVE',
'vin': 'LSJZ14U99NS094989',
'year': 2023}
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK23%2520XXL%27 HTTP/1.1" 200 None
2026-03-28 22:04:23 [bca.uk] INFO: Saving data for DK23%20XXL: {'created_time': 1774735463.699202, 'last_price_update_time': 1774735463.699213, 'auction_closing_time': 1774951200.0}
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DK23%2520XXL') HTTP/1.1" 204 0
2026-03-28 22:04:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189543/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189543>
2026-03-28 22:04:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189548/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189548>
2026-03-28 22:04:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189535/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WJ68ONK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b83fd0>
2026-03-28 22:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f00ae92-c3a1-5f36-b822-faa77c54fc81/1f00ae92-c3a1-5f36-b822-faa77c54fc81_expert_report_file_87b8e3a5-03fc-4b02-b1f4-83698595f150.pdf HTTP/1.1" 201 0
2026-03-28 22:04:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1f00ae92-c3a1-5f36-b822-faa77c54fc81
2026-03-28 22:04:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f00ae92-c3a1-5f36-b822-faa77c54fc81, skipping ID generation
2026-03-28 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f00ae92-c3a1-5f36-b822-faa77c54fc81
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAU02VYG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AU02VYG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189562/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189562>
2026-03-28 22:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252369/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT12LJZ/42809616?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=ZCqeg%2BtAkN7zfvr8I5qdCyvEoyksA32%2Fdc9lEzPe%2BbI%3D)
2026-03-28 22:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015804/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA61BFY/42810775?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=tQax5P6adI54twzyoqdok6iIUxSzHDcLDwBb4%2BMoMFw%3D)
2026-03-28 22:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994500/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS61FOF/42810605?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=CkwC%2BSn%2FHa5pvfLJnieo5YJn96MqgCZnNQ9bJG2t2ik%3D)
2026-03-28 22:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251911/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT64JYY/42807297?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=H09NJ6PkIwPyWfxNOYCddSHeDmQxr4Xr%2FaIklrKjYWY%3D)
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699057020%27 HTTP/1.1" 200 None
2026-03-28 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699057020 not downloaded yet
2026-03-28 22:04:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547226f50>
2026-03-28 22:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13188273-241e-5122-a324-f170682054c3/13188273-241e-5122-a324-f170682054c3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP11SXG%252F699253940%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253940/600 saved to cache
2026-03-28 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 13188273-241e-5122-a324-f170682054c3
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699057041%27 HTTP/1.1" 200 None
2026-03-28 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699057041 not downloaded yet
2026-03-28 22:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252107/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF19KHM/42806820?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=sr8AUvzfzyG0aLirfPlv3wY7sqotPL2UPVrzrL33HII%3D)
2026-03-28 22:04:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189595/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189595>
2026-03-28 22:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146556/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL62VWY/42810894?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=DJfJtw6KwyhBPhnAY9QJ%2FtOYYSvRRaWGTAGIk0DU%2F%2BA%3D)
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699057066%27 HTTP/1.1" 200 None
2026-03-28 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699057066 not downloaded yet
2026-03-28 22:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146563/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL62VWY/42810894?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=DJfJtw6KwyhBPhnAY9QJ%2FtOYYSvRRaWGTAGIk0DU%2F%2BA%3D)
2026-03-28 22:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253726/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YF07CJE/42784457?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=oeSdikiuOHhGcviJbgYya0Q8LTDoZVmeFjwoPj3o2js%3D)
2026-03-28 22:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015770/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA61BFY/42810775?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=tQax5P6adI54twzyoqdok6iIUxSzHDcLDwBb4%2BMoMFw%3D)
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699057082%27 HTTP/1.1" 200 None
2026-03-28 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699057082 not downloaded yet
2026-03-28 22:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253742/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YF07CJE/42784457?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=oeSdikiuOHhGcviJbgYya0Q8LTDoZVmeFjwoPj3o2js%3D)
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699057108%27 HTTP/1.1" 200 None
2026-03-28 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699057108 not downloaded yet
2026-03-28 22:04:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543b5810>
2026-03-28 22:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2a7ebc8-3779-5484-8073-7a1c6fb87969/c2a7ebc8-3779-5484-8073-7a1c6fb87969_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT12LJZ%252F699252369%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252369/600 saved to cache
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c2a7ebc8-3779-5484-8073-7a1c6fb87969
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547263990>
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4baa05ed-fc6d-5ddf-8f83-9a745e89a05a/4baa05ed-fc6d-5ddf-8f83-9a745e89a05a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA61BFY%252F699015804%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015804/600 saved to cache
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474ba850>
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c3dd07d-5304-5ac0-80dc-e30cb298b7d6/5c3dd07d-5304-5ac0-80dc-e30cb298b7d6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS61FOF%252F698994500%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994500/600 saved to cache
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548dcd90>
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e23659de-a271-571f-ad29-745e3ce94452/e23659de-a271-571f-ad29-745e3ce94452_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT64JYY%252F699251911%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251911/600 saved to cache
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e23659de-a271-571f-ad29-745e3ce94452
2026-03-28 22:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110820/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/B10PGJ/42811203?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=EuD%2Bp1HvVP2JXHqKU%2B8jitx6XlktdJcPsUn2sF2sJ6k%3D)
2026-03-28 22:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189548/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ68ONK/42801456?sv=2020-08-04&st=2026-03-28T22%3A04%3A18Z&se=2026-03-28T22%3A29%3A18Z&sr=b&sp=r&sig=XrZIL0OGToca5kzuopEVeJBt%2B6pt8clxftXtvhBt4NQ%3D)
2026-03-28 22:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189535/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ68ONK/42801456?sv=2020-08-04&st=2026-03-28T22%3A04%3A18Z&se=2026-03-28T22%3A29%3A18Z&sr=b&sp=r&sig=XrZIL0OGToca5kzuopEVeJBt%2B6pt8clxftXtvhBt4NQ%3D)
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699057130%27 HTTP/1.1" 200 None
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699057130 not downloaded yet
2026-03-28 22:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189543/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ68ONK/42801456?sv=2020-08-04&st=2026-03-28T22%3A04%3A18Z&se=2026-03-28T22%3A29%3A18Z&sr=b&sp=r&sig=XrZIL0OGToca5kzuopEVeJBt%2B6pt8clxftXtvhBt4NQ%3D)
2026-03-28 22:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189617/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189617>
2026-03-28 22:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189605/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189605>
2026-03-28 22:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189562/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ68ONK/42801456?sv=2020-08-04&st=2026-03-28T22%3A04%3A18Z&se=2026-03-28T22%3A29%3A18Z&sr=b&sp=r&sig=XrZIL0OGToca5kzuopEVeJBt%2B6pt8clxftXtvhBt4NQ%3D)
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699057153%27 HTTP/1.1" 200 None
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699057153 not downloaded yet
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699057173%27 HTTP/1.1" 200 None
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699057173 not downloaded yet
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554815090>
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ba462d-c70d-5156-b443-d7d5e76250e2/a4ba462d-c70d-5156-b443-d7d5e76250e2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF19KHM%252F699252107%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252107/600 saved to cache
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a4ba462d-c70d-5156-b443-d7d5e76250e2
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547117f50>
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de1b1d7c-0af9-5140-a37d-505dea797715/de1b1d7c-0af9-5140-a37d-505dea797715_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL62VWY%252F699146556%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146556/600 saved to cache
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item de1b1d7c-0af9-5140-a37d-505dea797715
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554800cd0>
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de1b1d7c-0af9-5140-a37d-505dea797715/de1b1d7c-0af9-5140-a37d-505dea797715_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL62VWY%252F699146563%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146563/600 saved to cache
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item de1b1d7c-0af9-5140-a37d-505dea797715
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471cc190>
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b77897-c825-556b-ba96-284dc5a81572/56b77897-c825-556b-ba96-284dc5a81572_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYF07CJE%252F699253726%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253726/600 saved to cache
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 56b77897-c825-556b-ba96-284dc5a81572
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472ab2d0>
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4baa05ed-fc6d-5ddf-8f83-9a745e89a05a/4baa05ed-fc6d-5ddf-8f83-9a745e89a05a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA61BFY%252F699015770%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015770/600 saved to cache
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471ce850>
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b77897-c825-556b-ba96-284dc5a81572/56b77897-c825-556b-ba96-284dc5a81572_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYF07CJE%252F699253742%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253742/600 saved to cache
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 56b77897-c825-556b-ba96-284dc5a81572
2026-03-28 22:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189579/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189579>
2026-03-28 22:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057020/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699057020>
2026-03-28 22:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057066/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699057066>
2026-03-28 22:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189556/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189556>
2026-03-28 22:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057041/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699057041>
2026-03-28 22:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189567/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189567>
2026-03-28 22:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699056999/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AU02VYG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699057198%27 HTTP/1.1" 200 None
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699057198 not downloaded yet
2026-03-28 22:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189595/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ68ONK/42801456?sv=2020-08-04&st=2026-03-28T22%3A04%3A18Z&se=2026-03-28T22%3A29%3A18Z&sr=b&sp=r&sig=XrZIL0OGToca5kzuopEVeJBt%2B6pt8clxftXtvhBt4NQ%3D)
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548007d0>
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414fda2b-7a8b-5d29-ad43-b0e99521f4d6/414fda2b-7a8b-5d29-ad43-b0e99521f4d6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FB10PGJ%252F699110820%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110820/600 saved to cache
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 414fda2b-7a8b-5d29-ad43-b0e99521f4d6
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547226310>
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_549aa2dc-22fb-53ad-ac56-4323c4ee2fe0/549aa2dc-22fb-53ad-ac56-4323c4ee2fe0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ68ONK%252F699189548%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189548/600 saved to cache
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543dfa90>
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_549aa2dc-22fb-53ad-ac56-4323c4ee2fe0/549aa2dc-22fb-53ad-ac56-4323c4ee2fe0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ68ONK%252F699189535%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189535/600 saved to cache
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547226190>
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_549aa2dc-22fb-53ad-ac56-4323c4ee2fe0/549aa2dc-22fb-53ad-ac56-4323c4ee2fe0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ68ONK%252F699189543%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189543/600 saved to cache
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54738f210>
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_549aa2dc-22fb-53ad-ac56-4323c4ee2fe0/549aa2dc-22fb-53ad-ac56-4323c4ee2fe0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ68ONK%252F699189562%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189562/600 saved to cache
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0
2026-03-28 22:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057082/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699057082>
2026-03-28 22:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023373/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023373>
2026-03-28 22:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057108/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699057108>
2026-03-28 22:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253913/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253913>
2026-03-28 22:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252339/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252339>
2026-03-28 22:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ19ZRG/42809537?sv=2020-08-04&st=2026-03-28T22%3A04%3A24Z&se=2026-03-28T22%3A29%3A24Z&sr=b&sp=r&sig=3UPd7KE5L4pnQMco18M4tzymf7e3IFQQNnSy3dZWExo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KJ19%20ZRG-GB>
2026-03-28 22:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189605/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ68ONK/42801456?sv=2020-08-04&st=2026-03-28T22%3A04%3A18Z&se=2026-03-28T22%3A29%3A18Z&sr=b&sp=r&sig=XrZIL0OGToca5kzuopEVeJBt%2B6pt8clxftXtvhBt4NQ%3D)
2026-03-28 22:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189617/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ68ONK/42801456?sv=2020-08-04&st=2026-03-28T22%3A04%3A18Z&se=2026-03-28T22%3A29%3A18Z&sr=b&sp=r&sig=XrZIL0OGToca5kzuopEVeJBt%2B6pt8clxftXtvhBt4NQ%3D)
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555ca9c90>
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_549aa2dc-22fb-53ad-ac56-4323c4ee2fe0/549aa2dc-22fb-53ad-ac56-4323c4ee2fe0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ68ONK%252F699189595%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189595/600 saved to cache
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0
2026-03-28 22:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057020/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AU02VYG/42810528?sv=2020-08-04&st=2026-03-28T22%3A04%3A21Z&se=2026-03-28T22%3A29%3A21Z&sr=b&sp=r&sig=l%2Fdb%2FB%2BBUeA0SChHayTsd1of3qhKRZHYBa2WamJxH7A%3D)
2026-03-28 22:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057041/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AU02VYG/42810528?sv=2020-08-04&st=2026-03-28T22%3A04%3A21Z&se=2026-03-28T22%3A29%3A21Z&sr=b&sp=r&sig=l%2Fdb%2FB%2BBUeA0SChHayTsd1of3qhKRZHYBa2WamJxH7A%3D)
2026-03-28 22:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057066/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AU02VYG/42810528?sv=2020-08-04&st=2026-03-28T22%3A04%3A21Z&se=2026-03-28T22%3A29%3A21Z&sr=b&sp=r&sig=l%2Fdb%2FB%2BBUeA0SChHayTsd1of3qhKRZHYBa2WamJxH7A%3D)
2026-03-28 22:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699056999/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AU02VYG/42810528?sv=2020-08-04&st=2026-03-28T22%3A04%3A21Z&se=2026-03-28T22%3A29%3A21Z&sr=b&sp=r&sig=l%2Fdb%2FB%2BBUeA0SChHayTsd1of3qhKRZHYBa2WamJxH7A%3D)
2026-03-28 22:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189556/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ68ONK/42801456?sv=2020-08-04&st=2026-03-28T22%3A04%3A18Z&se=2026-03-28T22%3A29%3A18Z&sr=b&sp=r&sig=XrZIL0OGToca5kzuopEVeJBt%2B6pt8clxftXtvhBt4NQ%3D)
2026-03-28 22:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189567/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ68ONK/42801456?sv=2020-08-04&st=2026-03-28T22%3A04%3A18Z&se=2026-03-28T22%3A29%3A18Z&sr=b&sp=r&sig=XrZIL0OGToca5kzuopEVeJBt%2B6pt8clxftXtvhBt4NQ%3D)
2026-03-28 22:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057173/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699057173>
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555033890>
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_549aa2dc-22fb-53ad-ac56-4323c4ee2fe0/549aa2dc-22fb-53ad-ac56-4323c4ee2fe0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ68ONK%252F699189605%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189605/600 saved to cache
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547207690>
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_549aa2dc-22fb-53ad-ac56-4323c4ee2fe0/549aa2dc-22fb-53ad-ac56-4323c4ee2fe0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ68ONK%252F699189617%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189617/600 saved to cache
2026-03-28 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0
2026-03-28 22:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189579/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ68ONK/42801456?sv=2020-08-04&st=2026-03-28T22%3A04%3A18Z&se=2026-03-28T22%3A29%3A18Z&sr=b&sp=r&sig=XrZIL0OGToca5kzuopEVeJBt%2B6pt8clxftXtvhBt4NQ%3D)
2026-03-28 22:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057108/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AU02VYG/42810528?sv=2020-08-04&st=2026-03-28T22%3A04%3A21Z&se=2026-03-28T22%3A29%3A21Z&sr=b&sp=r&sig=l%2Fdb%2FB%2BBUeA0SChHayTsd1of3qhKRZHYBa2WamJxH7A%3D)
2026-03-28 22:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253913/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP11SXG/42810463?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=qkkbLatUiKU%2BsinzgsPhauDtkraDtbwZc7leOW58DOU%3D)
2026-03-28 22:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057082/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AU02VYG/42810528?sv=2020-08-04&st=2026-03-28T22%3A04%3A21Z&se=2026-03-28T22%3A29%3A21Z&sr=b&sp=r&sig=l%2Fdb%2FB%2BBUeA0SChHayTsd1of3qhKRZHYBa2WamJxH7A%3D)
2026-03-28 22:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023373/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT69OUG/42810791?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=Rkj%2FxkM1%2BIIgVTIeJOHfQd43I%2FeKECKsCGXnmowEFQk%3D)
2026-03-28 22:04:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057198/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699057198>
2026-03-28 22:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252339/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT12LJZ/42809616?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=ZCqeg%2BtAkN7zfvr8I5qdCyvEoyksA32%2Fdc9lEzPe%2BbI%3D)
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554291090>
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f00ae92-c3a1-5f36-b822-faa77c54fc81/1f00ae92-c3a1-5f36-b822-faa77c54fc81_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAU02VYG%252F699057020%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057020/600 saved to cache
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f00ae92-c3a1-5f36-b822-faa77c54fc81
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54717f090>
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f00ae92-c3a1-5f36-b822-faa77c54fc81/1f00ae92-c3a1-5f36-b822-faa77c54fc81_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAU02VYG%252F699057041%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057041/600 saved to cache
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f00ae92-c3a1-5f36-b822-faa77c54fc81
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547293090>
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f00ae92-c3a1-5f36-b822-faa77c54fc81/1f00ae92-c3a1-5f36-b822-faa77c54fc81_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAU02VYG%252F699057066%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057066/600 saved to cache
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f00ae92-c3a1-5f36-b822-faa77c54fc81
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5545cf8d0>
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f00ae92-c3a1-5f36-b822-faa77c54fc81/1f00ae92-c3a1-5f36-b822-faa77c54fc81_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAU02VYG%252F699056999%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699056999/600 saved to cache
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f00ae92-c3a1-5f36-b822-faa77c54fc81
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547293d10>
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_549aa2dc-22fb-53ad-ac56-4323c4ee2fe0/549aa2dc-22fb-53ad-ac56-4323c4ee2fe0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ68ONK%252F699189556%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189556/600 saved to cache
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547743290>
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_549aa2dc-22fb-53ad-ac56-4323c4ee2fe0/549aa2dc-22fb-53ad-ac56-4323c4ee2fe0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ68ONK%252F699189567%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189567/600 saved to cache
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0
2026-03-28 22:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ19ZRG/42809537?sv=2020-08-04&st=2026-03-28T22%3A04%3A24Z&se=2026-03-28T22%3A29%3A24Z&sr=b&sp=r&sig=3UPd7KE5L4pnQMco18M4tzymf7e3IFQQNnSy3dZWExo%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057130/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699057130>
2026-03-28 22:04:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251884/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251884>
2026-03-28 22:04:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994443/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994443>
2026-03-28 22:04:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057153/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699057153>
2026-03-28 22:04:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253711/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253711>
2026-03-28 22:04:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146547/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146547>
2026-03-28 22:04:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015743/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015743>
2026-03-28 22:04:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554274210>
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_549aa2dc-22fb-53ad-ac56-4323c4ee2fe0/549aa2dc-22fb-53ad-ac56-4323c4ee2fe0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ68ONK%252F699189579%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189579/600 saved to cache
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0
2026-03-28 22:04:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0, skipping ID generation
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0 sending to next pipeline
2026-03-28 22:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0, identifier: WJ68%20ONK
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472043d0>
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f00ae92-c3a1-5f36-b822-faa77c54fc81/1f00ae92-c3a1-5f36-b822-faa77c54fc81_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAU02VYG%252F699057108%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057108/600 saved to cache
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1f00ae92-c3a1-5f36-b822-faa77c54fc81
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b3910>
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13188273-241e-5122-a324-f170682054c3/13188273-241e-5122-a324-f170682054c3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP11SXG%252F699253913%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253913/600 saved to cache
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 13188273-241e-5122-a324-f170682054c3
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554805810>
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f00ae92-c3a1-5f36-b822-faa77c54fc81/1f00ae92-c3a1-5f36-b822-faa77c54fc81_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAU02VYG%252F699057082%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057082/600 saved to cache
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f00ae92-c3a1-5f36-b822-faa77c54fc81
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554800a90>
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1f5ee4c-4910-54f2-806e-fcee61f2b886/b1f5ee4c-4910-54f2-806e-fcee61f2b886_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT69OUG%252F699023373%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023373/600 saved to cache
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b1f5ee4c-4910-54f2-806e-fcee61f2b886
2026-03-28 22:04:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548161d0>
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2a7ebc8-3779-5484-8073-7a1c6fb87969/c2a7ebc8-3779-5484-8073-7a1c6fb87969_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT12LJZ%252F699252339%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252339/600 saved to cache
2026-03-28 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c2a7ebc8-3779-5484-8073-7a1c6fb87969
2026-03-28 22:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0 with identifier: WJ68%20ONK
2026-03-28 22:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0 with identifier: WJ68%20ONK
2026-03-28 22:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0 with identifier: WJ68%20ONK to the API
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189579/600>
{'auction_title': '',
'c_o_2_emission_value': 170,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_549aa2dc-22fb-53ad-ac56-4323c4ee2fe0/549aa2dc-22fb-53ad-ac56-4323c4ee2fe0_expert_report_file_37e503d4-4368-44d1-9b9d-2fab7f0859c4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ68%20ONK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '549aa2dc-22fb-53ad-ac56-4323c4ee2fe0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ68 ONK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ68%20ONK&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 73783,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_549aa2dc-22fb-53ad-ac56-4323c4ee2fe0/549aa2dc-22fb-53ad-ac56-4323c4ee2fe0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40314,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189535/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_549aa2dc-22fb-53ad-ac56-4323c4ee2fe0/549aa2dc-22fb-53ad-ac56-4323c4ee2fe0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39699,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189543/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_549aa2dc-22fb-53ad-ac56-4323c4ee2fe0/549aa2dc-22fb-53ad-ac56-4323c4ee2fe0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35426,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189548/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_549aa2dc-22fb-53ad-ac56-4323c4ee2fe0/549aa2dc-22fb-53ad-ac56-4323c4ee2fe0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36991,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189556/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_549aa2dc-22fb-53ad-ac56-4323c4ee2fe0/549aa2dc-22fb-53ad-ac56-4323c4ee2fe0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36298,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189562/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_549aa2dc-22fb-53ad-ac56-4323c4ee2fe0/549aa2dc-22fb-53ad-ac56-4323c4ee2fe0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34357,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189567/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_549aa2dc-22fb-53ad-ac56-4323c4ee2fe0/549aa2dc-22fb-53ad-ac56-4323c4ee2fe0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94264,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189579/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_549aa2dc-22fb-53ad-ac56-4323c4ee2fe0/549aa2dc-22fb-53ad-ac56-4323c4ee2fe0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94636,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189595/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_549aa2dc-22fb-53ad-ac56-4323c4ee2fe0/549aa2dc-22fb-53ad-ac56-4323c4ee2fe0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94877,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189605/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_549aa2dc-22fb-53ad-ac56-4323c4ee2fe0/549aa2dc-22fb-53ad-ac56-4323c4ee2fe0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71365,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ68ONK/699189617/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 SE TECH StationWagon',
'transmission': 'automatic',
'trim': 'TD4 180 SE TECH',
'vin': 'SALCA2AN7KH779880',
'year': 2018}
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ68%2520ONK%27 HTTP/1.1" 200 None
2026-03-28 22:04:26 [bca.uk] INFO: Saving data for WJ68%20ONK: {'created_time': 1774735466.092798, 'last_price_update_time': 1774735466.09281, 'auction_closing_time': 1774778400.0}
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ68%2520ONK') HTTP/1.1" 204 0
2026-03-28 22:04:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143551/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143551>
2026-03-28 22:04:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143413/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143413>
2026-03-28 22:04:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110813/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110813>
2026-03-28 22:04:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976518/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976518>
2026-03-28 22:04:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252101/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252101>
2026-03-28 22:04:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146354/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146354>
2026-03-28 22:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057198/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AU02VYG/42810528?sv=2020-08-04&st=2026-03-28T22%3A04%3A21Z&se=2026-03-28T22%3A29%3A21Z&sr=b&sp=r&sig=l%2Fdb%2FB%2BBUeA0SChHayTsd1of3qhKRZHYBa2WamJxH7A%3D)
2026-03-28 22:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057173/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AU02VYG/42810528?sv=2020-08-04&st=2026-03-28T22%3A04%3A21Z&se=2026-03-28T22%3A29%3A21Z&sr=b&sp=r&sig=l%2Fdb%2FB%2BBUeA0SChHayTsd1of3qhKRZHYBa2WamJxH7A%3D)
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473dfad0>
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e094926b-3a83-59ef-883a-320713cabb3c/e094926b-3a83-59ef-883a-320713cabb3c_expert_report_file_ec247b6b-d72a-4e85-a3dd-cc72eb622658.pdf HTTP/1.1" 201 0
2026-03-28 22:04:26 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e094926b-3a83-59ef-883a-320713cabb3c
2026-03-28 22:04:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e094926b-3a83-59ef-883a-320713cabb3c, skipping ID generation
2026-03-28 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e094926b-3a83-59ef-883a-320713cabb3c
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKJ19ZRG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KJ19ZRG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002443%27 HTTP/1.1" 200 None
2026-03-28 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002443 not downloaded yet
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002459%27 HTTP/1.1" 200 None
2026-03-28 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002459 not downloaded yet
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002473%27 HTTP/1.1" 200 None
2026-03-28 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002473 not downloaded yet
2026-03-28 22:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146547/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL62VWY/42810894?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=DJfJtw6KwyhBPhnAY9QJ%2FtOYYSvRRaWGTAGIk0DU%2F%2BA%3D)
2026-03-28 22:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057153/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AU02VYG/42810528?sv=2020-08-04&st=2026-03-28T22%3A04%3A21Z&se=2026-03-28T22%3A29%3A21Z&sr=b&sp=r&sig=l%2Fdb%2FB%2BBUeA0SChHayTsd1of3qhKRZHYBa2WamJxH7A%3D)
2026-03-28 22:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994443/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS61FOF/42810605?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=CkwC%2BSn%2FHa5pvfLJnieo5YJn96MqgCZnNQ9bJG2t2ik%3D)
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002486%27 HTTP/1.1" 200 None
2026-03-28 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002486 not downloaded yet
2026-03-28 22:04:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE15URC/42810534?sv=2020-08-04&st=2026-03-28T22%3A04%3A26Z&se=2026-03-28T22%3A29%3A26Z&sr=b&sp=r&sig=lma3%2FQe4ZEzfBc0I050wuFexW2Hoti3SiwIvOwy4V1A%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AE15%20URC-GB>
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002504%27 HTTP/1.1" 200 None
2026-03-28 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002504 not downloaded yet
2026-03-28 22:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057130/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AU02VYG/42810528?sv=2020-08-04&st=2026-03-28T22%3A04%3A21Z&se=2026-03-28T22%3A29%3A21Z&sr=b&sp=r&sig=l%2Fdb%2FB%2BBUeA0SChHayTsd1of3qhKRZHYBa2WamJxH7A%3D)
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543e3610>
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f00ae92-c3a1-5f36-b822-faa77c54fc81/1f00ae92-c3a1-5f36-b822-faa77c54fc81_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAU02VYG%252F699057198%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057198/600 saved to cache
2026-03-28 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1f00ae92-c3a1-5f36-b822-faa77c54fc81
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471c20d0>
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f00ae92-c3a1-5f36-b822-faa77c54fc81/1f00ae92-c3a1-5f36-b822-faa77c54fc81_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAU02VYG%252F699057173%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057173/600 saved to cache
2026-03-28 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1f00ae92-c3a1-5f36-b822-faa77c54fc81
2026-03-28 22:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015743/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA61BFY/42810775?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=tQax5P6adI54twzyoqdok6iIUxSzHDcLDwBb4%2BMoMFw%3D)
2026-03-28 22:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253711/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YF07CJE/42784457?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=oeSdikiuOHhGcviJbgYya0Q8LTDoZVmeFjwoPj3o2js%3D)
2026-03-28 22:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251884/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT64JYY/42807297?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=H09NJ6PkIwPyWfxNOYCddSHeDmQxr4Xr%2FaIklrKjYWY%3D)
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002541%27 HTTP/1.1" 200 None
2026-03-28 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002541 not downloaded yet
2026-03-28 22:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252101/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF19KHM/42806820?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=sr8AUvzfzyG0aLirfPlv3wY7sqotPL2UPVrzrL33HII%3D)
2026-03-28 22:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976518/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY58NPG/42810706?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=m%2BjvjS4%2BeJxyPZhfktFet4Bo%2BpsamHOTjBnjcUc644A%3D)
2026-03-28 22:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146354/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK12WBW/42811322?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=zrDQXpGJ59OXDPhU47QBcrd8BHKRhOWFkFPoLF1d7pk%3D)
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002577%27 HTTP/1.1" 200 None
2026-03-28 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002577 not downloaded yet
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002619%27 HTTP/1.1" 200 None
2026-03-28 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002619 not downloaded yet
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54717f250>
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de1b1d7c-0af9-5140-a37d-505dea797715/de1b1d7c-0af9-5140-a37d-505dea797715_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL62VWY%252F699146547%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146547/600 saved to cache
2026-03-28 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item de1b1d7c-0af9-5140-a37d-505dea797715
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472b0190>
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f00ae92-c3a1-5f36-b822-faa77c54fc81/1f00ae92-c3a1-5f36-b822-faa77c54fc81_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAU02VYG%252F699057153%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057153/600 saved to cache
2026-03-28 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1f00ae92-c3a1-5f36-b822-faa77c54fc81
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549856d0>
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c3dd07d-5304-5ac0-80dc-e30cb298b7d6/5c3dd07d-5304-5ac0-80dc-e30cb298b7d6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS61FOF%252F698994443%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994443/600 saved to cache
2026-03-28 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543153d0>
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f00ae92-c3a1-5f36-b822-faa77c54fc81/1f00ae92-c3a1-5f36-b822-faa77c54fc81_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAU02VYG%252F699057130%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057130/600 saved to cache
2026-03-28 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1f00ae92-c3a1-5f36-b822-faa77c54fc81
2026-03-28 22:04:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f00ae92-c3a1-5f36-b822-faa77c54fc81, skipping ID generation
2026-03-28 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f00ae92-c3a1-5f36-b822-faa77c54fc81 sending to next pipeline
2026-03-28 22:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1f00ae92-c3a1-5f36-b822-faa77c54fc81, identifier: AU02%20VYG
2026-03-28 22:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1f00ae92-c3a1-5f36-b822-faa77c54fc81 with identifier: AU02%20VYG
2026-03-28 22:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1f00ae92-c3a1-5f36-b822-faa77c54fc81 with identifier: AU02%20VYG
2026-03-28 22:04:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1f00ae92-c3a1-5f36-b822-faa77c54fc81 with identifier: AU02%20VYG to the API
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057130/600>
{'auction_title': '',
'c_o_2_emission_value': 181,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f00ae92-c3a1-5f36-b822-faa77c54fc81/1f00ae92-c3a1-5f36-b822-faa77c54fc81_expert_report_file_87b8e3a5-03fc-4b02-b1f4-83698595f150.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AU02%20VYG-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1f00ae92-c3a1-5f36-b822-faa77c54fc81',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AU02 VYG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AU02%20VYG&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'TOYOTA',
'model': 'COROLLA VERSO',
'odometer': 109191,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f00ae92-c3a1-5f36-b822-faa77c54fc81/1f00ae92-c3a1-5f36-b822-faa77c54fc81_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44979,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699056999/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f00ae92-c3a1-5f36-b822-faa77c54fc81/1f00ae92-c3a1-5f36-b822-faa77c54fc81_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44445,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057020/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f00ae92-c3a1-5f36-b822-faa77c54fc81/1f00ae92-c3a1-5f36-b822-faa77c54fc81_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42123,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057041/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f00ae92-c3a1-5f36-b822-faa77c54fc81/1f00ae92-c3a1-5f36-b822-faa77c54fc81_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41323,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057066/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f00ae92-c3a1-5f36-b822-faa77c54fc81/1f00ae92-c3a1-5f36-b822-faa77c54fc81_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40693,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057082/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f00ae92-c3a1-5f36-b822-faa77c54fc81/1f00ae92-c3a1-5f36-b822-faa77c54fc81_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41162,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057108/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f00ae92-c3a1-5f36-b822-faa77c54fc81/1f00ae92-c3a1-5f36-b822-faa77c54fc81_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71015,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057130/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f00ae92-c3a1-5f36-b822-faa77c54fc81/1f00ae92-c3a1-5f36-b822-faa77c54fc81_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67702,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057153/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f00ae92-c3a1-5f36-b822-faa77c54fc81/1f00ae92-c3a1-5f36-b822-faa77c54fc81_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98798,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057173/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f00ae92-c3a1-5f36-b822-faa77c54fc81/1f00ae92-c3a1-5f36-b822-faa77c54fc81_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98020,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AU02VYG/699057198/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-01-01',
'seller_name': None,
'title': 'TOYOTA COROLLA VERSO 1.8 VVTI T SPIRIT MPV',
'transmission': 'manual',
'trim': 'VVTI T SPIRIT',
'vin': 'JTDER28E903032385',
'year': 2002}
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU02%2520VYG%27 HTTP/1.1" 200 None
2026-03-28 22:04:27 [bca.uk] INFO: Saving data for AU02%20VYG: {'created_time': 1774735467.03251, 'last_price_update_time': 1774735467.032522, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AU02%2520VYG') HTTP/1.1" 204 0
2026-03-28 22:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110813/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/B10PGJ/42811203?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=EuD%2Bp1HvVP2JXHqKU%2B8jitx6XlktdJcPsUn2sF2sJ6k%3D)
2026-03-28 22:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002459/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002459>
2026-03-28 22:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253902/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253902>
2026-03-28 22:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023358/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023358>
2026-03-28 22:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002473/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002473>
2026-03-28 22:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002443/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002443>
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002650%27 HTTP/1.1" 200 None
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002650 not downloaded yet
2026-03-28 22:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143413/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ63EXO/42810870?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=wLoUguMiGeygfSRIZDr4SROlj4YBVqcY7mSaCT7eFDc%3D)
2026-03-28 22:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143551/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY14HKC/42811403?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=%2BYxeffQ4HY6floQPvp5Yr65sra111z9jxOTYy7mtf%2FU%3D)
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471a1790>
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4baa05ed-fc6d-5ddf-8f83-9a745e89a05a/4baa05ed-fc6d-5ddf-8f83-9a745e89a05a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA61BFY%252F699015743%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015743/600 saved to cache
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543824d0>
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b77897-c825-556b-ba96-284dc5a81572/56b77897-c825-556b-ba96-284dc5a81572_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYF07CJE%252F699253711%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253711/600 saved to cache
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 56b77897-c825-556b-ba96-284dc5a81572
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544c3390>
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e23659de-a271-571f-ad29-745e3ce94452/e23659de-a271-571f-ad29-745e3ce94452_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT64JYY%252F699251884%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251884/600 saved to cache
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e23659de-a271-571f-ad29-745e3ce94452
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542afcd0>
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ba462d-c70d-5156-b443-d7d5e76250e2/a4ba462d-c70d-5156-b443-d7d5e76250e2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF19KHM%252F699252101%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252101/600 saved to cache
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a4ba462d-c70d-5156-b443-d7d5e76250e2
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544c2e90>
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96f4e7fc-b83e-5062-87d7-e0a26a3eaa65/96f4e7fc-b83e-5062-87d7-e0a26a3eaa65_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY58NPG%252F698976518%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976518/600 saved to cache
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547305cd0>
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5057cc2-c58a-5e78-ab90-b97e6edb6582/c5057cc2-c58a-5e78-ab90-b97e6edb6582_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK12WBW%252F699146354%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146354/600 saved to cache
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5057cc2-c58a-5e78-ab90-b97e6edb6582
2026-03-28 22:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994412/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994412>
2026-03-28 22:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002428/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KJ19ZRG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251871/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251871>
2026-03-28 22:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252326/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252326>
2026-03-28 22:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002504/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002504>
2026-03-28 22:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002541/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002541>
2026-03-28 22:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002486/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002486>
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547307610>
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414fda2b-7a8b-5d29-ad43-b0e99521f4d6/414fda2b-7a8b-5d29-ad43-b0e99521f4d6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FB10PGJ%252F699110813%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110813/600 saved to cache
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 414fda2b-7a8b-5d29-ad43-b0e99521f4d6
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543222d0>
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac2cb512-acf6-577f-a0f2-2fe21a625645/ac2cb512-acf6-577f-a0f2-2fe21a625645_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ63EXO%252F699143413%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143413/600 saved to cache
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac2cb512-acf6-577f-a0f2-2fe21a625645
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544c35d0>
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4878bd96-ecc6-5172-b9f4-32abbb9ae940/4878bd96-ecc6-5172-b9f4-32abbb9ae940_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY14HKC%252F699143551%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143551/600 saved to cache
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4878bd96-ecc6-5172-b9f4-32abbb9ae940
2026-03-28 22:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002443/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ19ZRG/42809537?sv=2020-08-04&st=2026-03-28T22%3A04%3A24Z&se=2026-03-28T22%3A29%3A24Z&sr=b&sp=r&sig=3UPd7KE5L4pnQMco18M4tzymf7e3IFQQNnSy3dZWExo%3D)
2026-03-28 22:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023358/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT69OUG/42810791?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=Rkj%2FxkM1%2BIIgVTIeJOHfQd43I%2FeKECKsCGXnmowEFQk%3D)
2026-03-28 22:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002459/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ19ZRG/42809537?sv=2020-08-04&st=2026-03-28T22%3A04%3A24Z&se=2026-03-28T22%3A29%3A24Z&sr=b&sp=r&sig=3UPd7KE5L4pnQMco18M4tzymf7e3IFQQNnSy3dZWExo%3D)
2026-03-28 22:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002473/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ19ZRG/42809537?sv=2020-08-04&st=2026-03-28T22%3A04%3A24Z&se=2026-03-28T22%3A29%3A24Z&sr=b&sp=r&sig=3UPd7KE5L4pnQMco18M4tzymf7e3IFQQNnSy3dZWExo%3D)
2026-03-28 22:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253902/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP11SXG/42810463?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=qkkbLatUiKU%2BsinzgsPhauDtkraDtbwZc7leOW58DOU%3D)
2026-03-28 22:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002577/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002577>
2026-03-28 22:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002619/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002619>
2026-03-28 22:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE15URC/42810534?sv=2020-08-04&st=2026-03-28T22%3A04%3A26Z&se=2026-03-28T22%3A29%3A26Z&sr=b&sp=r&sig=lma3%2FQe4ZEzfBc0I050wuFexW2Hoti3SiwIvOwy4V1A%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252326/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT12LJZ/42809616?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=ZCqeg%2BtAkN7zfvr8I5qdCyvEoyksA32%2Fdc9lEzPe%2BbI%3D)
2026-03-28 22:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994412/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS61FOF/42810605?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=CkwC%2BSn%2FHa5pvfLJnieo5YJn96MqgCZnNQ9bJG2t2ik%3D)
2026-03-28 22:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251871/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT64JYY/42807297?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=H09NJ6PkIwPyWfxNOYCddSHeDmQxr4Xr%2FaIklrKjYWY%3D)
2026-03-28 22:04:27 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 22:04:27 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 22:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 22:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015712/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015712>
2026-03-28 22:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002541/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ19ZRG/42809537?sv=2020-08-04&st=2026-03-28T22%3A04%3A24Z&se=2026-03-28T22%3A29%3A24Z&sr=b&sp=r&sig=3UPd7KE5L4pnQMco18M4tzymf7e3IFQQNnSy3dZWExo%3D)
2026-03-28 22:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002428/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ19ZRG/42809537?sv=2020-08-04&st=2026-03-28T22%3A04%3A24Z&se=2026-03-28T22%3A29%3A24Z&sr=b&sp=r&sig=3UPd7KE5L4pnQMco18M4tzymf7e3IFQQNnSy3dZWExo%3D)
2026-03-28 22:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002486/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ19ZRG/42809537?sv=2020-08-04&st=2026-03-28T22%3A04%3A24Z&se=2026-03-28T22%3A29%3A24Z&sr=b&sp=r&sig=3UPd7KE5L4pnQMco18M4tzymf7e3IFQQNnSy3dZWExo%3D)
2026-03-28 22:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002504/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ19ZRG/42809537?sv=2020-08-04&st=2026-03-28T22%3A04%3A24Z&se=2026-03-28T22%3A29%3A24Z&sr=b&sp=r&sig=3UPd7KE5L4pnQMco18M4tzymf7e3IFQQNnSy3dZWExo%3D)
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554926e50>
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e094926b-3a83-59ef-883a-320713cabb3c/e094926b-3a83-59ef-883a-320713cabb3c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ19ZRG%252F699002443%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002443/600 saved to cache
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e094926b-3a83-59ef-883a-320713cabb3c
2026-03-28 22:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146542/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146542>
2026-03-28 22:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002650/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002650>
2026-03-28 22:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253698/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253698>
2026-03-28 22:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143401/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143401>
2026-03-28 22:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143527/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143527>
2026-03-28 22:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976491/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976491>
2026-03-28 22:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002619/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ19ZRG/42809537?sv=2020-08-04&st=2026-03-28T22%3A04%3A24Z&se=2026-03-28T22%3A29%3A24Z&sr=b&sp=r&sig=3UPd7KE5L4pnQMco18M4tzymf7e3IFQQNnSy3dZWExo%3D)
2026-03-28 22:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002577/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ19ZRG/42809537?sv=2020-08-04&st=2026-03-28T22%3A04%3A24Z&se=2026-03-28T22%3A29%3A24Z&sr=b&sp=r&sig=3UPd7KE5L4pnQMco18M4tzymf7e3IFQQNnSy3dZWExo%3D)
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b43c90>
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1f5ee4c-4910-54f2-806e-fcee61f2b886/b1f5ee4c-4910-54f2-806e-fcee61f2b886_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT69OUG%252F699023358%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023358/600 saved to cache
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b1f5ee4c-4910-54f2-806e-fcee61f2b886
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544aae10>
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e094926b-3a83-59ef-883a-320713cabb3c/e094926b-3a83-59ef-883a-320713cabb3c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ19ZRG%252F699002459%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002459/600 saved to cache
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e094926b-3a83-59ef-883a-320713cabb3c
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5572a4c90>
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e094926b-3a83-59ef-883a-320713cabb3c/e094926b-3a83-59ef-883a-320713cabb3c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ19ZRG%252F699002473%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002473/600 saved to cache
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e094926b-3a83-59ef-883a-320713cabb3c
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544aa8d0>
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13188273-241e-5122-a324-f170682054c3/13188273-241e-5122-a324-f170682054c3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP11SXG%252F699253902%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253902/600 saved to cache
2026-03-28 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 13188273-241e-5122-a324-f170682054c3
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554318390>
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7208558-825f-54e8-9356-5e2af34b2242/d7208558-825f-54e8-9356-5e2af34b2242_expert_report_file_230b28fb-bbfb-4ea5-b948-c0c2d2394bb3.pdf HTTP/1.1" 201 0
2026-03-28 22:04:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d7208558-825f-54e8-9356-5e2af34b2242
2026-03-28 22:04:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7208558-825f-54e8-9356-5e2af34b2242, skipping ID generation
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7208558-825f-54e8-9356-5e2af34b2242
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAE15URC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AE15URC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544a8d10>
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2a7ebc8-3779-5484-8073-7a1c6fb87969/c2a7ebc8-3779-5484-8073-7a1c6fb87969_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT12LJZ%252F699252326%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252326/600 saved to cache
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c2a7ebc8-3779-5484-8073-7a1c6fb87969
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543baf10>
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c3dd07d-5304-5ac0-80dc-e30cb298b7d6/5c3dd07d-5304-5ac0-80dc-e30cb298b7d6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS61FOF%252F698994412%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994412/600 saved to cache
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472a25d0>
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e23659de-a271-571f-ad29-745e3ce94452/e23659de-a271-571f-ad29-745e3ce94452_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT64JYY%252F699251871%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251871/600 saved to cache
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e23659de-a271-571f-ad29-745e3ce94452
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471adc90>
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e094926b-3a83-59ef-883a-320713cabb3c/e094926b-3a83-59ef-883a-320713cabb3c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ19ZRG%252F699002541%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002541/600 saved to cache
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e094926b-3a83-59ef-883a-320713cabb3c
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547105dd0>
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e094926b-3a83-59ef-883a-320713cabb3c/e094926b-3a83-59ef-883a-320713cabb3c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ19ZRG%252F699002428%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002428/600 saved to cache
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e094926b-3a83-59ef-883a-320713cabb3c
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54747abd0>
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e094926b-3a83-59ef-883a-320713cabb3c/e094926b-3a83-59ef-883a-320713cabb3c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ19ZRG%252F699002486%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002486/600 saved to cache
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e094926b-3a83-59ef-883a-320713cabb3c
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471ae290>
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e094926b-3a83-59ef-883a-320713cabb3c/e094926b-3a83-59ef-883a-320713cabb3c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ19ZRG%252F699002504%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002504/600 saved to cache
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e094926b-3a83-59ef-883a-320713cabb3c
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981027%27 HTTP/1.1" 200 None
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981027 not downloaded yet
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543796d0>
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e094926b-3a83-59ef-883a-320713cabb3c/e094926b-3a83-59ef-883a-320713cabb3c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ19ZRG%252F699002619%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002619/600 saved to cache
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e094926b-3a83-59ef-883a-320713cabb3c
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474e0cd0>
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e094926b-3a83-59ef-883a-320713cabb3c/e094926b-3a83-59ef-883a-320713cabb3c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ19ZRG%252F699002577%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002577/600 saved to cache
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e094926b-3a83-59ef-883a-320713cabb3c
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981048%27 HTTP/1.1" 200 None
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981048 not downloaded yet
2026-03-28 22:04:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146339/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146339>
2026-03-28 22:04:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253898/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253898>
2026-03-28 22:04:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023352/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023352>
2026-03-28 22:04:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV13XGW/42810792?sv=2020-08-04&st=2026-03-28T22%3A04%3A28Z&se=2026-03-28T22%3A29%3A28Z&sr=b&sp=r&sig=eS2LzswHcR38fFGXBJkMxJSHov3%2BLOCla2caVcd2mMQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SV13%20XGW-GB>
2026-03-28 22:04:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252098/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MF19KHM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110801/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=B10PGJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015712/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA61BFY/42810775?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=tQax5P6adI54twzyoqdok6iIUxSzHDcLDwBb4%2BMoMFw%3D)
2026-03-28 22:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976491/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY58NPG/42810706?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=m%2BjvjS4%2BeJxyPZhfktFet4Bo%2BpsamHOTjBnjcUc644A%3D)
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981074%27 HTTP/1.1" 200 None
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981074 not downloaded yet
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981107%27 HTTP/1.1" 200 None
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981107 not downloaded yet
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981136%27 HTTP/1.1" 200 None
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981136 not downloaded yet
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981174%27 HTTP/1.1" 200 None
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981174 not downloaded yet
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981210%27 HTTP/1.1" 200 None
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981210 not downloaded yet
2026-03-28 22:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146542/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL62VWY/42810894?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=DJfJtw6KwyhBPhnAY9QJ%2FtOYYSvRRaWGTAGIk0DU%2F%2BA%3D)
2026-03-28 22:04:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252318/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252318>
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981264%27 HTTP/1.1" 200 None
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981264 not downloaded yet
2026-03-28 22:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143527/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY14HKC/42811403?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=%2BYxeffQ4HY6floQPvp5Yr65sra111z9jxOTYy7mtf%2FU%3D)
2026-03-28 22:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110801/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/B10PGJ/42811203?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=EuD%2Bp1HvVP2JXHqKU%2B8jitx6XlktdJcPsUn2sF2sJ6k%3D)
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981286%27 HTTP/1.1" 200 None
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981286 not downloaded yet
2026-03-28 22:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002650/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KJ19ZRG/42809537?sv=2020-08-04&st=2026-03-28T22%3A04%3A24Z&se=2026-03-28T22%3A29%3A24Z&sr=b&sp=r&sig=3UPd7KE5L4pnQMco18M4tzymf7e3IFQQNnSy3dZWExo%3D)
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54761c3d0>
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4baa05ed-fc6d-5ddf-8f83-9a745e89a05a/4baa05ed-fc6d-5ddf-8f83-9a745e89a05a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA61BFY%252F699015712%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015712/600 saved to cache
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544a8950>
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96f4e7fc-b83e-5062-87d7-e0a26a3eaa65/96f4e7fc-b83e-5062-87d7-e0a26a3eaa65_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY58NPG%252F698976491%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976491/600 saved to cache
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65
2026-03-28 22:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143401/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ63EXO/42810870?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=wLoUguMiGeygfSRIZDr4SROlj4YBVqcY7mSaCT7eFDc%3D)
2026-03-28 22:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253698/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YF07CJE/42784457?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=oeSdikiuOHhGcviJbgYya0Q8LTDoZVmeFjwoPj3o2js%3D)
2026-03-28 22:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252098/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF19KHM/42806820?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=sr8AUvzfzyG0aLirfPlv3wY7sqotPL2UPVrzrL33HII%3D)
2026-03-28 22:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023352/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT69OUG/42810791?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=Rkj%2FxkM1%2BIIgVTIeJOHfQd43I%2FeKECKsCGXnmowEFQk%3D)
2026-03-28 22:04:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994396/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994396>
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547702d50>
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de1b1d7c-0af9-5140-a37d-505dea797715/de1b1d7c-0af9-5140-a37d-505dea797715_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL62VWY%252F699146542%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146542/600 saved to cache
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item de1b1d7c-0af9-5140-a37d-505dea797715
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472a0790>
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4878bd96-ecc6-5172-b9f4-32abbb9ae940/4878bd96-ecc6-5172-b9f4-32abbb9ae940_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY14HKC%252F699143527%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143527/600 saved to cache
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4878bd96-ecc6-5172-b9f4-32abbb9ae940
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542fc3d0>
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414fda2b-7a8b-5d29-ad43-b0e99521f4d6/414fda2b-7a8b-5d29-ad43-b0e99521f4d6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FB10PGJ%252F699110801%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110801/600 saved to cache
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 414fda2b-7a8b-5d29-ad43-b0e99521f4d6
2026-03-28 22:04:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 414fda2b-7a8b-5d29-ad43-b0e99521f4d6, skipping ID generation
2026-03-28 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 414fda2b-7a8b-5d29-ad43-b0e99521f4d6 sending to next pipeline
2026-03-28 22:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 414fda2b-7a8b-5d29-ad43-b0e99521f4d6, identifier: B10%20PGJ
2026-03-28 22:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 414fda2b-7a8b-5d29-ad43-b0e99521f4d6 with identifier: B10%20PGJ
2026-03-28 22:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 414fda2b-7a8b-5d29-ad43-b0e99521f4d6 with identifier: B10%20PGJ
2026-03-28 22:04:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 414fda2b-7a8b-5d29-ad43-b0e99521f4d6 with identifier: B10%20PGJ to the API
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110801/600>
{'auction_title': '',
'c_o_2_emission_value': 254,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414fda2b-7a8b-5d29-ad43-b0e99521f4d6/414fda2b-7a8b-5d29-ad43-b0e99521f4d6_expert_report_file_2b2e7990-5f6e-4969-bbf9-870d1bcf9958.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=B10%20PGJ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '414fda2b-7a8b-5d29-ad43-b0e99521f4d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'B10 PGJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=B10%20PGJ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'JEEP',
'model': 'WRANGLER',
'odometer': 31755,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414fda2b-7a8b-5d29-ad43-b0e99521f4d6/414fda2b-7a8b-5d29-ad43-b0e99521f4d6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43220,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110801/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414fda2b-7a8b-5d29-ad43-b0e99521f4d6/414fda2b-7a8b-5d29-ad43-b0e99521f4d6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42358,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110813/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414fda2b-7a8b-5d29-ad43-b0e99521f4d6/414fda2b-7a8b-5d29-ad43-b0e99521f4d6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41862,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110820/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414fda2b-7a8b-5d29-ad43-b0e99521f4d6/414fda2b-7a8b-5d29-ad43-b0e99521f4d6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42817,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110834/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414fda2b-7a8b-5d29-ad43-b0e99521f4d6/414fda2b-7a8b-5d29-ad43-b0e99521f4d6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42156,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110840/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414fda2b-7a8b-5d29-ad43-b0e99521f4d6/414fda2b-7a8b-5d29-ad43-b0e99521f4d6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40060,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110851/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414fda2b-7a8b-5d29-ad43-b0e99521f4d6/414fda2b-7a8b-5d29-ad43-b0e99521f4d6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87112,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110872/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414fda2b-7a8b-5d29-ad43-b0e99521f4d6/414fda2b-7a8b-5d29-ad43-b0e99521f4d6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73900,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110888/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414fda2b-7a8b-5d29-ad43-b0e99521f4d6/414fda2b-7a8b-5d29-ad43-b0e99521f4d6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92676,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110906/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414fda2b-7a8b-5d29-ad43-b0e99521f4d6/414fda2b-7a8b-5d29-ad43-b0e99521f4d6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94812,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/B10PGJ/699110927/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'JEEP WRANGLER 2.0 GME RUBICON HARD TOP StationWagon',
'transmission': 'automatic',
'trim': 'GME RUBICON HARD TOP',
'vin': '1C4HJXJN8LW174788',
'year': 2021}
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27B10%2520PGJ%27 HTTP/1.1" 200 None
2026-03-28 22:04:29 [bca.uk] INFO: Saving data for B10%20PGJ: {'created_time': 1774735469.402965, 'last_price_update_time': 1774735469.40298, 'auction_closing_time': 1774951200.0}
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='B10%2520PGJ') HTTP/1.1" 204 0
2026-03-28 22:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253898/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP11SXG/42810463?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=qkkbLatUiKU%2BsinzgsPhauDtkraDtbwZc7leOW58DOU%3D)
2026-03-28 22:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252318/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT12LJZ/42809616?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=ZCqeg%2BtAkN7zfvr8I5qdCyvEoyksA32%2Fdc9lEzPe%2BbI%3D)
2026-03-28 22:04:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981210/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981210>
2026-03-28 22:04:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981027/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981027>
2026-03-28 22:04:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981048/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981048>
2026-03-28 22:04:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981174/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981174>
2026-03-28 22:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146339/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK12WBW/42811322?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=zrDQXpGJ59OXDPhU47QBcrd8BHKRhOWFkFPoLF1d7pk%3D)
2026-03-28 22:04:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543790d0>
2026-03-28 22:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e094926b-3a83-59ef-883a-320713cabb3c/e094926b-3a83-59ef-883a-320713cabb3c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKJ19ZRG%252F699002650%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002650/600 saved to cache
2026-03-28 22:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e094926b-3a83-59ef-883a-320713cabb3c
2026-03-28 22:04:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e094926b-3a83-59ef-883a-320713cabb3c, skipping ID generation
2026-03-28 22:04:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e094926b-3a83-59ef-883a-320713cabb3c sending to next pipeline
2026-03-28 22:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e094926b-3a83-59ef-883a-320713cabb3c, identifier: KJ19%20ZRG
2026-03-28 22:04:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547294e50>
2026-03-28 22:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac2cb512-acf6-577f-a0f2-2fe21a625645/ac2cb512-acf6-577f-a0f2-2fe21a625645_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ63EXO%252F699143401%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143401/600 saved to cache
2026-03-28 22:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac2cb512-acf6-577f-a0f2-2fe21a625645
2026-03-28 22:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554915b90>
2026-03-28 22:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b77897-c825-556b-ba96-284dc5a81572/56b77897-c825-556b-ba96-284dc5a81572_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYF07CJE%252F699253698%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253698/600 saved to cache
2026-03-28 22:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 56b77897-c825-556b-ba96-284dc5a81572
2026-03-28 22:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547730810>
2026-03-28 22:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ba462d-c70d-5156-b443-d7d5e76250e2/a4ba462d-c70d-5156-b443-d7d5e76250e2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF19KHM%252F699252098%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252098/600 saved to cache
2026-03-28 22:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a4ba462d-c70d-5156-b443-d7d5e76250e2
2026-03-28 22:04:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a4ba462d-c70d-5156-b443-d7d5e76250e2, skipping ID generation
2026-03-28 22:04:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a4ba462d-c70d-5156-b443-d7d5e76250e2 sending to next pipeline
2026-03-28 22:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a4ba462d-c70d-5156-b443-d7d5e76250e2, identifier: MF19%20KHM
2026-03-28 22:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54761cb90>
2026-03-28 22:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1f5ee4c-4910-54f2-806e-fcee61f2b886/b1f5ee4c-4910-54f2-806e-fcee61f2b886_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT69OUG%252F699023352%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023352/600 saved to cache
2026-03-28 22:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b1f5ee4c-4910-54f2-806e-fcee61f2b886
2026-03-28 22:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e094926b-3a83-59ef-883a-320713cabb3c with identifier: KJ19%20ZRG
2026-03-28 22:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e094926b-3a83-59ef-883a-320713cabb3c with identifier: KJ19%20ZRG
2026-03-28 22:04:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e094926b-3a83-59ef-883a-320713cabb3c with identifier: KJ19%20ZRG to the API
2026-03-28 22:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002650/600>
{'auction_title': '',
'c_o_2_emission_value': 116,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e094926b-3a83-59ef-883a-320713cabb3c/e094926b-3a83-59ef-883a-320713cabb3c_expert_report_file_ec247b6b-d72a-4e85-a3dd-cc72eb622658.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KJ19%20ZRG-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e094926b-3a83-59ef-883a-320713cabb3c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KJ19 ZRG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KJ19%20ZRG&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'SKODA',
'model': 'OCTAVIA',
'odometer': 61989,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e094926b-3a83-59ef-883a-320713cabb3c/e094926b-3a83-59ef-883a-320713cabb3c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53540,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002428/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e094926b-3a83-59ef-883a-320713cabb3c/e094926b-3a83-59ef-883a-320713cabb3c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52126,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002443/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e094926b-3a83-59ef-883a-320713cabb3c/e094926b-3a83-59ef-883a-320713cabb3c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48963,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002459/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e094926b-3a83-59ef-883a-320713cabb3c/e094926b-3a83-59ef-883a-320713cabb3c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47416,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002473/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e094926b-3a83-59ef-883a-320713cabb3c/e094926b-3a83-59ef-883a-320713cabb3c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46984,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002486/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e094926b-3a83-59ef-883a-320713cabb3c/e094926b-3a83-59ef-883a-320713cabb3c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46182,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002504/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e094926b-3a83-59ef-883a-320713cabb3c/e094926b-3a83-59ef-883a-320713cabb3c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93109,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002541/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e094926b-3a83-59ef-883a-320713cabb3c/e094926b-3a83-59ef-883a-320713cabb3c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89596,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002577/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e094926b-3a83-59ef-883a-320713cabb3c/e094926b-3a83-59ef-883a-320713cabb3c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97743,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002619/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e094926b-3a83-59ef-883a-320713cabb3c/e094926b-3a83-59ef-883a-320713cabb3c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84998,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KJ19ZRG/699002650/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'SKODA OCTAVIA 2.0 TDI 184 VRS BLACK DSG7 Hatchback',
'transmission': 'automatic',
'trim': 'TDI 184 VRS BLACK DSG7',
'vin': 'TMBBK7NE1K0195822',
'year': 2019}
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ19%2520ZRG%27 HTTP/1.1" 200 None
2026-03-28 22:04:30 [bca.uk] INFO: Saving data for KJ19%20ZRG: {'created_time': 1774735470.291162, 'last_price_update_time': 1774735470.291172, 'auction_closing_time': 1774951200.0}
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KJ19%2520ZRG') HTTP/1.1" 204 0
2026-03-28 22:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a4ba462d-c70d-5156-b443-d7d5e76250e2 with identifier: MF19%20KHM
2026-03-28 22:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a4ba462d-c70d-5156-b443-d7d5e76250e2 with identifier: MF19%20KHM
2026-03-28 22:04:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a4ba462d-c70d-5156-b443-d7d5e76250e2 with identifier: MF19%20KHM to the API
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252098/600>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ba462d-c70d-5156-b443-d7d5e76250e2/a4ba462d-c70d-5156-b443-d7d5e76250e2_expert_report_file_69e7a85c-745b-4982-9e83-04129b7b9155.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF19%20KHM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a4ba462d-c70d-5156-b443-d7d5e76250e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF19 KHM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MF19%20KHM&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 62510,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ba462d-c70d-5156-b443-d7d5e76250e2/a4ba462d-c70d-5156-b443-d7d5e76250e2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41683,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252098/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ba462d-c70d-5156-b443-d7d5e76250e2/a4ba462d-c70d-5156-b443-d7d5e76250e2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41681,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252101/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ba462d-c70d-5156-b443-d7d5e76250e2/a4ba462d-c70d-5156-b443-d7d5e76250e2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40482,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252107/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ba462d-c70d-5156-b443-d7d5e76250e2/a4ba462d-c70d-5156-b443-d7d5e76250e2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41644,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252112/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ba462d-c70d-5156-b443-d7d5e76250e2/a4ba462d-c70d-5156-b443-d7d5e76250e2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36982,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252120/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ba462d-c70d-5156-b443-d7d5e76250e2/a4ba462d-c70d-5156-b443-d7d5e76250e2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35515,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252126/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ba462d-c70d-5156-b443-d7d5e76250e2/a4ba462d-c70d-5156-b443-d7d5e76250e2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91809,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252137/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ba462d-c70d-5156-b443-d7d5e76250e2/a4ba462d-c70d-5156-b443-d7d5e76250e2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83604,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252150/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ba462d-c70d-5156-b443-d7d5e76250e2/a4ba462d-c70d-5156-b443-d7d5e76250e2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96072,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252161/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ba462d-c70d-5156-b443-d7d5e76250e2/a4ba462d-c70d-5156-b443-d7d5e76250e2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78049,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF19KHM/699252171/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'PEUGEOT 3008 1.5 BLUEHDI 130 GT LINE Hatchback',
'transmission': 'manual',
'trim': 'BLUEHDI 130 GT LINE',
'vin': 'VF3MCYHZJJS487274',
'year': 2019}
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF19%2520KHM%27 HTTP/1.1" 200 None
2026-03-28 22:04:30 [bca.uk] INFO: Saving data for MF19%20KHM: {'created_time': 1774735470.697493, 'last_price_update_time': 1774735470.697504, 'auction_closing_time': 1774951200.0}
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MF19%2520KHM') HTTP/1.1" 204 0
2026-03-28 22:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV13XGW/42810792?sv=2020-08-04&st=2026-03-28T22%3A04%3A28Z&se=2026-03-28T22%3A29%3A28Z&sr=b&sp=r&sig=eS2LzswHcR38fFGXBJkMxJSHov3%2BLOCla2caVcd2mMQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981107/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981107>
2026-03-28 22:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981136/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981136>
2026-03-28 22:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981286/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981286>
2026-03-28 22:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981074/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981074>
2026-03-28 22:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981264/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981264>
2026-03-28 22:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981013/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AE15URC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994396/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS61FOF/42810605?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=CkwC%2BSn%2FHa5pvfLJnieo5YJn96MqgCZnNQ9bJG2t2ik%3D)
2026-03-28 22:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547373ed0>
2026-03-28 22:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13188273-241e-5122-a324-f170682054c3/13188273-241e-5122-a324-f170682054c3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP11SXG%252F699253898%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253898/600 saved to cache
2026-03-28 22:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 13188273-241e-5122-a324-f170682054c3
2026-03-28 22:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b5fd0>
2026-03-28 22:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2a7ebc8-3779-5484-8073-7a1c6fb87969/c2a7ebc8-3779-5484-8073-7a1c6fb87969_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT12LJZ%252F699252318%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252318/600 saved to cache
2026-03-28 22:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c2a7ebc8-3779-5484-8073-7a1c6fb87969
2026-03-28 22:04:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554319650>
2026-03-28 22:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5057cc2-c58a-5e78-ab90-b97e6edb6582/c5057cc2-c58a-5e78-ab90-b97e6edb6582_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK12WBW%252F699146339%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146339/600 saved to cache
2026-03-28 22:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5057cc2-c58a-5e78-ab90-b97e6edb6582
2026-03-28 22:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b52d0>
2026-03-28 22:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4e4f996-7647-5f09-9c47-a666d700954d/e4e4f996-7647-5f09-9c47-a666d700954d_expert_report_file_a12fb57d-cc96-4da2-a230-98c15b4dc352.pdf HTTP/1.1" 201 0
2026-03-28 22:04:30 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e4e4f996-7647-5f09-9c47-a666d700954d
2026-03-28 22:04:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4e4f996-7647-5f09-9c47-a666d700954d, skipping ID generation
2026-03-28 22:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4e4f996-7647-5f09-9c47-a666d700954d
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSV13XGW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SV13XGW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554802bd0>
2026-03-28 22:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c3dd07d-5304-5ac0-80dc-e30cb298b7d6/5c3dd07d-5304-5ac0-80dc-e30cb298b7d6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS61FOF%252F698994396%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994396/600 saved to cache
2026-03-28 22:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6
2026-03-28 22:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981048/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE15URC/42810534?sv=2020-08-04&st=2026-03-28T22%3A04%3A26Z&se=2026-03-28T22%3A29%3A26Z&sr=b&sp=r&sig=lma3%2FQe4ZEzfBc0I050wuFexW2Hoti3SiwIvOwy4V1A%3D)
2026-03-28 22:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981027/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE15URC/42810534?sv=2020-08-04&st=2026-03-28T22%3A04%3A26Z&se=2026-03-28T22%3A29%3A26Z&sr=b&sp=r&sig=lma3%2FQe4ZEzfBc0I050wuFexW2Hoti3SiwIvOwy4V1A%3D)
2026-03-28 22:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981013/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE15URC/42810534?sv=2020-08-04&st=2026-03-28T22%3A04%3A26Z&se=2026-03-28T22%3A29%3A26Z&sr=b&sp=r&sig=lma3%2FQe4ZEzfBc0I050wuFexW2Hoti3SiwIvOwy4V1A%3D)
2026-03-28 22:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015705/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015705>
2026-03-28 22:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146536/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146536>
2026-03-28 22:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251864/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251864>
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D689128533%27 HTTP/1.1" 200 None
2026-03-28 22:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689128533 not downloaded yet
2026-03-28 22:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981210/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE15URC/42810534?sv=2020-08-04&st=2026-03-28T22%3A04%3A26Z&se=2026-03-28T22%3A29%3A26Z&sr=b&sp=r&sig=lma3%2FQe4ZEzfBc0I050wuFexW2Hoti3SiwIvOwy4V1A%3D)
2026-03-28 22:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981174/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE15URC/42810534?sv=2020-08-04&st=2026-03-28T22%3A04%3A26Z&se=2026-03-28T22%3A29%3A26Z&sr=b&sp=r&sig=lma3%2FQe4ZEzfBc0I050wuFexW2Hoti3SiwIvOwy4V1A%3D)
2026-03-28 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D689128547%27 HTTP/1.1" 200 None
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689128547 not downloaded yet
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D689128556%27 HTTP/1.1" 200 None
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689128556 not downloaded yet
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D689128565%27 HTTP/1.1" 200 None
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689128565 not downloaded yet
2026-03-28 22:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981136/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE15URC/42810534?sv=2020-08-04&st=2026-03-28T22%3A04%3A26Z&se=2026-03-28T22%3A29%3A26Z&sr=b&sp=r&sig=lma3%2FQe4ZEzfBc0I050wuFexW2Hoti3SiwIvOwy4V1A%3D)
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D689128582%27 HTTP/1.1" 200 None
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689128582 not downloaded yet
2026-03-28 22:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981107/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE15URC/42810534?sv=2020-08-04&st=2026-03-28T22%3A04%3A26Z&se=2026-03-28T22%3A29%3A26Z&sr=b&sp=r&sig=lma3%2FQe4ZEzfBc0I050wuFexW2Hoti3SiwIvOwy4V1A%3D)
2026-03-28 22:04:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253692/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253692>
2026-03-28 22:04:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143387/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143387>
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D689128600%27 HTTP/1.1" 200 None
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689128600 not downloaded yet
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477edb50>
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7208558-825f-54e8-9356-5e2af34b2242/d7208558-825f-54e8-9356-5e2af34b2242_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE15URC%252F698981048%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981048/600 saved to cache
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d7208558-825f-54e8-9356-5e2af34b2242
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472a30d0>
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7208558-825f-54e8-9356-5e2af34b2242/d7208558-825f-54e8-9356-5e2af34b2242_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE15URC%252F698981027%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981027/600 saved to cache
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d7208558-825f-54e8-9356-5e2af34b2242
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547756190>
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7208558-825f-54e8-9356-5e2af34b2242/d7208558-825f-54e8-9356-5e2af34b2242_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE15URC%252F698981013%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981013/600 saved to cache
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7208558-825f-54e8-9356-5e2af34b2242
2026-03-28 22:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981074/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE15URC/42810534?sv=2020-08-04&st=2026-03-28T22%3A04%3A26Z&se=2026-03-28T22%3A29%3A26Z&sr=b&sp=r&sig=lma3%2FQe4ZEzfBc0I050wuFexW2Hoti3SiwIvOwy4V1A%3D)
2026-03-28 22:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981264/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE15URC/42810534?sv=2020-08-04&st=2026-03-28T22%3A04%3A26Z&se=2026-03-28T22%3A29%3A26Z&sr=b&sp=r&sig=lma3%2FQe4ZEzfBc0I050wuFexW2Hoti3SiwIvOwy4V1A%3D)
2026-03-28 22:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981286/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE15URC/42810534?sv=2020-08-04&st=2026-03-28T22%3A04%3A26Z&se=2026-03-28T22%3A29%3A26Z&sr=b&sp=r&sig=lma3%2FQe4ZEzfBc0I050wuFexW2Hoti3SiwIvOwy4V1A%3D)
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D689128625%27 HTTP/1.1" 200 None
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689128625 not downloaded yet
2026-03-28 22:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251864/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT64JYY/42807297?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=H09NJ6PkIwPyWfxNOYCddSHeDmQxr4Xr%2FaIklrKjYWY%3D)
2026-03-28 22:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146536/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL62VWY/42810894?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=DJfJtw6KwyhBPhnAY9QJ%2FtOYYSvRRaWGTAGIk0DU%2F%2BA%3D)
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D689128665%27 HTTP/1.1" 200 None
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689128665 not downloaded yet
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D689128691%27 HTTP/1.1" 200 None
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689128691 not downloaded yet
2026-03-28 22:04:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54761f450>
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7208558-825f-54e8-9356-5e2af34b2242/d7208558-825f-54e8-9356-5e2af34b2242_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE15URC%252F698981210%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981210/600 saved to cache
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d7208558-825f-54e8-9356-5e2af34b2242
2026-03-28 22:04:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547169d10>
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7208558-825f-54e8-9356-5e2af34b2242/d7208558-825f-54e8-9356-5e2af34b2242_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE15URC%252F698981174%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981174/600 saved to cache
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d7208558-825f-54e8-9356-5e2af34b2242
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54715a5d0>
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7208558-825f-54e8-9356-5e2af34b2242/d7208558-825f-54e8-9356-5e2af34b2242_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE15URC%252F698981136%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981136/600 saved to cache
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d7208558-825f-54e8-9356-5e2af34b2242
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54716b490>
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7208558-825f-54e8-9356-5e2af34b2242/d7208558-825f-54e8-9356-5e2af34b2242_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE15URC%252F698981107%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981107/600 saved to cache
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d7208558-825f-54e8-9356-5e2af34b2242
2026-03-28 22:04:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976472/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976472>
2026-03-28 22:04:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128516/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SV13XGW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015705/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA61BFY/42810775?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=tQax5P6adI54twzyoqdok6iIUxSzHDcLDwBb4%2BMoMFw%3D)
2026-03-28 22:04:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146324/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146324>
2026-03-28 22:04:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WM66HPY/42811136?sv=2020-08-04&st=2026-03-28T22%3A04%3A31Z&se=2026-03-28T22%3A29%3A31Z&sr=b&sp=r&sig=sXYRigPpSnWc%2FEZZOPShUy%2B9XgkE6pqm32sEVFPKdlE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WM66%20HPY-GB>
2026-03-28 22:04:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128565/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689128565>
2026-03-28 22:04:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143507/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143507>
2026-03-28 22:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143387/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ63EXO/42810870?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=wLoUguMiGeygfSRIZDr4SROlj4YBVqcY7mSaCT7eFDc%3D)
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547487e50>
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7208558-825f-54e8-9356-5e2af34b2242/d7208558-825f-54e8-9356-5e2af34b2242_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE15URC%252F698981074%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981074/600 saved to cache
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d7208558-825f-54e8-9356-5e2af34b2242
2026-03-28 22:04:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b37090>
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7208558-825f-54e8-9356-5e2af34b2242/d7208558-825f-54e8-9356-5e2af34b2242_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE15URC%252F698981264%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981264/600 saved to cache
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d7208558-825f-54e8-9356-5e2af34b2242
2026-03-28 22:04:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54715a6d0>
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7208558-825f-54e8-9356-5e2af34b2242/d7208558-825f-54e8-9356-5e2af34b2242_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE15URC%252F698981286%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981286/600 saved to cache
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d7208558-825f-54e8-9356-5e2af34b2242
2026-03-28 22:04:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7208558-825f-54e8-9356-5e2af34b2242, skipping ID generation
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7208558-825f-54e8-9356-5e2af34b2242 sending to next pipeline
2026-03-28 22:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d7208558-825f-54e8-9356-5e2af34b2242, identifier: AE15%20URC
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554907cd0>
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e23659de-a271-571f-ad29-745e3ce94452/e23659de-a271-571f-ad29-745e3ce94452_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT64JYY%252F699251864%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251864/600 saved to cache
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e23659de-a271-571f-ad29-745e3ce94452
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54762aa10>
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de1b1d7c-0af9-5140-a37d-505dea797715/de1b1d7c-0af9-5140-a37d-505dea797715_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL62VWY%252F699146536%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146536/600 saved to cache
2026-03-28 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de1b1d7c-0af9-5140-a37d-505dea797715
2026-03-28 22:04:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d7208558-825f-54e8-9356-5e2af34b2242 with identifier: AE15%20URC
2026-03-28 22:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d7208558-825f-54e8-9356-5e2af34b2242 with identifier: AE15%20URC
2026-03-28 22:04:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d7208558-825f-54e8-9356-5e2af34b2242 with identifier: AE15%20URC to the API
2026-03-28 22:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981286/600>
{'auction_title': '',
'c_o_2_emission_value': 185,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7208558-825f-54e8-9356-5e2af34b2242/d7208558-825f-54e8-9356-5e2af34b2242_expert_report_file_230b28fb-bbfb-4ea5-b948-c0c2d2394bb3.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AE15%20URC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd7208558-825f-54e8-9356-5e2af34b2242',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AE15 URC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AE15%20URC&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 139838,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7208558-825f-54e8-9356-5e2af34b2242/d7208558-825f-54e8-9356-5e2af34b2242_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41006,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981013/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7208558-825f-54e8-9356-5e2af34b2242/d7208558-825f-54e8-9356-5e2af34b2242_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39860,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981027/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7208558-825f-54e8-9356-5e2af34b2242/d7208558-825f-54e8-9356-5e2af34b2242_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40261,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981048/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7208558-825f-54e8-9356-5e2af34b2242/d7208558-825f-54e8-9356-5e2af34b2242_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41369,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981074/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7208558-825f-54e8-9356-5e2af34b2242/d7208558-825f-54e8-9356-5e2af34b2242_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36711,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981107/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7208558-825f-54e8-9356-5e2af34b2242/d7208558-825f-54e8-9356-5e2af34b2242_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33610,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981136/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7208558-825f-54e8-9356-5e2af34b2242/d7208558-825f-54e8-9356-5e2af34b2242_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84660,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981174/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7208558-825f-54e8-9356-5e2af34b2242/d7208558-825f-54e8-9356-5e2af34b2242_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79646,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981210/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7208558-825f-54e8-9356-5e2af34b2242/d7208558-825f-54e8-9356-5e2af34b2242_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94396,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981264/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7208558-825f-54e8-9356-5e2af34b2242/d7208558-825f-54e8-9356-5e2af34b2242_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76065,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE15URC/698981286/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 3.0 SDV6 HSE StationWagon',
'transmission': 'manual',
'trim': 'SDV6 HSE',
'vin': 'SALWA2KE4FA523223',
'year': 2015}
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE15%2520URC%27 HTTP/1.1" 200 None
2026-03-28 22:04:32 [bca.uk] INFO: Saving data for AE15%20URC: {'created_time': 1774735472.193803, 'last_price_update_time': 1774735472.193817, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AE15%2520URC') HTTP/1.1" 204 0
2026-03-28 22:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128582/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689128582>
2026-03-28 22:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128556/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689128556>
2026-03-28 22:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128547/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689128547>
2026-03-28 22:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023337/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DT69OUG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128600/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689128600>
2026-03-28 22:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128533/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689128533>
2026-03-28 22:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253692/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YF07CJE/42784457?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=oeSdikiuOHhGcviJbgYya0Q8LTDoZVmeFjwoPj3o2js%3D)
2026-03-28 22:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143507/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY14HKC/42811403?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=%2BYxeffQ4HY6floQPvp5Yr65sra111z9jxOTYy7mtf%2FU%3D)
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54710c390>
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4baa05ed-fc6d-5ddf-8f83-9a745e89a05a/4baa05ed-fc6d-5ddf-8f83-9a745e89a05a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA61BFY%252F699015705%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015705/600 saved to cache
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a
2026-03-28 22:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b3a810>
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac2cb512-acf6-577f-a0f2-2fe21a625645/ac2cb512-acf6-577f-a0f2-2fe21a625645_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ63EXO%252F699143387%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143387/600 saved to cache
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac2cb512-acf6-577f-a0f2-2fe21a625645
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55437af90>
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b77897-c825-556b-ba96-284dc5a81572/56b77897-c825-556b-ba96-284dc5a81572_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYF07CJE%252F699253692%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253692/600 saved to cache
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 56b77897-c825-556b-ba96-284dc5a81572
2026-03-28 22:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128665/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689128665>
2026-03-28 22:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477337d0>
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4878bd96-ecc6-5172-b9f4-32abbb9ae940/4878bd96-ecc6-5172-b9f4-32abbb9ae940_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY14HKC%252F699143507%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143507/600 saved to cache
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4878bd96-ecc6-5172-b9f4-32abbb9ae940
2026-03-28 22:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128691/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689128691>
2026-03-28 22:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128565/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV13XGW/42810792?sv=2020-08-04&st=2026-03-28T22%3A04%3A28Z&se=2026-03-28T22%3A29%3A28Z&sr=b&sp=r&sig=eS2LzswHcR38fFGXBJkMxJSHov3%2BLOCla2caVcd2mMQ%3D)
2026-03-28 22:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128516/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV13XGW/42810792?sv=2020-08-04&st=2026-03-28T22%3A04%3A28Z&se=2026-03-28T22%3A29%3A28Z&sr=b&sp=r&sig=eS2LzswHcR38fFGXBJkMxJSHov3%2BLOCla2caVcd2mMQ%3D)
2026-03-28 22:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976472/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY58NPG/42810706?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=m%2BjvjS4%2BeJxyPZhfktFet4Bo%2BpsamHOTjBnjcUc644A%3D)
2026-03-28 22:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146324/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK12WBW/42811322?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=zrDQXpGJ59OXDPhU47QBcrd8BHKRhOWFkFPoLF1d7pk%3D)
2026-03-28 22:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128533/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV13XGW/42810792?sv=2020-08-04&st=2026-03-28T22%3A04%3A28Z&se=2026-03-28T22%3A29%3A28Z&sr=b&sp=r&sig=eS2LzswHcR38fFGXBJkMxJSHov3%2BLOCla2caVcd2mMQ%3D)
2026-03-28 22:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128582/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV13XGW/42810792?sv=2020-08-04&st=2026-03-28T22%3A04%3A28Z&se=2026-03-28T22%3A29%3A28Z&sr=b&sp=r&sig=eS2LzswHcR38fFGXBJkMxJSHov3%2BLOCla2caVcd2mMQ%3D)
2026-03-28 22:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128625/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=689128625>
2026-03-28 22:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253885/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253885>
2026-03-28 22:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128547/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV13XGW/42810792?sv=2020-08-04&st=2026-03-28T22%3A04%3A28Z&se=2026-03-28T22%3A29%3A28Z&sr=b&sp=r&sig=eS2LzswHcR38fFGXBJkMxJSHov3%2BLOCla2caVcd2mMQ%3D)
2026-03-28 22:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128556/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV13XGW/42810792?sv=2020-08-04&st=2026-03-28T22%3A04%3A28Z&se=2026-03-28T22%3A29%3A28Z&sr=b&sp=r&sig=eS2LzswHcR38fFGXBJkMxJSHov3%2BLOCla2caVcd2mMQ%3D)
2026-03-28 22:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023337/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT69OUG/42810791?sv=2020-08-04&st=2026-03-28T22%3A03%3A21Z&se=2026-03-28T22%3A28%3A21Z&sr=b&sp=r&sig=Rkj%2FxkM1%2BIIgVTIeJOHfQd43I%2FeKECKsCGXnmowEFQk%3D)
2026-03-28 22:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WM66HPY/42811136?sv=2020-08-04&st=2026-03-28T22%3A04%3A31Z&se=2026-03-28T22%3A29%3A31Z&sr=b&sp=r&sig=sXYRigPpSnWc%2FEZZOPShUy%2B9XgkE6pqm32sEVFPKdlE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128600/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV13XGW/42810792?sv=2020-08-04&st=2026-03-28T22%3A04%3A28Z&se=2026-03-28T22%3A29%3A28Z&sr=b&sp=r&sig=eS2LzswHcR38fFGXBJkMxJSHov3%2BLOCla2caVcd2mMQ%3D)
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543e9f90>
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4e4f996-7647-5f09-9c47-a666d700954d/e4e4f996-7647-5f09-9c47-a666d700954d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV13XGW%252F689128565%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128565/600 saved to cache
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e4e4f996-7647-5f09-9c47-a666d700954d
2026-03-28 22:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994383/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994383>
2026-03-28 22:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252310/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252310>
2026-03-28 22:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251857/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251857>
2026-03-28 22:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015697/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015697>
2026-03-28 22:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146529/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146529>
2026-03-28 22:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253681/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253681>
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b3a750>
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4e4f996-7647-5f09-9c47-a666d700954d/e4e4f996-7647-5f09-9c47-a666d700954d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV13XGW%252F689128516%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128516/600 saved to cache
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4e4f996-7647-5f09-9c47-a666d700954d
2026-03-28 22:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128665/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV13XGW/42810792?sv=2020-08-04&st=2026-03-28T22%3A04%3A28Z&se=2026-03-28T22%3A29%3A28Z&sr=b&sp=r&sig=eS2LzswHcR38fFGXBJkMxJSHov3%2BLOCla2caVcd2mMQ%3D)
2026-03-28 22:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128691/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV13XGW/42810792?sv=2020-08-04&st=2026-03-28T22%3A04%3A28Z&se=2026-03-28T22%3A29%3A28Z&sr=b&sp=r&sig=eS2LzswHcR38fFGXBJkMxJSHov3%2BLOCla2caVcd2mMQ%3D)
2026-03-28 22:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548f7710>
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96f4e7fc-b83e-5062-87d7-e0a26a3eaa65/96f4e7fc-b83e-5062-87d7-e0a26a3eaa65_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY58NPG%252F698976472%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976472/600 saved to cache
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65
2026-03-28 22:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548ba7d0>
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5057cc2-c58a-5e78-ab90-b97e6edb6582/c5057cc2-c58a-5e78-ab90-b97e6edb6582_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK12WBW%252F699146324%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146324/600 saved to cache
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5057cc2-c58a-5e78-ab90-b97e6edb6582
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554830250>
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4e4f996-7647-5f09-9c47-a666d700954d/e4e4f996-7647-5f09-9c47-a666d700954d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV13XGW%252F689128533%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128533/600 saved to cache
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e4e4f996-7647-5f09-9c47-a666d700954d
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474b9990>
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4e4f996-7647-5f09-9c47-a666d700954d/e4e4f996-7647-5f09-9c47-a666d700954d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV13XGW%252F689128582%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128582/600 saved to cache
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e4e4f996-7647-5f09-9c47-a666d700954d
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54710f190>
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4e4f996-7647-5f09-9c47-a666d700954d/e4e4f996-7647-5f09-9c47-a666d700954d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV13XGW%252F689128547%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128547/600 saved to cache
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e4e4f996-7647-5f09-9c47-a666d700954d
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548ba610>
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4e4f996-7647-5f09-9c47-a666d700954d/e4e4f996-7647-5f09-9c47-a666d700954d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV13XGW%252F689128556%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128556/600 saved to cache
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e4e4f996-7647-5f09-9c47-a666d700954d
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554830190>
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1f5ee4c-4910-54f2-806e-fcee61f2b886/b1f5ee4c-4910-54f2-806e-fcee61f2b886_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT69OUG%252F699023337%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023337/600 saved to cache
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1f5ee4c-4910-54f2-806e-fcee61f2b886
2026-03-28 22:04:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1f5ee4c-4910-54f2-806e-fcee61f2b886, skipping ID generation
2026-03-28 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1f5ee4c-4910-54f2-806e-fcee61f2b886 sending to next pipeline
2026-03-28 22:04:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b1f5ee4c-4910-54f2-806e-fcee61f2b886, identifier: DT69%20OUG
2026-03-28 22:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557379650>
2026-03-28 22:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe/f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe_expert_report_file_cb21125a-b634-428c-83b2-9a59dc9ba86b.pdf HTTP/1.1" 201 0
2026-03-28 22:04:33 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe
2026-03-28 22:04:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe, skipping ID generation
2026-03-28 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWM66HPY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WM66HPY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547628790>
2026-03-28 22:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4e4f996-7647-5f09-9c47-a666d700954d/e4e4f996-7647-5f09-9c47-a666d700954d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV13XGW%252F689128600%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128600/600 saved to cache
2026-03-28 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e4e4f996-7647-5f09-9c47-a666d700954d
2026-03-28 22:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253885/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP11SXG/42810463?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=qkkbLatUiKU%2BsinzgsPhauDtkraDtbwZc7leOW58DOU%3D)
2026-03-28 22:04:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143490/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143490>
2026-03-28 22:04:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146306/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146306>
2026-03-28 22:04:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143370/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143370>
2026-03-28 22:04:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976442/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976442>
2026-03-28 22:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b1f5ee4c-4910-54f2-806e-fcee61f2b886 with identifier: DT69%20OUG
2026-03-28 22:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b1f5ee4c-4910-54f2-806e-fcee61f2b886 with identifier: DT69%20OUG
2026-03-28 22:04:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b1f5ee4c-4910-54f2-806e-fcee61f2b886 with identifier: DT69%20OUG to the API
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023337/600>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1f5ee4c-4910-54f2-806e-fcee61f2b886/b1f5ee4c-4910-54f2-806e-fcee61f2b886_expert_report_file_72511c2a-952c-4ddc-95fa-c42d782d1d5a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DT69%20OUG-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b1f5ee4c-4910-54f2-806e-fcee61f2b886',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DT69 OUG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DT69%20OUG&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 22392,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1f5ee4c-4910-54f2-806e-fcee61f2b886/b1f5ee4c-4910-54f2-806e-fcee61f2b886_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41173,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023337/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1f5ee4c-4910-54f2-806e-fcee61f2b886/b1f5ee4c-4910-54f2-806e-fcee61f2b886_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39728,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023352/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1f5ee4c-4910-54f2-806e-fcee61f2b886/b1f5ee4c-4910-54f2-806e-fcee61f2b886_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40762,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023358/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1f5ee4c-4910-54f2-806e-fcee61f2b886/b1f5ee4c-4910-54f2-806e-fcee61f2b886_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42231,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023373/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1f5ee4c-4910-54f2-806e-fcee61f2b886/b1f5ee4c-4910-54f2-806e-fcee61f2b886_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37634,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023391/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1f5ee4c-4910-54f2-806e-fcee61f2b886/b1f5ee4c-4910-54f2-806e-fcee61f2b886_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35092,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023402/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1f5ee4c-4910-54f2-806e-fcee61f2b886/b1f5ee4c-4910-54f2-806e-fcee61f2b886_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94706,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023424/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1f5ee4c-4910-54f2-806e-fcee61f2b886/b1f5ee4c-4910-54f2-806e-fcee61f2b886_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93208,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023451/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1f5ee4c-4910-54f2-806e-fcee61f2b886/b1f5ee4c-4910-54f2-806e-fcee61f2b886_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101065,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023479/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1f5ee4c-4910-54f2-806e-fcee61f2b886/b1f5ee4c-4910-54f2-806e-fcee61f2b886_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87731,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT69OUG/699023499/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.2 TURBO 145 SRI Hatchback',
'transmission': 'manual',
'trim': 'TURBO 145 SRI',
'vin': 'W0VBF6EW6LG010248',
'year': 2020}
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT69%2520OUG%27 HTTP/1.1" 200 None
2026-03-28 22:04:33 [bca.uk] INFO: Saving data for DT69%20OUG: {'created_time': 1774735473.785976, 'last_price_update_time': 1774735473.78599, 'auction_closing_time': 1774951200.0}
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DT69%2520OUG') HTTP/1.1" 204 0
2026-03-28 22:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128625/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV13XGW/42810792?sv=2020-08-04&st=2026-03-28T22%3A04%3A28Z&se=2026-03-28T22%3A29%3A28Z&sr=b&sp=r&sig=eS2LzswHcR38fFGXBJkMxJSHov3%2BLOCla2caVcd2mMQ%3D)
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082675%27 HTTP/1.1" 200 None
2026-03-28 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082675 not downloaded yet
2026-03-28 22:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253681/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YF07CJE/42784457?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=oeSdikiuOHhGcviJbgYya0Q8LTDoZVmeFjwoPj3o2js%3D)
2026-03-28 22:04:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU67KTN/42810831?sv=2020-08-04&st=2026-03-28T22%3A04%3A33Z&se=2026-03-28T22%3A29%3A33Z&sr=b&sp=r&sig=AjZdvh35Dwjd77tZDhaGUD7kU%2BX6C4A1ZckHUS7%2Fs2Y%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BU67%20KTN-GB>
2026-03-28 22:04:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fa8190>
2026-03-28 22:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4e4f996-7647-5f09-9c47-a666d700954d/e4e4f996-7647-5f09-9c47-a666d700954d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV13XGW%252F689128665%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128665/600 saved to cache
2026-03-28 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e4e4f996-7647-5f09-9c47-a666d700954d
2026-03-28 22:04:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547450710>
2026-03-28 22:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4e4f996-7647-5f09-9c47-a666d700954d/e4e4f996-7647-5f09-9c47-a666d700954d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV13XGW%252F689128691%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128691/600 saved to cache
2026-03-28 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e4e4f996-7647-5f09-9c47-a666d700954d
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082690%27 HTTP/1.1" 200 None
2026-03-28 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082690 not downloaded yet
2026-03-28 22:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252310/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT12LJZ/42809616?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=ZCqeg%2BtAkN7zfvr8I5qdCyvEoyksA32%2Fdc9lEzPe%2BbI%3D)
2026-03-28 22:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994383/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS61FOF/42810605?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=CkwC%2BSn%2FHa5pvfLJnieo5YJn96MqgCZnNQ9bJG2t2ik%3D)
2026-03-28 22:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015697/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA61BFY/42810775?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=tQax5P6adI54twzyoqdok6iIUxSzHDcLDwBb4%2BMoMFw%3D)
2026-03-28 22:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b77f90>
2026-03-28 22:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13188273-241e-5122-a324-f170682054c3/13188273-241e-5122-a324-f170682054c3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP11SXG%252F699253885%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253885/600 saved to cache
2026-03-28 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 13188273-241e-5122-a324-f170682054c3
2026-03-28 22:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251857/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT64JYY/42807297?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=H09NJ6PkIwPyWfxNOYCddSHeDmQxr4Xr%2FaIklrKjYWY%3D)
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082697%27 HTTP/1.1" 200 None
2026-03-28 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082697 not downloaded yet
2026-03-28 22:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146529/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL62VWY/42810894?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=DJfJtw6KwyhBPhnAY9QJ%2FtOYYSvRRaWGTAGIk0DU%2F%2BA%3D)
2026-03-28 22:04:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253881/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253881>
2026-03-28 22:04:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252304/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252304>
2026-03-28 22:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976442/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY58NPG/42810706?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=m%2BjvjS4%2BeJxyPZhfktFet4Bo%2BpsamHOTjBnjcUc644A%3D)
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082713%27 HTTP/1.1" 200 None
2026-03-28 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082713 not downloaded yet
2026-03-28 22:04:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b76c10>
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4e4f996-7647-5f09-9c47-a666d700954d/e4e4f996-7647-5f09-9c47-a666d700954d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV13XGW%252F689128625%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128625/600 saved to cache
2026-03-28 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e4e4f996-7647-5f09-9c47-a666d700954d
2026-03-28 22:04:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4e4f996-7647-5f09-9c47-a666d700954d, skipping ID generation
2026-03-28 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4e4f996-7647-5f09-9c47-a666d700954d sending to next pipeline
2026-03-28 22:04:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e4e4f996-7647-5f09-9c47-a666d700954d, identifier: SV13%20XGW
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556f63650>
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b77897-c825-556b-ba96-284dc5a81572/56b77897-c825-556b-ba96-284dc5a81572_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYF07CJE%252F699253681%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253681/600 saved to cache
2026-03-28 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 56b77897-c825-556b-ba96-284dc5a81572
2026-03-28 22:04:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e4e4f996-7647-5f09-9c47-a666d700954d with identifier: SV13%20XGW
2026-03-28 22:04:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e4e4f996-7647-5f09-9c47-a666d700954d with identifier: SV13%20XGW
2026-03-28 22:04:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e4e4f996-7647-5f09-9c47-a666d700954d with identifier: SV13%20XGW to the API
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128625/600>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4e4f996-7647-5f09-9c47-a666d700954d/e4e4f996-7647-5f09-9c47-a666d700954d_expert_report_file_a12fb57d-cc96-4da2-a230-98c15b4dc352.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SV13%20XGW-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e4e4f996-7647-5f09-9c47-a666d700954d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SV13 XGW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SV13%20XGW&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 90532,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4e4f996-7647-5f09-9c47-a666d700954d/e4e4f996-7647-5f09-9c47-a666d700954d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47226,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128516/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4e4f996-7647-5f09-9c47-a666d700954d/e4e4f996-7647-5f09-9c47-a666d700954d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46702,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128533/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4e4f996-7647-5f09-9c47-a666d700954d/e4e4f996-7647-5f09-9c47-a666d700954d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45805,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128547/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4e4f996-7647-5f09-9c47-a666d700954d/e4e4f996-7647-5f09-9c47-a666d700954d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45747,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128556/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4e4f996-7647-5f09-9c47-a666d700954d/e4e4f996-7647-5f09-9c47-a666d700954d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46453,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128565/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4e4f996-7647-5f09-9c47-a666d700954d/e4e4f996-7647-5f09-9c47-a666d700954d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45575,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128582/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4e4f996-7647-5f09-9c47-a666d700954d/e4e4f996-7647-5f09-9c47-a666d700954d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95433,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128600/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4e4f996-7647-5f09-9c47-a666d700954d/e4e4f996-7647-5f09-9c47-a666d700954d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68526,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128625/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4e4f996-7647-5f09-9c47-a666d700954d/e4e4f996-7647-5f09-9c47-a666d700954d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76583,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128665/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4e4f996-7647-5f09-9c47-a666d700954d/e4e4f996-7647-5f09-9c47-a666d700954d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86596,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV13XGW/689128691/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 16V ENERGY Hatchback',
'transmission': 'manual',
'trim': '16V ENERGY',
'vin': 'W0L0SDL68D4152369',
'year': 2013}
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV13%2520XGW%27 HTTP/1.1" 200 None
2026-03-28 22:04:34 [bca.uk] INFO: Saving data for SV13%20XGW: {'created_time': 1774735474.591685, 'last_price_update_time': 1774735474.591696, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SV13%2520XGW') HTTP/1.1" 204 0
2026-03-28 22:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994369/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994369>
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082723%27 HTTP/1.1" 200 None
2026-03-28 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082723 not downloaded yet
2026-03-28 22:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082675/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082675>
2026-03-28 22:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251849/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251849>
2026-03-28 22:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082666/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WM66HPY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143370/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ63EXO/42810870?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=wLoUguMiGeygfSRIZDr4SROlj4YBVqcY7mSaCT7eFDc%3D)
2026-03-28 22:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143490/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY14HKC/42811403?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=%2BYxeffQ4HY6floQPvp5Yr65sra111z9jxOTYy7mtf%2FU%3D)
2026-03-28 22:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146306/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK12WBW/42811322?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=zrDQXpGJ59OXDPhU47QBcrd8BHKRhOWFkFPoLF1d7pk%3D)
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082740%27 HTTP/1.1" 200 None
2026-03-28 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082740 not downloaded yet
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556fafcd0>
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2a7ebc8-3779-5484-8073-7a1c6fb87969/c2a7ebc8-3779-5484-8073-7a1c6fb87969_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT12LJZ%252F699252310%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252310/600 saved to cache
2026-03-28 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c2a7ebc8-3779-5484-8073-7a1c6fb87969
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b35b10>
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c3dd07d-5304-5ac0-80dc-e30cb298b7d6/5c3dd07d-5304-5ac0-80dc-e30cb298b7d6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS61FOF%252F698994383%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994383/600 saved to cache
2026-03-28 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547304bd0>
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4baa05ed-fc6d-5ddf-8f83-9a745e89a05a/4baa05ed-fc6d-5ddf-8f83-9a745e89a05a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA61BFY%252F699015697%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015697/600 saved to cache
2026-03-28 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55749aa10>
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e23659de-a271-571f-ad29-745e3ce94452/e23659de-a271-571f-ad29-745e3ce94452_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT64JYY%252F699251857%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251857/600 saved to cache
2026-03-28 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e23659de-a271-571f-ad29-745e3ce94452
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554203ed0>
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de1b1d7c-0af9-5140-a37d-505dea797715/de1b1d7c-0af9-5140-a37d-505dea797715_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL62VWY%252F699146529%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146529/600 saved to cache
2026-03-28 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de1b1d7c-0af9-5140-a37d-505dea797715
2026-03-28 22:04:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5541fc7d0>
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96f4e7fc-b83e-5062-87d7-e0a26a3eaa65/96f4e7fc-b83e-5062-87d7-e0a26a3eaa65_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY58NPG%252F698976442%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976442/600 saved to cache
2026-03-28 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65
2026-03-28 22:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU67KTN/42810831?sv=2020-08-04&st=2026-03-28T22%3A04%3A33Z&se=2026-03-28T22%3A29%3A33Z&sr=b&sp=r&sig=AjZdvh35Dwjd77tZDhaGUD7kU%2BX6C4A1ZckHUS7%2Fs2Y%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082753%27 HTTP/1.1" 200 None
2026-03-28 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082753 not downloaded yet
2026-03-28 22:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252304/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT12LJZ/42809616?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=ZCqeg%2BtAkN7zfvr8I5qdCyvEoyksA32%2Fdc9lEzPe%2BbI%3D)
2026-03-28 22:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082697/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082697>
2026-03-28 22:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146523/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146523>
2026-03-28 22:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253672/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253672>
2026-03-28 22:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015693/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015693>
2026-03-28 22:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082690/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082690>
2026-03-28 22:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253881/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP11SXG/42810463?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=qkkbLatUiKU%2BsinzgsPhauDtkraDtbwZc7leOW58DOU%3D)
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082765%27 HTTP/1.1" 200 None
2026-03-28 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082765 not downloaded yet
2026-03-28 22:04:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5572a1890>
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac2cb512-acf6-577f-a0f2-2fe21a625645/ac2cb512-acf6-577f-a0f2-2fe21a625645_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ63EXO%252F699143370%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143370/600 saved to cache
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac2cb512-acf6-577f-a0f2-2fe21a625645
2026-03-28 22:04:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54723a490>
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4878bd96-ecc6-5172-b9f4-32abbb9ae940/4878bd96-ecc6-5172-b9f4-32abbb9ae940_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY14HKC%252F699143490%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143490/600 saved to cache
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4878bd96-ecc6-5172-b9f4-32abbb9ae940
2026-03-28 22:04:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473b97d0>
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5057cc2-c58a-5e78-ab90-b97e6edb6582/c5057cc2-c58a-5e78-ab90-b97e6edb6582_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK12WBW%252F699146306%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146306/600 saved to cache
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5057cc2-c58a-5e78-ab90-b97e6edb6582
2026-03-28 22:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994369/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS61FOF/42810605?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=CkwC%2BSn%2FHa5pvfLJnieo5YJn96MqgCZnNQ9bJG2t2ik%3D)
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082776%27 HTTP/1.1" 200 None
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082776 not downloaded yet
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471af510>
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8934b9-4045-555c-b8d3-812b6cc9a1e0/1a8934b9-4045-555c-b8d3-812b6cc9a1e0_expert_report_file_cb73d513-85b1-4ee1-8e31-d33c51a57ee3.pdf HTTP/1.1" 201 0
2026-03-28 22:04:35 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1a8934b9-4045-555c-b8d3-812b6cc9a1e0
2026-03-28 22:04:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a8934b9-4045-555c-b8d3-812b6cc9a1e0, skipping ID generation
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a8934b9-4045-555c-b8d3-812b6cc9a1e0
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBU67KTN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BU67KTN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547756810>
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2a7ebc8-3779-5484-8073-7a1c6fb87969/c2a7ebc8-3779-5484-8073-7a1c6fb87969_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT12LJZ%252F699252304%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252304/600 saved to cache
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c2a7ebc8-3779-5484-8073-7a1c6fb87969
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547755cd0>
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13188273-241e-5122-a324-f170682054c3/13188273-241e-5122-a324-f170682054c3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP11SXG%252F699253881%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253881/600 saved to cache
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 13188273-241e-5122-a324-f170682054c3
2026-03-28 22:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082675/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WM66HPY/42811136?sv=2020-08-04&st=2026-03-28T22%3A04%3A31Z&se=2026-03-28T22%3A29%3A31Z&sr=b&sp=r&sig=sXYRigPpSnWc%2FEZZOPShUy%2B9XgkE6pqm32sEVFPKdlE%3D)
2026-03-28 22:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251849/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT64JYY/42807297?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=H09NJ6PkIwPyWfxNOYCddSHeDmQxr4Xr%2FaIklrKjYWY%3D)
2026-03-28 22:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082666/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WM66HPY/42811136?sv=2020-08-04&st=2026-03-28T22%3A04%3A31Z&se=2026-03-28T22%3A29%3A31Z&sr=b&sp=r&sig=sXYRigPpSnWc%2FEZZOPShUy%2B9XgkE6pqm32sEVFPKdlE%3D)
2026-03-28 22:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143353/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143353>
2026-03-28 22:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976406/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976406>
2026-03-28 22:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082740/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082740>
2026-03-28 22:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082713/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082713>
2026-03-28 22:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082690/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WM66HPY/42811136?sv=2020-08-04&st=2026-03-28T22%3A04%3A31Z&se=2026-03-28T22%3A29%3A31Z&sr=b&sp=r&sig=sXYRigPpSnWc%2FEZZOPShUy%2B9XgkE6pqm32sEVFPKdlE%3D)
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031786%27 HTTP/1.1" 200 None
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031786 not downloaded yet
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031800%27 HTTP/1.1" 200 None
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031800 not downloaded yet
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554298210>
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c3dd07d-5304-5ac0-80dc-e30cb298b7d6/5c3dd07d-5304-5ac0-80dc-e30cb298b7d6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS61FOF%252F698994369%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994369/600 saved to cache
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031810%27 HTTP/1.1" 200 None
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031810 not downloaded yet
2026-03-28 22:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082697/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WM66HPY/42811136?sv=2020-08-04&st=2026-03-28T22%3A04%3A31Z&se=2026-03-28T22%3A29%3A31Z&sr=b&sp=r&sig=sXYRigPpSnWc%2FEZZOPShUy%2B9XgkE6pqm32sEVFPKdlE%3D)
2026-03-28 22:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082713/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WM66HPY/42811136?sv=2020-08-04&st=2026-03-28T22%3A04%3A31Z&se=2026-03-28T22%3A29%3A31Z&sr=b&sp=r&sig=sXYRigPpSnWc%2FEZZOPShUy%2B9XgkE6pqm32sEVFPKdlE%3D)
2026-03-28 22:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015693/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA61BFY/42810775?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=tQax5P6adI54twzyoqdok6iIUxSzHDcLDwBb4%2BMoMFw%3D)
2026-03-28 22:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253672/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YF07CJE/42784457?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=oeSdikiuOHhGcviJbgYya0Q8LTDoZVmeFjwoPj3o2js%3D)
2026-03-28 22:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146523/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL62VWY/42810894?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=DJfJtw6KwyhBPhnAY9QJ%2FtOYYSvRRaWGTAGIk0DU%2F%2BA%3D)
2026-03-28 22:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082765/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082765>
2026-03-28 22:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082753/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082753>
2026-03-28 22:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082723/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082723>
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031823%27 HTTP/1.1" 200 None
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031823 not downloaded yet
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031841%27 HTTP/1.1" 200 None
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031841 not downloaded yet
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471ae810>
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe/f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWM66HPY%252F699082675%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082675/600 saved to cache
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54713f6d0>
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e23659de-a271-571f-ad29-745e3ce94452/e23659de-a271-571f-ad29-745e3ce94452_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT64JYY%252F699251849%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251849/600 saved to cache
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e23659de-a271-571f-ad29-745e3ce94452
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477d9d10>
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe/f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWM66HPY%252F699082666%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082666/600 saved to cache
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b22450>
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe/f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWM66HPY%252F699082690%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082690/600 saved to cache
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe
2026-03-28 22:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976406/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY58NPG/42810706?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=m%2BjvjS4%2BeJxyPZhfktFet4Bo%2BpsamHOTjBnjcUc644A%3D)
2026-03-28 22:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082776/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082776>
2026-03-28 22:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143481/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143481>
2026-03-28 22:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143353/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ63EXO/42810870?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=wLoUguMiGeygfSRIZDr4SROlj4YBVqcY7mSaCT7eFDc%3D)
2026-03-28 22:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031781/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BU67KTN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146298/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146298>
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031872%27 HTTP/1.1" 200 None
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031872 not downloaded yet
2026-03-28 22:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082740/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WM66HPY/42811136?sv=2020-08-04&st=2026-03-28T22%3A04%3A31Z&se=2026-03-28T22%3A29%3A31Z&sr=b&sp=r&sig=sXYRigPpSnWc%2FEZZOPShUy%2B9XgkE6pqm32sEVFPKdlE%3D)
2026-03-28 22:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082765/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WM66HPY/42811136?sv=2020-08-04&st=2026-03-28T22%3A04%3A31Z&se=2026-03-28T22%3A29%3A31Z&sr=b&sp=r&sig=sXYRigPpSnWc%2FEZZOPShUy%2B9XgkE6pqm32sEVFPKdlE%3D)
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031895%27 HTTP/1.1" 200 None
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031895 not downloaded yet
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477d8810>
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe/f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWM66HPY%252F699082697%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082697/600 saved to cache
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55729c3d0>
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe/f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWM66HPY%252F699082713%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082713/600 saved to cache
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a8cad0>
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4baa05ed-fc6d-5ddf-8f83-9a745e89a05a/4baa05ed-fc6d-5ddf-8f83-9a745e89a05a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA61BFY%252F699015693%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015693/600 saved to cache
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547604250>
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b77897-c825-556b-ba96-284dc5a81572/56b77897-c825-556b-ba96-284dc5a81572_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYF07CJE%252F699253672%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253672/600 saved to cache
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 56b77897-c825-556b-ba96-284dc5a81572
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547306bd0>
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de1b1d7c-0af9-5140-a37d-505dea797715/de1b1d7c-0af9-5140-a37d-505dea797715_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL62VWY%252F699146523%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146523/600 saved to cache
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de1b1d7c-0af9-5140-a37d-505dea797715
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031917%27 HTTP/1.1" 200 None
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031917 not downloaded yet
2026-03-28 22:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082723/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WM66HPY/42811136?sv=2020-08-04&st=2026-03-28T22%3A04%3A31Z&se=2026-03-28T22%3A29%3A31Z&sr=b&sp=r&sig=sXYRigPpSnWc%2FEZZOPShUy%2B9XgkE6pqm32sEVFPKdlE%3D)
2026-03-28 22:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031800/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031800>
2026-03-28 22:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031786/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031786>
2026-03-28 22:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145592/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145592>
2026-03-28 22:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SJ16SYV/42810702?sv=2020-08-04&st=2026-03-28T22%3A04%3A35Z&se=2026-03-28T22%3A29%3A35Z&sr=b&sp=r&sig=%2BBYlLD9rqFt1G6ZbiDclfQeHodNg1O1M3KtSWE%2FuZkI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SJ16%20SYV-GB>
2026-03-28 22:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145354/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145354>
2026-03-28 22:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146298/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK12WBW/42811322?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=zrDQXpGJ59OXDPhU47QBcrd8BHKRhOWFkFPoLF1d7pk%3D)
2026-03-28 22:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082753/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WM66HPY/42811136?sv=2020-08-04&st=2026-03-28T22%3A04%3A31Z&se=2026-03-28T22%3A29%3A31Z&sr=b&sp=r&sig=sXYRigPpSnWc%2FEZZOPShUy%2B9XgkE6pqm32sEVFPKdlE%3D)
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031931%27 HTTP/1.1" 200 None
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031931 not downloaded yet
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477ecf10>
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96f4e7fc-b83e-5062-87d7-e0a26a3eaa65/96f4e7fc-b83e-5062-87d7-e0a26a3eaa65_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY58NPG%252F698976406%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976406/600 saved to cache
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547757990>
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac2cb512-acf6-577f-a0f2-2fe21a625645/ac2cb512-acf6-577f-a0f2-2fe21a625645_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ63EXO%252F699143353%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143353/600 saved to cache
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac2cb512-acf6-577f-a0f2-2fe21a625645
2026-03-28 22:04:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544a8490>
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe/f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWM66HPY%252F699082740%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082740/600 saved to cache
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe
2026-03-28 22:04:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472e5fd0>
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe/f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWM66HPY%252F699082765%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082765/600 saved to cache
2026-03-28 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe
2026-03-28 22:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031781/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU67KTN/42810831?sv=2020-08-04&st=2026-03-28T22%3A04%3A33Z&se=2026-03-28T22%3A29%3A33Z&sr=b&sp=r&sig=AjZdvh35Dwjd77tZDhaGUD7kU%2BX6C4A1ZckHUS7%2Fs2Y%3D)
2026-03-28 22:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031841/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031841>
2026-03-28 22:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253871/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YP11SXG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031823/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031823>
2026-03-28 22:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031810/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031810>
2026-03-28 22:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143481/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY14HKC/42811403?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=%2BYxeffQ4HY6floQPvp5Yr65sra111z9jxOTYy7mtf%2FU%3D)
2026-03-28 22:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082776/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WM66HPY/42811136?sv=2020-08-04&st=2026-03-28T22%3A04%3A31Z&se=2026-03-28T22%3A29%3A31Z&sr=b&sp=r&sig=sXYRigPpSnWc%2FEZZOPShUy%2B9XgkE6pqm32sEVFPKdlE%3D)
2026-03-28 22:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145354/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM61DYD/42811410?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=bDvqRxwLzIpEHYLUXTs40ur1RioMfasSNgu0Yug2sj4%3D)
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54713da50>
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe/f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWM66HPY%252F699082723%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082723/600 saved to cache
2026-03-28 22:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547204e10>
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5057cc2-c58a-5e78-ab90-b97e6edb6582/c5057cc2-c58a-5e78-ab90-b97e6edb6582_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK12WBW%252F699146298%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146298/600 saved to cache
2026-03-28 22:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5057cc2-c58a-5e78-ab90-b97e6edb6582
2026-03-28 22:04:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471072d0>
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe/f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWM66HPY%252F699082753%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082753/600 saved to cache
2026-03-28 22:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe
2026-03-28 22:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031800/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU67KTN/42810831?sv=2020-08-04&st=2026-03-28T22%3A04%3A33Z&se=2026-03-28T22%3A29%3A33Z&sr=b&sp=r&sig=AjZdvh35Dwjd77tZDhaGUD7kU%2BX6C4A1ZckHUS7%2Fs2Y%3D)
2026-03-28 22:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031786/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU67KTN/42810831?sv=2020-08-04&st=2026-03-28T22%3A04%3A33Z&se=2026-03-28T22%3A29%3A33Z&sr=b&sp=r&sig=AjZdvh35Dwjd77tZDhaGUD7kU%2BX6C4A1ZckHUS7%2Fs2Y%3D)
2026-03-28 22:04:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031895/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031895>
2026-03-28 22:04:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031872/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031872>
2026-03-28 22:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145592/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LY64DTU/42811373?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=nlvyE6o%2BjOSTCR6ZUHB9E%2BOFaaB84Hiq02HBTHcoq8g%3D)
2026-03-28 22:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SJ16SYV/42810702?sv=2020-08-04&st=2026-03-28T22%3A04%3A35Z&se=2026-03-28T22%3A29%3A35Z&sr=b&sp=r&sig=%2BBYlLD9rqFt1G6ZbiDclfQeHodNg1O1M3KtSWE%2FuZkI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55423b390>
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8934b9-4045-555c-b8d3-812b6cc9a1e0/1a8934b9-4045-555c-b8d3-812b6cc9a1e0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU67KTN%252F699031781%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031781/600 saved to cache
2026-03-28 22:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a8934b9-4045-555c-b8d3-812b6cc9a1e0
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554941910>
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4878bd96-ecc6-5172-b9f4-32abbb9ae940/4878bd96-ecc6-5172-b9f4-32abbb9ae940_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY14HKC%252F699143481%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143481/600 saved to cache
2026-03-28 22:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4878bd96-ecc6-5172-b9f4-32abbb9ae940
2026-03-28 22:04:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547205a10>
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe/f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWM66HPY%252F699082776%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082776/600 saved to cache
2026-03-28 22:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe
2026-03-28 22:04:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe, skipping ID generation
2026-03-28 22:04:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe sending to next pipeline
2026-03-28 22:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe, identifier: WM66%20HPY
2026-03-28 22:04:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554226110>
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a59b1b92-68f6-5af6-ad88-8517ad8fae07/a59b1b92-68f6-5af6-ad88-8517ad8fae07_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM61DYD%252F699145354%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145354/600 saved to cache
2026-03-28 22:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a59b1b92-68f6-5af6-ad88-8517ad8fae07
2026-03-28 22:04:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe with identifier: WM66%20HPY
2026-03-28 22:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe with identifier: WM66%20HPY
2026-03-28 22:04:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe with identifier: WM66%20HPY to the API
2026-03-28 22:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082776/600>
{'auction_title': '',
'c_o_2_emission_value': 89,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe/f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe_expert_report_file_cb21125a-b634-428c-83b2-9a59dc9ba86b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WM66%20HPY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WM66 HPY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WM66%20HPY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MERCEDES-BENZ',
'model': 'A180 D',
'odometer': 118159,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe/f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38350,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082666/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe/f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37936,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082675/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe/f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37204,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082690/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe/f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38015,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082697/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe/f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36495,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082713/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe/f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34237,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082723/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe/f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89636,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082740/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe/f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66447,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082753/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe/f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82478,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082765/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe/f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89869,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WM66HPY/699082776/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A180 D 1.5 SE EXECUTIVE Hatchback',
'transmission': 'manual',
'trim': 'SE EXECUTIVE',
'vin': 'WDD1760122V174778',
'year': 2017}
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM66%2520HPY%27 HTTP/1.1" 200 None
2026-03-28 22:04:37 [bca.uk] INFO: Saving data for WM66%20HPY: {'created_time': 1774735477.120695, 'last_price_update_time': 1774735477.120708, 'auction_closing_time': 1774951200.0}
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WM66%2520HPY') HTTP/1.1" 204 0
2026-03-28 22:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031810/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU67KTN/42810831?sv=2020-08-04&st=2026-03-28T22%3A04%3A33Z&se=2026-03-28T22%3A29%3A33Z&sr=b&sp=r&sig=AjZdvh35Dwjd77tZDhaGUD7kU%2BX6C4A1ZckHUS7%2Fs2Y%3D)
2026-03-28 22:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253871/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP11SXG/42810463?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=qkkbLatUiKU%2BsinzgsPhauDtkraDtbwZc7leOW58DOU%3D)
2026-03-28 22:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031841/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU67KTN/42810831?sv=2020-08-04&st=2026-03-28T22%3A04%3A33Z&se=2026-03-28T22%3A29%3A33Z&sr=b&sp=r&sig=AjZdvh35Dwjd77tZDhaGUD7kU%2BX6C4A1ZckHUS7%2Fs2Y%3D)
2026-03-28 22:04:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031917/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031917>
2026-03-28 22:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031823/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU67KTN/42810831?sv=2020-08-04&st=2026-03-28T22%3A04%3A33Z&se=2026-03-28T22%3A29%3A33Z&sr=b&sp=r&sig=AjZdvh35Dwjd77tZDhaGUD7kU%2BX6C4A1ZckHUS7%2Fs2Y%3D)
2026-03-28 22:04:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031931/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031931>
2026-03-28 22:04:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252295/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252295>
2026-03-28 22:04:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994354/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994354>
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5573287d0>
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8934b9-4045-555c-b8d3-812b6cc9a1e0/1a8934b9-4045-555c-b8d3-812b6cc9a1e0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU67KTN%252F699031800%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031800/600 saved to cache
2026-03-28 22:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a8934b9-4045-555c-b8d3-812b6cc9a1e0
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547306890>
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8934b9-4045-555c-b8d3-812b6cc9a1e0/1a8934b9-4045-555c-b8d3-812b6cc9a1e0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU67KTN%252F699031786%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031786/600 saved to cache
2026-03-28 22:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a8934b9-4045-555c-b8d3-812b6cc9a1e0
2026-03-28 22:04:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55436f390>
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_782aa18e-a0c9-5c10-9106-d797127b5b2a/782aa18e-a0c9-5c10-9106-d797127b5b2a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLY64DTU%252F699145592%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145592/600 saved to cache
2026-03-28 22:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 782aa18e-a0c9-5c10-9106-d797127b5b2a
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55436cb90>
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f02d0f-7d6c-5628-aec2-1916af416587/15f02d0f-7d6c-5628-aec2-1916af416587_expert_report_file_7a0984d6-a661-4ce6-a57d-ba30fc8573a0.pdf HTTP/1.1" 201 0
2026-03-28 22:04:37 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 15f02d0f-7d6c-5628-aec2-1916af416587
2026-03-28 22:04:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15f02d0f-7d6c-5628-aec2-1916af416587, skipping ID generation
2026-03-28 22:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 15f02d0f-7d6c-5628-aec2-1916af416587
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSJ16SYV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SJ16SYV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031895/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU67KTN/42810831?sv=2020-08-04&st=2026-03-28T22%3A04%3A33Z&se=2026-03-28T22%3A29%3A33Z&sr=b&sp=r&sig=AjZdvh35Dwjd77tZDhaGUD7kU%2BX6C4A1ZckHUS7%2Fs2Y%3D)
2026-03-28 22:04:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015685/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015685>
2026-03-28 22:04:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253665/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253665>
2026-03-28 22:04:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251842/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251842>
2026-03-28 22:04:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146513/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146513>
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011358%27 HTTP/1.1" 200 None
2026-03-28 22:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011358 not downloaded yet
2026-03-28 22:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031872/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU67KTN/42810831?sv=2020-08-04&st=2026-03-28T22%3A04%3A33Z&se=2026-03-28T22%3A29%3A33Z&sr=b&sp=r&sig=AjZdvh35Dwjd77tZDhaGUD7kU%2BX6C4A1ZckHUS7%2Fs2Y%3D)
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554800250>
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8934b9-4045-555c-b8d3-812b6cc9a1e0/1a8934b9-4045-555c-b8d3-812b6cc9a1e0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU67KTN%252F699031810%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031810/600 saved to cache
2026-03-28 22:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a8934b9-4045-555c-b8d3-812b6cc9a1e0
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54732e8d0>
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13188273-241e-5122-a324-f170682054c3/13188273-241e-5122-a324-f170682054c3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP11SXG%252F699253871%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253871/600 saved to cache
2026-03-28 22:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13188273-241e-5122-a324-f170682054c3
2026-03-28 22:04:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13188273-241e-5122-a324-f170682054c3, skipping ID generation
2026-03-28 22:04:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13188273-241e-5122-a324-f170682054c3 sending to next pipeline
2026-03-28 22:04:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 13188273-241e-5122-a324-f170682054c3, identifier: YP11%20SXG
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55436d7d0>
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8934b9-4045-555c-b8d3-812b6cc9a1e0/1a8934b9-4045-555c-b8d3-812b6cc9a1e0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU67KTN%252F699031841%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031841/600 saved to cache
2026-03-28 22:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a8934b9-4045-555c-b8d3-812b6cc9a1e0
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54732ff90>
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8934b9-4045-555c-b8d3-812b6cc9a1e0/1a8934b9-4045-555c-b8d3-812b6cc9a1e0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU67KTN%252F699031823%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031823/600 saved to cache
2026-03-28 22:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a8934b9-4045-555c-b8d3-812b6cc9a1e0
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011372%27 HTTP/1.1" 200 None
2026-03-28 22:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011372 not downloaded yet
2026-03-28 22:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 13188273-241e-5122-a324-f170682054c3 with identifier: YP11%20SXG
2026-03-28 22:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 13188273-241e-5122-a324-f170682054c3 with identifier: YP11%20SXG
2026-03-28 22:04:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 13188273-241e-5122-a324-f170682054c3 with identifier: YP11%20SXG to the API
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253871/600>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13188273-241e-5122-a324-f170682054c3/13188273-241e-5122-a324-f170682054c3_expert_report_file_46e10367-830c-4fcc-88b0-f523a29b8bcc.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YP11%20SXG-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '13188273-241e-5122-a324-f170682054c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YP11 SXG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YP11%20SXG&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VOLVO',
'model': 'C30',
'odometer': 122078,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13188273-241e-5122-a324-f170682054c3/13188273-241e-5122-a324-f170682054c3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39973,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253871/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13188273-241e-5122-a324-f170682054c3/13188273-241e-5122-a324-f170682054c3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39385,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253881/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13188273-241e-5122-a324-f170682054c3/13188273-241e-5122-a324-f170682054c3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40897,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253885/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13188273-241e-5122-a324-f170682054c3/13188273-241e-5122-a324-f170682054c3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42308,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253898/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13188273-241e-5122-a324-f170682054c3/13188273-241e-5122-a324-f170682054c3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35557,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253902/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13188273-241e-5122-a324-f170682054c3/13188273-241e-5122-a324-f170682054c3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34772,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253913/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13188273-241e-5122-a324-f170682054c3/13188273-241e-5122-a324-f170682054c3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111238,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253924/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13188273-241e-5122-a324-f170682054c3/13188273-241e-5122-a324-f170682054c3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74713,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253940/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13188273-241e-5122-a324-f170682054c3/13188273-241e-5122-a324-f170682054c3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101932,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253951/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13188273-241e-5122-a324-f170682054c3/13188273-241e-5122-a324-f170682054c3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80039,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP11SXG/699253965/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'VOLVO C30 1.6 DRIVE 115 SE Coupe',
'transmission': 'manual',
'trim': 'DRIVE 115 SE',
'vin': 'YV1MK84F1C2265293',
'year': 2011}
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP11%2520SXG%27 HTTP/1.1" 200 None
2026-03-28 22:04:37 [bca.uk] INFO: Saving data for YP11%20SXG: {'created_time': 1774735477.987162, 'last_price_update_time': 1774735477.987173, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YP11%2520SXG') HTTP/1.1" 204 0
2026-03-28 22:04:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143345/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143345>
2026-03-28 22:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994354/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS61FOF/42810605?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=CkwC%2BSn%2FHa5pvfLJnieo5YJn96MqgCZnNQ9bJG2t2ik%3D)
2026-03-28 22:04:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145581/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145581>
2026-03-28 22:04:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146292/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146292>
2026-03-28 22:04:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143476/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143476>
2026-03-28 22:04:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976387/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976387>
2026-03-28 22:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031931/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU67KTN/42810831?sv=2020-08-04&st=2026-03-28T22%3A04%3A33Z&se=2026-03-28T22%3A29%3A33Z&sr=b&sp=r&sig=AjZdvh35Dwjd77tZDhaGUD7kU%2BX6C4A1ZckHUS7%2Fs2Y%3D)
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011386%27 HTTP/1.1" 200 None
2026-03-28 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011386 not downloaded yet
2026-03-28 22:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031917/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU67KTN/42810831?sv=2020-08-04&st=2026-03-28T22%3A04%3A33Z&se=2026-03-28T22%3A29%3A33Z&sr=b&sp=r&sig=AjZdvh35Dwjd77tZDhaGUD7kU%2BX6C4A1ZckHUS7%2Fs2Y%3D)
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011403%27 HTTP/1.1" 200 None
2026-03-28 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011403 not downloaded yet
2026-03-28 22:04:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5541fda50>
2026-03-28 22:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8934b9-4045-555c-b8d3-812b6cc9a1e0/1a8934b9-4045-555c-b8d3-812b6cc9a1e0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU67KTN%252F699031895%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031895/600 saved to cache
2026-03-28 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a8934b9-4045-555c-b8d3-812b6cc9a1e0
2026-03-28 22:04:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477c4810>
2026-03-28 22:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8934b9-4045-555c-b8d3-812b6cc9a1e0/1a8934b9-4045-555c-b8d3-812b6cc9a1e0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU67KTN%252F699031872%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031872/600 saved to cache
2026-03-28 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a8934b9-4045-555c-b8d3-812b6cc9a1e0
2026-03-28 22:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252295/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT12LJZ/42809616?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=ZCqeg%2BtAkN7zfvr8I5qdCyvEoyksA32%2Fdc9lEzPe%2BbI%3D)
2026-03-28 22:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146513/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL62VWY/42810894?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=DJfJtw6KwyhBPhnAY9QJ%2FtOYYSvRRaWGTAGIk0DU%2F%2BA%3D)
2026-03-28 22:04:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145344/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145344>
2026-03-28 22:04:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011346/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SJ16SYV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253665/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YF07CJE/42784457?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=oeSdikiuOHhGcviJbgYya0Q8LTDoZVmeFjwoPj3o2js%3D)
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011418%27 HTTP/1.1" 200 None
2026-03-28 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011418 not downloaded yet
2026-03-28 22:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251842/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT64JYY/42807297?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=H09NJ6PkIwPyWfxNOYCddSHeDmQxr4Xr%2FaIklrKjYWY%3D)
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011449%27 HTTP/1.1" 200 None
2026-03-28 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011449 not downloaded yet
2026-03-28 22:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543b4850>
2026-03-28 22:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c3dd07d-5304-5ac0-80dc-e30cb298b7d6/5c3dd07d-5304-5ac0-80dc-e30cb298b7d6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS61FOF%252F698994354%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994354/600 saved to cache
2026-03-28 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6
2026-03-28 22:04:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554395290>
2026-03-28 22:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8934b9-4045-555c-b8d3-812b6cc9a1e0/1a8934b9-4045-555c-b8d3-812b6cc9a1e0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU67KTN%252F699031931%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031931/600 saved to cache
2026-03-28 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a8934b9-4045-555c-b8d3-812b6cc9a1e0
2026-03-28 22:04:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544ab6d0>
2026-03-28 22:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8934b9-4045-555c-b8d3-812b6cc9a1e0/1a8934b9-4045-555c-b8d3-812b6cc9a1e0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU67KTN%252F699031917%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031917/600 saved to cache
2026-03-28 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a8934b9-4045-555c-b8d3-812b6cc9a1e0
2026-03-28 22:04:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a8934b9-4045-555c-b8d3-812b6cc9a1e0, skipping ID generation
2026-03-28 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a8934b9-4045-555c-b8d3-812b6cc9a1e0 sending to next pipeline
2026-03-28 22:04:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1a8934b9-4045-555c-b8d3-812b6cc9a1e0, identifier: BU67%20KTN
2026-03-28 22:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015685/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA61BFY/42810775?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=tQax5P6adI54twzyoqdok6iIUxSzHDcLDwBb4%2BMoMFw%3D)
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011481%27 HTTP/1.1" 200 None
2026-03-28 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011481 not downloaded yet
2026-03-28 22:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1a8934b9-4045-555c-b8d3-812b6cc9a1e0 with identifier: BU67%20KTN
2026-03-28 22:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1a8934b9-4045-555c-b8d3-812b6cc9a1e0 with identifier: BU67%20KTN
2026-03-28 22:04:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1a8934b9-4045-555c-b8d3-812b6cc9a1e0 with identifier: BU67%20KTN to the API
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031917/600>
{'auction_title': '',
'c_o_2_emission_value': 463,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8934b9-4045-555c-b8d3-812b6cc9a1e0/1a8934b9-4045-555c-b8d3-812b6cc9a1e0_expert_report_file_cb73d513-85b1-4ee1-8e31-d33c51a57ee3.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BU67%20KTN-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1a8934b9-4045-555c-b8d3-812b6cc9a1e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BU67 KTN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BU67%20KTN&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 42547,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8934b9-4045-555c-b8d3-812b6cc9a1e0/1a8934b9-4045-555c-b8d3-812b6cc9a1e0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36439,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031781/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8934b9-4045-555c-b8d3-812b6cc9a1e0/1a8934b9-4045-555c-b8d3-812b6cc9a1e0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38398,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031786/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8934b9-4045-555c-b8d3-812b6cc9a1e0/1a8934b9-4045-555c-b8d3-812b6cc9a1e0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37776,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031800/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8934b9-4045-555c-b8d3-812b6cc9a1e0/1a8934b9-4045-555c-b8d3-812b6cc9a1e0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38191,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031810/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8934b9-4045-555c-b8d3-812b6cc9a1e0/1a8934b9-4045-555c-b8d3-812b6cc9a1e0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32183,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031823/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8934b9-4045-555c-b8d3-812b6cc9a1e0/1a8934b9-4045-555c-b8d3-812b6cc9a1e0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31892,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031841/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8934b9-4045-555c-b8d3-812b6cc9a1e0/1a8934b9-4045-555c-b8d3-812b6cc9a1e0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89727,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031872/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8934b9-4045-555c-b8d3-812b6cc9a1e0/1a8934b9-4045-555c-b8d3-812b6cc9a1e0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60846,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031895/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8934b9-4045-555c-b8d3-812b6cc9a1e0/1a8934b9-4045-555c-b8d3-812b6cc9a1e0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90358,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031917/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8934b9-4045-555c-b8d3-812b6cc9a1e0/1a8934b9-4045-555c-b8d3-812b6cc9a1e0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89321,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU67KTN/699031931/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.4 90 SRI Hatchback',
'transmission': 'manual',
'trim': '90 SRI',
'vin': 'W0V0XEP08J6028164',
'year': 2017}
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU67%2520KTN%27 HTTP/1.1" 200 None
2026-03-28 22:04:38 [bca.uk] INFO: Saving data for BU67%20KTN: {'created_time': 1774735478.801287, 'last_price_update_time': 1774735478.8013, 'auction_closing_time': 1774951200.0}
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BU67%2520KTN') HTTP/1.1" 204 0
2026-03-28 22:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976387/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY58NPG/42810706?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=m%2BjvjS4%2BeJxyPZhfktFet4Bo%2BpsamHOTjBnjcUc644A%3D)
2026-03-28 22:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143476/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY14HKC/42811403?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=%2BYxeffQ4HY6floQPvp5Yr65sra111z9jxOTYy7mtf%2FU%3D)
2026-03-28 22:04:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011372/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011372>
2026-03-28 22:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146292/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK12WBW/42811322?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=zrDQXpGJ59OXDPhU47QBcrd8BHKRhOWFkFPoLF1d7pk%3D)
2026-03-28 22:04:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011358/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011358>
2026-03-28 22:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143345/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ63EXO/42810870?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=wLoUguMiGeygfSRIZDr4SROlj4YBVqcY7mSaCT7eFDc%3D)
2026-03-28 22:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145581/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LY64DTU/42811373?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=nlvyE6o%2BjOSTCR6ZUHB9E%2BOFaaB84Hiq02HBTHcoq8g%3D)
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011510%27 HTTP/1.1" 200 None
2026-03-28 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011510 not downloaded yet
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011533%27 HTTP/1.1" 200 None
2026-03-28 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011533 not downloaded yet
2026-03-28 22:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555ca9810>
2026-03-28 22:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2a7ebc8-3779-5484-8073-7a1c6fb87969/c2a7ebc8-3779-5484-8073-7a1c6fb87969_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT12LJZ%252F699252295%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252295/600 saved to cache
2026-03-28 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c2a7ebc8-3779-5484-8073-7a1c6fb87969
2026-03-28 22:04:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2a7ebc8-3779-5484-8073-7a1c6fb87969, skipping ID generation
2026-03-28 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2a7ebc8-3779-5484-8073-7a1c6fb87969 sending to next pipeline
2026-03-28 22:04:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c2a7ebc8-3779-5484-8073-7a1c6fb87969, identifier: MT12%20LJZ
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554202cd0>
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de1b1d7c-0af9-5140-a37d-505dea797715/de1b1d7c-0af9-5140-a37d-505dea797715_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL62VWY%252F699146513%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146513/600 saved to cache
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de1b1d7c-0af9-5140-a37d-505dea797715
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474b8d10>
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b77897-c825-556b-ba96-284dc5a81572/56b77897-c825-556b-ba96-284dc5a81572_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYF07CJE%252F699253665%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253665/600 saved to cache
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 56b77897-c825-556b-ba96-284dc5a81572
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554394d90>
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e23659de-a271-571f-ad29-745e3ce94452/e23659de-a271-571f-ad29-745e3ce94452_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT64JYY%252F699251842%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251842/600 saved to cache
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e23659de-a271-571f-ad29-745e3ce94452
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474bb610>
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4baa05ed-fc6d-5ddf-8f83-9a745e89a05a/4baa05ed-fc6d-5ddf-8f83-9a745e89a05a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA61BFY%252F699015685%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015685/600 saved to cache
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a
2026-03-28 22:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c2a7ebc8-3779-5484-8073-7a1c6fb87969 with identifier: MT12%20LJZ
2026-03-28 22:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c2a7ebc8-3779-5484-8073-7a1c6fb87969 with identifier: MT12%20LJZ
2026-03-28 22:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c2a7ebc8-3779-5484-8073-7a1c6fb87969 with identifier: MT12%20LJZ to the API
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252295/600>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2a7ebc8-3779-5484-8073-7a1c6fb87969/c2a7ebc8-3779-5484-8073-7a1c6fb87969_expert_report_file_4f4ff5c8-ab44-4553-8622-ec44cc3ba915.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT12%20LJZ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c2a7ebc8-3779-5484-8073-7a1c6fb87969',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT12 LJZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT12%20LJZ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 74492,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2a7ebc8-3779-5484-8073-7a1c6fb87969/c2a7ebc8-3779-5484-8073-7a1c6fb87969_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36908,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252289/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2a7ebc8-3779-5484-8073-7a1c6fb87969/c2a7ebc8-3779-5484-8073-7a1c6fb87969_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36120,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252295/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2a7ebc8-3779-5484-8073-7a1c6fb87969/c2a7ebc8-3779-5484-8073-7a1c6fb87969_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36285,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252304/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2a7ebc8-3779-5484-8073-7a1c6fb87969/c2a7ebc8-3779-5484-8073-7a1c6fb87969_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37555,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252310/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2a7ebc8-3779-5484-8073-7a1c6fb87969/c2a7ebc8-3779-5484-8073-7a1c6fb87969_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35072,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252318/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2a7ebc8-3779-5484-8073-7a1c6fb87969/c2a7ebc8-3779-5484-8073-7a1c6fb87969_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33999,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252326/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2a7ebc8-3779-5484-8073-7a1c6fb87969/c2a7ebc8-3779-5484-8073-7a1c6fb87969_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85151,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252339/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2a7ebc8-3779-5484-8073-7a1c6fb87969/c2a7ebc8-3779-5484-8073-7a1c6fb87969_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53058,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252353/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2a7ebc8-3779-5484-8073-7a1c6fb87969/c2a7ebc8-3779-5484-8073-7a1c6fb87969_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67462,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252369/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2a7ebc8-3779-5484-8073-7a1c6fb87969/c2a7ebc8-3779-5484-8073-7a1c6fb87969_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83890,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12LJZ/699252387/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI 1.5 DCI 110 ACENTA Hatchback',
'transmission': 'manual',
'trim': 'DCI 110 ACENTA',
'vin': 'SJNFCAJ10U2586169',
'year': 2012}
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT12%2520LJZ%27 HTTP/1.1" 200 None
2026-03-28 22:04:39 [bca.uk] INFO: Saving data for MT12%20LJZ: {'created_time': 1774735479.542659, 'last_price_update_time': 1774735479.54267, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT12%2520LJZ') HTTP/1.1" 204 0
2026-03-28 22:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011346/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SJ16SYV/42810702?sv=2020-08-04&st=2026-03-28T22%3A04%3A35Z&se=2026-03-28T22%3A29%3A35Z&sr=b&sp=r&sig=%2BBYlLD9rqFt1G6ZbiDclfQeHodNg1O1M3KtSWE%2FuZkI%3D)
2026-03-28 22:04:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011403/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011403>
2026-03-28 22:04:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143271/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143271>
2026-03-28 22:04:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011386/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011386>
2026-03-28 22:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011372/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SJ16SYV/42810702?sv=2020-08-04&st=2026-03-28T22%3A04%3A35Z&se=2026-03-28T22%3A29%3A35Z&sr=b&sp=r&sig=%2BBYlLD9rqFt1G6ZbiDclfQeHodNg1O1M3KtSWE%2FuZkI%3D)
2026-03-28 22:04:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011418/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011418>
2026-03-28 22:04:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147190/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147190>
2026-03-28 22:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145344/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM61DYD/42811410?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=bDvqRxwLzIpEHYLUXTs40ur1RioMfasSNgu0Yug2sj4%3D)
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477cd610>
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96f4e7fc-b83e-5062-87d7-e0a26a3eaa65/96f4e7fc-b83e-5062-87d7-e0a26a3eaa65_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY58NPG%252F698976387%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976387/600 saved to cache
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5541ff890>
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4878bd96-ecc6-5172-b9f4-32abbb9ae940/4878bd96-ecc6-5172-b9f4-32abbb9ae940_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY14HKC%252F699143476%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143476/600 saved to cache
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4878bd96-ecc6-5172-b9f4-32abbb9ae940
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555c6dd50>
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5057cc2-c58a-5e78-ab90-b97e6edb6582/c5057cc2-c58a-5e78-ab90-b97e6edb6582_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK12WBW%252F699146292%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146292/600 saved to cache
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5057cc2-c58a-5e78-ab90-b97e6edb6582
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b366d0>
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac2cb512-acf6-577f-a0f2-2fe21a625645/ac2cb512-acf6-577f-a0f2-2fe21a625645_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ63EXO%252F699143345%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143345/600 saved to cache
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac2cb512-acf6-577f-a0f2-2fe21a625645
2026-03-28 22:04:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471ae390>
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_782aa18e-a0c9-5c10-9106-d797127b5b2a/782aa18e-a0c9-5c10-9106-d797127b5b2a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLY64DTU%252F699145581%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145581/600 saved to cache
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 782aa18e-a0c9-5c10-9106-d797127b5b2a
2026-03-28 22:04:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011449/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011449>
2026-03-28 22:04:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011481/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011481>
2026-03-28 22:04:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT66HCJ/42797462?sv=2020-08-04&st=2026-03-28T22%3A04%3A39Z&se=2026-03-28T22%3A29%3A39Z&sr=b&sp=r&sig=VJeDgqSMnD6SI2b%2FRQMkxxcpFu7sCUpLlSyJDS8Or6A%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT66%20HCJ-GB>
2026-03-28 22:04:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251837/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LT64JYY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994343/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DS61FOF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015678/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MA61BFY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011358/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SJ16SYV/42810702?sv=2020-08-04&st=2026-03-28T22%3A04%3A35Z&se=2026-03-28T22%3A29%3A35Z&sr=b&sp=r&sig=%2BBYlLD9rqFt1G6ZbiDclfQeHodNg1O1M3KtSWE%2FuZkI%3D)
2026-03-28 22:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147190/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK11VUF/42811158?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=l8QAasE0E%2FzQR5QTuF2laotj8hcmBnHx0u13mVzzHt8%3D)
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477c4090>
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f02d0f-7d6c-5628-aec2-1916af416587/15f02d0f-7d6c-5628-aec2-1916af416587_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSJ16SYV%252F699011346%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011346/600 saved to cache
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15f02d0f-7d6c-5628-aec2-1916af416587
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547755e10>
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f02d0f-7d6c-5628-aec2-1916af416587/15f02d0f-7d6c-5628-aec2-1916af416587_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSJ16SYV%252F699011372%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011372/600 saved to cache
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 15f02d0f-7d6c-5628-aec2-1916af416587
2026-03-28 22:04:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554909250>
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a59b1b92-68f6-5af6-ad88-8517ad8fae07/a59b1b92-68f6-5af6-ad88-8517ad8fae07_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM61DYD%252F699145344%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145344/600 saved to cache
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a59b1b92-68f6-5af6-ad88-8517ad8fae07
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554acd250>
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f02d0f-7d6c-5628-aec2-1916af416587/15f02d0f-7d6c-5628-aec2-1916af416587_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSJ16SYV%252F699011358%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011358/600 saved to cache
2026-03-28 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 15f02d0f-7d6c-5628-aec2-1916af416587
2026-03-28 22:04:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477400d0>
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db8298e-1099-5db2-81d1-5141138419a2/3db8298e-1099-5db2-81d1-5141138419a2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK11VUF%252F699147190%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147190/600 saved to cache
2026-03-28 22:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3db8298e-1099-5db2-81d1-5141138419a2
2026-03-28 22:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015678/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA61BFY/42810775?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=tQax5P6adI54twzyoqdok6iIUxSzHDcLDwBb4%2BMoMFw%3D)
2026-03-28 22:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011403/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SJ16SYV/42810702?sv=2020-08-04&st=2026-03-28T22%3A04%3A35Z&se=2026-03-28T22%3A29%3A35Z&sr=b&sp=r&sig=%2BBYlLD9rqFt1G6ZbiDclfQeHodNg1O1M3KtSWE%2FuZkI%3D)
2026-03-28 22:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011510/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011510>
2026-03-28 22:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146507/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SL62VWY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011418/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SJ16SYV/42810702?sv=2020-08-04&st=2026-03-28T22%3A04%3A35Z&se=2026-03-28T22%3A29%3A35Z&sr=b&sp=r&sig=%2BBYlLD9rqFt1G6ZbiDclfQeHodNg1O1M3KtSWE%2FuZkI%3D)
2026-03-28 22:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011533/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011533>
2026-03-28 22:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143271/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DV14VNO/42811439?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=AJzvLw0izZRKfov%2BeUrE5UmVQvMJLyUVerbX0NanFzs%3D)
2026-03-28 22:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011386/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SJ16SYV/42810702?sv=2020-08-04&st=2026-03-28T22%3A04%3A35Z&se=2026-03-28T22%3A29%3A35Z&sr=b&sp=r&sig=%2BBYlLD9rqFt1G6ZbiDclfQeHodNg1O1M3KtSWE%2FuZkI%3D)
2026-03-28 22:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251837/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT64JYY/42807297?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=H09NJ6PkIwPyWfxNOYCddSHeDmQxr4Xr%2FaIklrKjYWY%3D)
2026-03-28 22:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143336/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143336>
2026-03-28 22:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253656/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YF07CJE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994343/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS61FOF/42810605?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=CkwC%2BSn%2FHa5pvfLJnieo5YJn96MqgCZnNQ9bJG2t2ik%3D)
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554acfcd0>
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4baa05ed-fc6d-5ddf-8f83-9a745e89a05a/4baa05ed-fc6d-5ddf-8f83-9a745e89a05a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA61BFY%252F699015678%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015678/600 saved to cache
2026-03-28 22:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a
2026-03-28 22:04:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a, skipping ID generation
2026-03-28 22:04:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a sending to next pipeline
2026-03-28 22:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a, identifier: MA61%20BFY
2026-03-28 22:04:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a with identifier: MA61%20BFY
2026-03-28 22:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a with identifier: MA61%20BFY
2026-03-28 22:04:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a with identifier: MA61%20BFY to the API
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015678/600>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4baa05ed-fc6d-5ddf-8f83-9a745e89a05a/4baa05ed-fc6d-5ddf-8f83-9a745e89a05a_expert_report_file_46ae7f81-d4f7-420b-9619-054acef293e3.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MA61%20BFY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4baa05ed-fc6d-5ddf-8f83-9a745e89a05a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MA61 BFY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MA61%20BFY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'MONDEO',
'odometer': 116145,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4baa05ed-fc6d-5ddf-8f83-9a745e89a05a/4baa05ed-fc6d-5ddf-8f83-9a745e89a05a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40635,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015678/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4baa05ed-fc6d-5ddf-8f83-9a745e89a05a/4baa05ed-fc6d-5ddf-8f83-9a745e89a05a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38053,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015685/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4baa05ed-fc6d-5ddf-8f83-9a745e89a05a/4baa05ed-fc6d-5ddf-8f83-9a745e89a05a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39619,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015693/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4baa05ed-fc6d-5ddf-8f83-9a745e89a05a/4baa05ed-fc6d-5ddf-8f83-9a745e89a05a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40303,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015697/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4baa05ed-fc6d-5ddf-8f83-9a745e89a05a/4baa05ed-fc6d-5ddf-8f83-9a745e89a05a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35794,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015705/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4baa05ed-fc6d-5ddf-8f83-9a745e89a05a/4baa05ed-fc6d-5ddf-8f83-9a745e89a05a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32575,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015712/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4baa05ed-fc6d-5ddf-8f83-9a745e89a05a/4baa05ed-fc6d-5ddf-8f83-9a745e89a05a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76328,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015743/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4baa05ed-fc6d-5ddf-8f83-9a745e89a05a/4baa05ed-fc6d-5ddf-8f83-9a745e89a05a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75441,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015770/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4baa05ed-fc6d-5ddf-8f83-9a745e89a05a/4baa05ed-fc6d-5ddf-8f83-9a745e89a05a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97789,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015804/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4baa05ed-fc6d-5ddf-8f83-9a745e89a05a/4baa05ed-fc6d-5ddf-8f83-9a745e89a05a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80438,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA61BFY/699015821/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'FORD MONDEO 1.6 TDCI ECO ZETEC S/S Hatchback',
'transmission': 'manual',
'trim': 'TDCI ECO ZETEC S/S',
'vin': 'WF0EXXGBBEBT63753',
'year': 2011}
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA61%2520BFY%27 HTTP/1.1" 200 None
2026-03-28 22:04:40 [bca.uk] INFO: Saving data for MA61%20BFY: {'created_time': 1774735480.64757, 'last_price_update_time': 1774735480.64758, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MA61%2520BFY') HTTP/1.1" 204 0
2026-03-28 22:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146507/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL62VWY/42810894?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=DJfJtw6KwyhBPhnAY9QJ%2FtOYYSvRRaWGTAGIk0DU%2F%2BA%3D)
2026-03-28 22:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976368/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976368>
2026-03-28 22:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143465/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143465>
2026-03-28 22:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011481/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SJ16SYV/42810702?sv=2020-08-04&st=2026-03-28T22%3A04%3A35Z&se=2026-03-28T22%3A29%3A35Z&sr=b&sp=r&sig=%2BBYlLD9rqFt1G6ZbiDclfQeHodNg1O1M3KtSWE%2FuZkI%3D)
2026-03-28 22:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011449/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SJ16SYV/42810702?sv=2020-08-04&st=2026-03-28T22%3A04%3A35Z&se=2026-03-28T22%3A29%3A35Z&sr=b&sp=r&sig=%2BBYlLD9rqFt1G6ZbiDclfQeHodNg1O1M3KtSWE%2FuZkI%3D)
2026-03-28 22:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011510/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SJ16SYV/42810702?sv=2020-08-04&st=2026-03-28T22%3A04%3A35Z&se=2026-03-28T22%3A29%3A35Z&sr=b&sp=r&sig=%2BBYlLD9rqFt1G6ZbiDclfQeHodNg1O1M3KtSWE%2FuZkI%3D)
2026-03-28 22:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011533/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SJ16SYV/42810702?sv=2020-08-04&st=2026-03-28T22%3A04%3A35Z&se=2026-03-28T22%3A29%3A35Z&sr=b&sp=r&sig=%2BBYlLD9rqFt1G6ZbiDclfQeHodNg1O1M3KtSWE%2FuZkI%3D)
2026-03-28 22:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT66HCJ/42797462?sv=2020-08-04&st=2026-03-28T22%3A04%3A39Z&se=2026-03-28T22%3A29%3A39Z&sr=b&sp=r&sig=VJeDgqSMnD6SI2b%2FRQMkxxcpFu7sCUpLlSyJDS8Or6A%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5573dfad0>
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f02d0f-7d6c-5628-aec2-1916af416587/15f02d0f-7d6c-5628-aec2-1916af416587_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSJ16SYV%252F699011403%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011403/600 saved to cache
2026-03-28 22:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 15f02d0f-7d6c-5628-aec2-1916af416587
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477c7f10>
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f02d0f-7d6c-5628-aec2-1916af416587/15f02d0f-7d6c-5628-aec2-1916af416587_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSJ16SYV%252F699011418%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011418/600 saved to cache
2026-03-28 22:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 15f02d0f-7d6c-5628-aec2-1916af416587
2026-03-28 22:04:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557361c10>
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b6294-9845-5eb5-8c1d-a1f98760f95e/ef7b6294-9845-5eb5-8c1d-a1f98760f95e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDV14VNO%252F699143271%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143271/600 saved to cache
2026-03-28 22:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ef7b6294-9845-5eb5-8c1d-a1f98760f95e
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547479e90>
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f02d0f-7d6c-5628-aec2-1916af416587/15f02d0f-7d6c-5628-aec2-1916af416587_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSJ16SYV%252F699011386%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011386/600 saved to cache
2026-03-28 22:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 15f02d0f-7d6c-5628-aec2-1916af416587
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554ace650>
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e23659de-a271-571f-ad29-745e3ce94452/e23659de-a271-571f-ad29-745e3ce94452_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT64JYY%252F699251837%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251837/600 saved to cache
2026-03-28 22:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e23659de-a271-571f-ad29-745e3ce94452
2026-03-28 22:04:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e23659de-a271-571f-ad29-745e3ce94452, skipping ID generation
2026-03-28 22:04:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e23659de-a271-571f-ad29-745e3ce94452 sending to next pipeline
2026-03-28 22:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e23659de-a271-571f-ad29-745e3ce94452, identifier: LT64%20JYY
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474b8c90>
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c3dd07d-5304-5ac0-80dc-e30cb298b7d6/5c3dd07d-5304-5ac0-80dc-e30cb298b7d6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS61FOF%252F698994343%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994343/600 saved to cache
2026-03-28 22:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6
2026-03-28 22:04:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6, skipping ID generation
2026-03-28 22:04:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6 sending to next pipeline
2026-03-28 22:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6, identifier: DS61%20FOF
2026-03-28 22:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e23659de-a271-571f-ad29-745e3ce94452 with identifier: LT64%20JYY
2026-03-28 22:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e23659de-a271-571f-ad29-745e3ce94452 with identifier: LT64%20JYY
2026-03-28 22:04:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e23659de-a271-571f-ad29-745e3ce94452 with identifier: LT64%20JYY to the API
2026-03-28 22:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251837/600>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e23659de-a271-571f-ad29-745e3ce94452/e23659de-a271-571f-ad29-745e3ce94452_expert_report_file_4d71fd10-de23-495f-a464-a1b2ba4a8582.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT64%20JYY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e23659de-a271-571f-ad29-745e3ce94452',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LT64 JYY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LT64%20JYY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SUZUKI',
'model': 'ALTO',
'odometer': 68003,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e23659de-a271-571f-ad29-745e3ce94452/e23659de-a271-571f-ad29-745e3ce94452_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39166,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251837/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e23659de-a271-571f-ad29-745e3ce94452/e23659de-a271-571f-ad29-745e3ce94452_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38505,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251842/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e23659de-a271-571f-ad29-745e3ce94452/e23659de-a271-571f-ad29-745e3ce94452_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38010,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251849/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e23659de-a271-571f-ad29-745e3ce94452/e23659de-a271-571f-ad29-745e3ce94452_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39104,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251857/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e23659de-a271-571f-ad29-745e3ce94452/e23659de-a271-571f-ad29-745e3ce94452_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37471,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251864/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e23659de-a271-571f-ad29-745e3ce94452/e23659de-a271-571f-ad29-745e3ce94452_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36459,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251871/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e23659de-a271-571f-ad29-745e3ce94452/e23659de-a271-571f-ad29-745e3ce94452_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84507,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251884/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e23659de-a271-571f-ad29-745e3ce94452/e23659de-a271-571f-ad29-745e3ce94452_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54145,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251899/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e23659de-a271-571f-ad29-745e3ce94452/e23659de-a271-571f-ad29-745e3ce94452_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74301,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251911/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e23659de-a271-571f-ad29-745e3ce94452/e23659de-a271-571f-ad29-745e3ce94452_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67210,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64JYY/699251924/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'SUZUKI ALTO 1.0 SZ Hatchback',
'transmission': 'manual',
'trim': 'SZ',
'vin': 'MA3GFC31S00741356',
'year': 2014}
2026-03-28 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT64%2520JYY%27 HTTP/1.1" 200 None
2026-03-28 22:04:41 [bca.uk] INFO: Saving data for LT64%20JYY: {'created_time': 1774735481.496694, 'last_price_update_time': 1774735481.496705, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LT64%2520JYY') HTTP/1.1" 204 0
2026-03-28 22:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6 with identifier: DS61%20FOF
2026-03-28 22:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6 with identifier: DS61%20FOF
2026-03-28 22:04:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6 with identifier: DS61%20FOF to the API
2026-03-28 22:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994343/600>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3dd07d-5304-5ac0-80dc-e30cb298b7d6/5c3dd07d-5304-5ac0-80dc-e30cb298b7d6_expert_report_file_917fb746-68f4-44f0-81eb-6068400ee615.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DS61%20FOF-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5c3dd07d-5304-5ac0-80dc-e30cb298b7d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DS61 FOF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DS61%20FOF&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 74718,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3dd07d-5304-5ac0-80dc-e30cb298b7d6/5c3dd07d-5304-5ac0-80dc-e30cb298b7d6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40242,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994343/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3dd07d-5304-5ac0-80dc-e30cb298b7d6/5c3dd07d-5304-5ac0-80dc-e30cb298b7d6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38365,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994354/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3dd07d-5304-5ac0-80dc-e30cb298b7d6/5c3dd07d-5304-5ac0-80dc-e30cb298b7d6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40049,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994369/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3dd07d-5304-5ac0-80dc-e30cb298b7d6/5c3dd07d-5304-5ac0-80dc-e30cb298b7d6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41217,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994383/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3dd07d-5304-5ac0-80dc-e30cb298b7d6/5c3dd07d-5304-5ac0-80dc-e30cb298b7d6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38560,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994396/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3dd07d-5304-5ac0-80dc-e30cb298b7d6/5c3dd07d-5304-5ac0-80dc-e30cb298b7d6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36194,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994412/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3dd07d-5304-5ac0-80dc-e30cb298b7d6/5c3dd07d-5304-5ac0-80dc-e30cb298b7d6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89936,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994443/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3dd07d-5304-5ac0-80dc-e30cb298b7d6/5c3dd07d-5304-5ac0-80dc-e30cb298b7d6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69149,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994470/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3dd07d-5304-5ac0-80dc-e30cb298b7d6/5c3dd07d-5304-5ac0-80dc-e30cb298b7d6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89209,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994500/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3dd07d-5304-5ac0-80dc-e30cb298b7d6/5c3dd07d-5304-5ac0-80dc-e30cb298b7d6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79951,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS61FOF/698994521/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'RENAULT CLIO 1.2 TCE DYNAMIQUE TOM TOM Estate',
'transmission': 'manual',
'trim': 'TCE DYNAMIQUE TOM TOM',
'vin': 'VF1KRC40H46881690',
'year': 2012}
2026-03-28 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS61%2520FOF%27 HTTP/1.1" 200 None
2026-03-28 22:04:41 [bca.uk] INFO: Saving data for DS61%20FOF: {'created_time': 1774735481.899983, 'last_price_update_time': 1774735481.899995, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DS61%2520FOF') HTTP/1.1" 204 0
2026-03-28 22:04:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146285/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146285>
2026-03-28 22:04:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145575/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145575>
2026-03-28 22:04:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145335/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145335>
2026-03-28 22:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253656/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YF07CJE/42784457?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=oeSdikiuOHhGcviJbgYya0Q8LTDoZVmeFjwoPj3o2js%3D)
2026-03-28 22:04:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143255/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143255>
2026-03-28 22:04:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147174/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147174>
2026-03-28 22:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143465/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY14HKC/42811403?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=%2BYxeffQ4HY6floQPvp5Yr65sra111z9jxOTYy7mtf%2FU%3D)
2026-03-28 22:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143336/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ63EXO/42810870?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=wLoUguMiGeygfSRIZDr4SROlj4YBVqcY7mSaCT7eFDc%3D)
2026-03-28 22:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5545cfb10>
2026-03-28 22:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de1b1d7c-0af9-5140-a37d-505dea797715/de1b1d7c-0af9-5140-a37d-505dea797715_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL62VWY%252F699146507%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146507/600 saved to cache
2026-03-28 22:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de1b1d7c-0af9-5140-a37d-505dea797715
2026-03-28 22:04:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de1b1d7c-0af9-5140-a37d-505dea797715, skipping ID generation
2026-03-28 22:04:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de1b1d7c-0af9-5140-a37d-505dea797715 sending to next pipeline
2026-03-28 22:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: de1b1d7c-0af9-5140-a37d-505dea797715, identifier: SL62%20VWY
2026-03-28 22:04:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55429b650>
2026-03-28 22:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f02d0f-7d6c-5628-aec2-1916af416587/15f02d0f-7d6c-5628-aec2-1916af416587_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSJ16SYV%252F699011481%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011481/600 saved to cache
2026-03-28 22:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 15f02d0f-7d6c-5628-aec2-1916af416587
2026-03-28 22:04:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554303a10>
2026-03-28 22:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f02d0f-7d6c-5628-aec2-1916af416587/15f02d0f-7d6c-5628-aec2-1916af416587_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSJ16SYV%252F699011449%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011449/600 saved to cache
2026-03-28 22:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 15f02d0f-7d6c-5628-aec2-1916af416587
2026-03-28 22:04:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55437b390>
2026-03-28 22:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f02d0f-7d6c-5628-aec2-1916af416587/15f02d0f-7d6c-5628-aec2-1916af416587_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSJ16SYV%252F699011510%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011510/600 saved to cache
2026-03-28 22:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 15f02d0f-7d6c-5628-aec2-1916af416587
2026-03-28 22:04:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477569d0>
2026-03-28 22:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f02d0f-7d6c-5628-aec2-1916af416587/15f02d0f-7d6c-5628-aec2-1916af416587_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSJ16SYV%252F699011533%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011533/600 saved to cache
2026-03-28 22:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 15f02d0f-7d6c-5628-aec2-1916af416587
2026-03-28 22:04:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15f02d0f-7d6c-5628-aec2-1916af416587, skipping ID generation
2026-03-28 22:04:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15f02d0f-7d6c-5628-aec2-1916af416587 sending to next pipeline
2026-03-28 22:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 15f02d0f-7d6c-5628-aec2-1916af416587, identifier: SJ16%20SYV
2026-03-28 22:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5572a4410>
2026-03-28 22:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c346eec4-40ba-53d7-bb4d-ada017b4776d/c346eec4-40ba-53d7-bb4d-ada017b4776d_expert_report_file_2c427876-fb4b-4dc9-91e0-6aa66f86db23.pdf HTTP/1.1" 201 0
2026-03-28 22:04:42 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c346eec4-40ba-53d7-bb4d-ada017b4776d
2026-03-28 22:04:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c346eec4-40ba-53d7-bb4d-ada017b4776d, skipping ID generation
2026-03-28 22:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c346eec4-40ba-53d7-bb4d-ada017b4776d
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLT66HCJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LT66HCJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: de1b1d7c-0af9-5140-a37d-505dea797715 with identifier: SL62%20VWY
2026-03-28 22:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: de1b1d7c-0af9-5140-a37d-505dea797715 with identifier: SL62%20VWY
2026-03-28 22:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: de1b1d7c-0af9-5140-a37d-505dea797715 with identifier: SL62%20VWY to the API
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146507/600>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de1b1d7c-0af9-5140-a37d-505dea797715/de1b1d7c-0af9-5140-a37d-505dea797715_expert_report_file_758170ab-e171-4c58-aa9e-bbcdceec9b5b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SL62%20VWY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'de1b1d7c-0af9-5140-a37d-505dea797715',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SL62 VWY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SL62%20VWY&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'KIA',
'model': 'RIO',
'odometer': 57076,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de1b1d7c-0af9-5140-a37d-505dea797715/de1b1d7c-0af9-5140-a37d-505dea797715_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47112,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146507/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de1b1d7c-0af9-5140-a37d-505dea797715/de1b1d7c-0af9-5140-a37d-505dea797715_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45964,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146513/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de1b1d7c-0af9-5140-a37d-505dea797715/de1b1d7c-0af9-5140-a37d-505dea797715_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44961,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146523/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de1b1d7c-0af9-5140-a37d-505dea797715/de1b1d7c-0af9-5140-a37d-505dea797715_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46837,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146529/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de1b1d7c-0af9-5140-a37d-505dea797715/de1b1d7c-0af9-5140-a37d-505dea797715_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46390,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146536/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de1b1d7c-0af9-5140-a37d-505dea797715/de1b1d7c-0af9-5140-a37d-505dea797715_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44620,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146542/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de1b1d7c-0af9-5140-a37d-505dea797715/de1b1d7c-0af9-5140-a37d-505dea797715_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81116,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146547/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de1b1d7c-0af9-5140-a37d-505dea797715/de1b1d7c-0af9-5140-a37d-505dea797715_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61723,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146556/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de1b1d7c-0af9-5140-a37d-505dea797715/de1b1d7c-0af9-5140-a37d-505dea797715_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82118,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146563/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de1b1d7c-0af9-5140-a37d-505dea797715/de1b1d7c-0af9-5140-a37d-505dea797715_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67485,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL62VWY/699146573/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'KIA RIO 1.2 1 Hatchback',
'transmission': 'manual',
'trim': '1',
'vin': 'KNADM511LD6162634',
'year': 2012}
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL62%2520VWY%27 HTTP/1.1" 200 None
2026-03-28 22:04:42 [bca.uk] INFO: Saving data for SL62%20VWY: {'created_time': 1774735482.819571, 'last_price_update_time': 1774735482.819581, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SL62%2520VWY') HTTP/1.1" 204 0
2026-03-28 22:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 15f02d0f-7d6c-5628-aec2-1916af416587 with identifier: SJ16%20SYV
2026-03-28 22:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 15f02d0f-7d6c-5628-aec2-1916af416587 with identifier: SJ16%20SYV
2026-03-28 22:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 15f02d0f-7d6c-5628-aec2-1916af416587 with identifier: SJ16%20SYV to the API
2026-03-28 22:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011533/600>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f02d0f-7d6c-5628-aec2-1916af416587/15f02d0f-7d6c-5628-aec2-1916af416587_expert_report_file_7a0984d6-a661-4ce6-a57d-ba30fc8573a0.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SJ16%20SYV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '15f02d0f-7d6c-5628-aec2-1916af416587',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SJ16 SYV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SJ16%20SYV&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'C-MAX',
'odometer': 57673,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f02d0f-7d6c-5628-aec2-1916af416587/15f02d0f-7d6c-5628-aec2-1916af416587_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38115,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011346/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f02d0f-7d6c-5628-aec2-1916af416587/15f02d0f-7d6c-5628-aec2-1916af416587_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38714,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011358/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f02d0f-7d6c-5628-aec2-1916af416587/15f02d0f-7d6c-5628-aec2-1916af416587_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36835,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011372/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f02d0f-7d6c-5628-aec2-1916af416587/15f02d0f-7d6c-5628-aec2-1916af416587_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38082,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011386/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f02d0f-7d6c-5628-aec2-1916af416587/15f02d0f-7d6c-5628-aec2-1916af416587_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36956,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011403/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f02d0f-7d6c-5628-aec2-1916af416587/15f02d0f-7d6c-5628-aec2-1916af416587_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36348,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011418/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f02d0f-7d6c-5628-aec2-1916af416587/15f02d0f-7d6c-5628-aec2-1916af416587_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81437,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011449/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f02d0f-7d6c-5628-aec2-1916af416587/15f02d0f-7d6c-5628-aec2-1916af416587_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72496,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011481/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f02d0f-7d6c-5628-aec2-1916af416587/15f02d0f-7d6c-5628-aec2-1916af416587_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83984,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011510/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f02d0f-7d6c-5628-aec2-1916af416587/15f02d0f-7d6c-5628-aec2-1916af416587_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84737,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SJ16SYV/699011533/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FORD C-MAX 1.5 TDCI 120 TITANIUM P/S MPV',
'transmission': 'automatic',
'trim': 'TDCI 120 TITANIUM P/S',
'vin': 'WF0VXXGCEVGK06650',
'year': 2016}
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ16%2520SYV%27 HTTP/1.1" 200 None
2026-03-28 22:04:43 [bca.uk] INFO: Saving data for SJ16%20SYV: {'created_time': 1774735483.216078, 'last_price_update_time': 1774735483.216089, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SJ16%2520SYV') HTTP/1.1" 204 0
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251843%27 HTTP/1.1" 200 None
2026-03-28 22:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251843 not downloaded yet
2026-03-28 22:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976368/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY58NPG/42810706?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=m%2BjvjS4%2BeJxyPZhfktFet4Bo%2BpsamHOTjBnjcUc644A%3D)
2026-03-28 22:04:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143332/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143332>
2026-03-28 22:04:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146276/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146276>
2026-03-28 22:04:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143458/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143458>
2026-03-28 22:04:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976355/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976355>
2026-03-28 22:04:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145565/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145565>
2026-03-28 22:04:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN16MXA/42810567?sv=2020-08-04&st=2026-03-28T22%3A04%3A42Z&se=2026-03-28T22%3A29%3A42Z&sr=b&sp=r&sig=fbVjWoKfY7E6uGTD9k2kX09K7vWl8YF1h2J1YBI1O3I%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WN16%20MXA-GB>
2026-03-28 22:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543e85d0>
2026-03-28 22:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b77897-c825-556b-ba96-284dc5a81572/56b77897-c825-556b-ba96-284dc5a81572_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYF07CJE%252F699253656%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253656/600 saved to cache
2026-03-28 22:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 56b77897-c825-556b-ba96-284dc5a81572
2026-03-28 22:04:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 56b77897-c825-556b-ba96-284dc5a81572, skipping ID generation
2026-03-28 22:04:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 56b77897-c825-556b-ba96-284dc5a81572 sending to next pipeline
2026-03-28 22:04:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 56b77897-c825-556b-ba96-284dc5a81572, identifier: YF07%20CJE
2026-03-28 22:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543e8410>
2026-03-28 22:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4878bd96-ecc6-5172-b9f4-32abbb9ae940/4878bd96-ecc6-5172-b9f4-32abbb9ae940_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY14HKC%252F699143465%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143465/600 saved to cache
2026-03-28 22:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4878bd96-ecc6-5172-b9f4-32abbb9ae940
2026-03-28 22:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b7690>
2026-03-28 22:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac2cb512-acf6-577f-a0f2-2fe21a625645/ac2cb512-acf6-577f-a0f2-2fe21a625645_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ63EXO%252F699143336%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143336/600 saved to cache
2026-03-28 22:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac2cb512-acf6-577f-a0f2-2fe21a625645
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251850%27 HTTP/1.1" 200 None
2026-03-28 22:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251850 not downloaded yet
2026-03-28 22:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 56b77897-c825-556b-ba96-284dc5a81572 with identifier: YF07%20CJE
2026-03-28 22:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 56b77897-c825-556b-ba96-284dc5a81572 with identifier: YF07%20CJE
2026-03-28 22:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 56b77897-c825-556b-ba96-284dc5a81572 with identifier: YF07%20CJE to the API
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253656/600>
{'auction_title': '',
'c_o_2_emission_value': 239,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56b77897-c825-556b-ba96-284dc5a81572/56b77897-c825-556b-ba96-284dc5a81572_expert_report_file_84bd16d0-4df1-4ce7-a6c9-eb1aa76729c4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YF07%20CJE-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '56b77897-c825-556b-ba96-284dc5a81572',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YF07 CJE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YF07%20CJE&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VOLVO',
'model': 'XC90',
'odometer': 119982,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56b77897-c825-556b-ba96-284dc5a81572/56b77897-c825-556b-ba96-284dc5a81572_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41606,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253656/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56b77897-c825-556b-ba96-284dc5a81572/56b77897-c825-556b-ba96-284dc5a81572_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42286,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253665/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56b77897-c825-556b-ba96-284dc5a81572/56b77897-c825-556b-ba96-284dc5a81572_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42816,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253672/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56b77897-c825-556b-ba96-284dc5a81572/56b77897-c825-556b-ba96-284dc5a81572_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44450,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253681/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56b77897-c825-556b-ba96-284dc5a81572/56b77897-c825-556b-ba96-284dc5a81572_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40335,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253692/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56b77897-c825-556b-ba96-284dc5a81572/56b77897-c825-556b-ba96-284dc5a81572_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37887,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253698/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56b77897-c825-556b-ba96-284dc5a81572/56b77897-c825-556b-ba96-284dc5a81572_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106684,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253711/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56b77897-c825-556b-ba96-284dc5a81572/56b77897-c825-556b-ba96-284dc5a81572_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84599,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253726/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56b77897-c825-556b-ba96-284dc5a81572/56b77897-c825-556b-ba96-284dc5a81572_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98837,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253742/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56b77897-c825-556b-ba96-284dc5a81572/56b77897-c825-556b-ba96-284dc5a81572_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64093,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF07CJE/699253754/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'VOLVO XC90 2.4 D5 185 SE LUX G/T Estate',
'transmission': 'manual',
'trim': 'D5 185 SE LUX G/T',
'vin': 'YV1CZ714671400964',
'year': 2007}
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF07%2520CJE%27 HTTP/1.1" 200 None
2026-03-28 22:04:43 [bca.uk] INFO: Saving data for YF07%20CJE: {'created_time': 1774735483.888312, 'last_price_update_time': 1774735483.888324, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YF07%2520CJE') HTTP/1.1" 204 0
2026-03-28 22:04:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145325/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145325>
2026-03-28 22:04:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147158/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147158>
2026-03-28 22:04:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143238/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143238>
2026-03-28 22:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146285/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK12WBW/42811322?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=zrDQXpGJ59OXDPhU47QBcrd8BHKRhOWFkFPoLF1d7pk%3D)
2026-03-28 22:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147174/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK11VUF/42811158?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=l8QAasE0E%2FzQR5QTuF2laotj8hcmBnHx0u13mVzzHt8%3D)
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251855%27 HTTP/1.1" 200 None
2026-03-28 22:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251855 not downloaded yet
2026-03-28 22:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145575/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LY64DTU/42811373?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=nlvyE6o%2BjOSTCR6ZUHB9E%2BOFaaB84Hiq02HBTHcoq8g%3D)
2026-03-28 22:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143255/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DV14VNO/42811439?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=AJzvLw0izZRKfov%2BeUrE5UmVQvMJLyUVerbX0NanFzs%3D)
2026-03-28 22:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145335/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM61DYD/42811410?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=bDvqRxwLzIpEHYLUXTs40ur1RioMfasSNgu0Yug2sj4%3D)
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251863%27 HTTP/1.1" 200 None
2026-03-28 22:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251863 not downloaded yet
2026-03-28 22:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548c1b50>
2026-03-28 22:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96f4e7fc-b83e-5062-87d7-e0a26a3eaa65/96f4e7fc-b83e-5062-87d7-e0a26a3eaa65_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY58NPG%252F698976368%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976368/600 saved to cache
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65
2026-03-28 22:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146276/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK12WBW/42811322?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=zrDQXpGJ59OXDPhU47QBcrd8BHKRhOWFkFPoLF1d7pk%3D)
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251870%27 HTTP/1.1" 200 None
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251870 not downloaded yet
2026-03-28 22:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143458/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY14HKC/42811403?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=%2BYxeffQ4HY6floQPvp5Yr65sra111z9jxOTYy7mtf%2FU%3D)
2026-03-28 22:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976355/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY58NPG/42810706?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=m%2BjvjS4%2BeJxyPZhfktFet4Bo%2BpsamHOTjBnjcUc644A%3D)
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251881%27 HTTP/1.1" 200 None
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251881 not downloaded yet
2026-03-28 22:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145565/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LY64DTU/42811373?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=nlvyE6o%2BjOSTCR6ZUHB9E%2BOFaaB84Hiq02HBTHcoq8g%3D)
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251896%27 HTTP/1.1" 200 None
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251896 not downloaded yet
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554909390>
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5057cc2-c58a-5e78-ab90-b97e6edb6582/c5057cc2-c58a-5e78-ab90-b97e6edb6582_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK12WBW%252F699146285%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146285/600 saved to cache
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5057cc2-c58a-5e78-ab90-b97e6edb6582
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542d4390>
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db8298e-1099-5db2-81d1-5141138419a2/3db8298e-1099-5db2-81d1-5141138419a2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK11VUF%252F699147174%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147174/600 saved to cache
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3db8298e-1099-5db2-81d1-5141138419a2
2026-03-28 22:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143332/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ63EXO/42810870?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=wLoUguMiGeygfSRIZDr4SROlj4YBVqcY7mSaCT7eFDc%3D)
2026-03-28 22:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147158/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK11VUF/42811158?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=l8QAasE0E%2FzQR5QTuF2laotj8hcmBnHx0u13mVzzHt8%3D)
2026-03-28 22:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143238/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DV14VNO/42811439?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=AJzvLw0izZRKfov%2BeUrE5UmVQvMJLyUVerbX0NanFzs%3D)
2026-03-28 22:04:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251835/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LT66HCJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251850/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251850>
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251910%27 HTTP/1.1" 200 None
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251910 not downloaded yet
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b70910>
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_782aa18e-a0c9-5c10-9106-d797127b5b2a/782aa18e-a0c9-5c10-9106-d797127b5b2a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLY64DTU%252F699145575%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145575/600 saved to cache
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 782aa18e-a0c9-5c10-9106-d797127b5b2a
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b3aed0>
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b6294-9845-5eb5-8c1d-a1f98760f95e/ef7b6294-9845-5eb5-8c1d-a1f98760f95e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDV14VNO%252F699143255%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143255/600 saved to cache
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ef7b6294-9845-5eb5-8c1d-a1f98760f95e
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474e36d0>
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a59b1b92-68f6-5af6-ad88-8517ad8fae07/a59b1b92-68f6-5af6-ad88-8517ad8fae07_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM61DYD%252F699145335%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145335/600 saved to cache
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a59b1b92-68f6-5af6-ad88-8517ad8fae07
2026-03-28 22:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145325/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM61DYD/42811410?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=bDvqRxwLzIpEHYLUXTs40ur1RioMfasSNgu0Yug2sj4%3D)
2026-03-28 22:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN16MXA/42810567?sv=2020-08-04&st=2026-03-28T22%3A04%3A42Z&se=2026-03-28T22%3A29%3A42Z&sr=b&sp=r&sig=fbVjWoKfY7E6uGTD9k2kX09K7vWl8YF1h2J1YBI1O3I%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251843/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251843>
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251922%27 HTTP/1.1" 200 None
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251922 not downloaded yet
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547263d10>
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5057cc2-c58a-5e78-ab90-b97e6edb6582/c5057cc2-c58a-5e78-ab90-b97e6edb6582_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK12WBW%252F699146276%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146276/600 saved to cache
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5057cc2-c58a-5e78-ab90-b97e6edb6582
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547642610>
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4878bd96-ecc6-5172-b9f4-32abbb9ae940/4878bd96-ecc6-5172-b9f4-32abbb9ae940_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY14HKC%252F699143458%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143458/600 saved to cache
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4878bd96-ecc6-5172-b9f4-32abbb9ae940
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54723b050>
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96f4e7fc-b83e-5062-87d7-e0a26a3eaa65/96f4e7fc-b83e-5062-87d7-e0a26a3eaa65_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY58NPG%252F698976355%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976355/600 saved to cache
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549cb410>
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_782aa18e-a0c9-5c10-9106-d797127b5b2a/782aa18e-a0c9-5c10-9106-d797127b5b2a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLY64DTU%252F699145565%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145565/600 saved to cache
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 782aa18e-a0c9-5c10-9106-d797127b5b2a
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474b8a90>
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac2cb512-acf6-577f-a0f2-2fe21a625645/ac2cb512-acf6-577f-a0f2-2fe21a625645_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ63EXO%252F699143332%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143332/600 saved to cache
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac2cb512-acf6-577f-a0f2-2fe21a625645
2026-03-28 22:04:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac2cb512-acf6-577f-a0f2-2fe21a625645, skipping ID generation
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac2cb512-acf6-577f-a0f2-2fe21a625645 sending to next pipeline
2026-03-28 22:04:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ac2cb512-acf6-577f-a0f2-2fe21a625645, identifier: EJ63%20EXO
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54717f290>
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db8298e-1099-5db2-81d1-5141138419a2/3db8298e-1099-5db2-81d1-5141138419a2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK11VUF%252F699147158%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147158/600 saved to cache
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3db8298e-1099-5db2-81d1-5141138419a2
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5476402d0>
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b6294-9845-5eb5-8c1d-a1f98760f95e/ef7b6294-9845-5eb5-8c1d-a1f98760f95e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDV14VNO%252F699143238%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143238/600 saved to cache
2026-03-28 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ef7b6294-9845-5eb5-8c1d-a1f98760f95e
2026-03-28 22:04:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ac2cb512-acf6-577f-a0f2-2fe21a625645 with identifier: EJ63%20EXO
2026-03-28 22:04:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ac2cb512-acf6-577f-a0f2-2fe21a625645 with identifier: EJ63%20EXO
2026-03-28 22:04:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ac2cb512-acf6-577f-a0f2-2fe21a625645 with identifier: EJ63%20EXO to the API
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143332/600>
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac2cb512-acf6-577f-a0f2-2fe21a625645/ac2cb512-acf6-577f-a0f2-2fe21a625645_expert_report_file_976cecb9-9151-468e-9693-ae3ad804f9d3.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EJ63%20EXO-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ac2cb512-acf6-577f-a0f2-2fe21a625645',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EJ63 EXO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EJ63%20EXO&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 53652,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac2cb512-acf6-577f-a0f2-2fe21a625645/ac2cb512-acf6-577f-a0f2-2fe21a625645_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53538,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143318/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac2cb512-acf6-577f-a0f2-2fe21a625645/ac2cb512-acf6-577f-a0f2-2fe21a625645_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50070,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143325/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac2cb512-acf6-577f-a0f2-2fe21a625645/ac2cb512-acf6-577f-a0f2-2fe21a625645_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50588,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143332/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac2cb512-acf6-577f-a0f2-2fe21a625645/ac2cb512-acf6-577f-a0f2-2fe21a625645_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52858,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143336/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac2cb512-acf6-577f-a0f2-2fe21a625645/ac2cb512-acf6-577f-a0f2-2fe21a625645_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50101,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143345/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac2cb512-acf6-577f-a0f2-2fe21a625645/ac2cb512-acf6-577f-a0f2-2fe21a625645_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48047,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143353/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac2cb512-acf6-577f-a0f2-2fe21a625645/ac2cb512-acf6-577f-a0f2-2fe21a625645_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99835,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143370/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac2cb512-acf6-577f-a0f2-2fe21a625645/ac2cb512-acf6-577f-a0f2-2fe21a625645_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73805,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143387/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac2cb512-acf6-577f-a0f2-2fe21a625645/ac2cb512-acf6-577f-a0f2-2fe21a625645_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91227,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143401/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac2cb512-acf6-577f-a0f2-2fe21a625645/ac2cb512-acf6-577f-a0f2-2fe21a625645_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87021,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ63EXO/699143413/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.2 82 ZETEC Hatchback',
'transmission': 'manual',
'trim': '82 ZETEC',
'vin': 'WF0DXXGAKDEL88377',
'year': 2014}
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ63%2520EXO%27 HTTP/1.1" 200 None
2026-03-28 22:04:45 [bca.uk] INFO: Saving data for EJ63%20EXO: {'created_time': 1774735485.061207, 'last_price_update_time': 1774735485.061223, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EJ63%2520EXO') HTTP/1.1" 204 0
2026-03-28 22:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251855/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251855>
2026-03-28 22:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976336/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976336>
2026-03-28 22:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251870/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251870>
2026-03-28 22:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251863/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251863>
2026-03-28 22:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143452/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143452>
2026-03-28 22:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VF15KKY/42810796?sv=2020-08-04&st=2026-03-28T22%3A04%3A44Z&se=2026-03-28T22%3A29%3A44Z&sr=b&sp=r&sig=N7cgNbL%2FASZL5X1rnPo5iRbHozMBybglsDq6dl%2BjyDQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VF15%20KKY-GB>
2026-03-28 22:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251850/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT66HCJ/42797462?sv=2020-08-04&st=2026-03-28T22%3A04%3A39Z&se=2026-03-28T22%3A29%3A39Z&sr=b&sp=r&sig=VJeDgqSMnD6SI2b%2FRQMkxxcpFu7sCUpLlSyJDS8Or6A%3D)
2026-03-28 22:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251881/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251881>
2026-03-28 22:04:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473b94d0>
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a59b1b92-68f6-5af6-ad88-8517ad8fae07/a59b1b92-68f6-5af6-ad88-8517ad8fae07_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM61DYD%252F699145325%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145325/600 saved to cache
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a59b1b92-68f6-5af6-ad88-8517ad8fae07
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472e5ed0>
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4011303-c936-5ad4-909d-9af520e69082/c4011303-c936-5ad4-909d-9af520e69082_expert_report_file_2d225adc-2f4e-4419-9162-fca6dac17fc7.pdf HTTP/1.1" 201 0
2026-03-28 22:04:45 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c4011303-c936-5ad4-909d-9af520e69082
2026-03-28 22:04:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c4011303-c936-5ad4-909d-9af520e69082, skipping ID generation
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c4011303-c936-5ad4-909d-9af520e69082
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWN16MXA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WN16MXA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981069%27 HTTP/1.1" 200 None
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981069 not downloaded yet
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981094%27 HTTP/1.1" 200 None
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981094 not downloaded yet
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981117%27 HTTP/1.1" 200 None
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981117 not downloaded yet
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472abf10>
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c346eec4-40ba-53d7-bb4d-ada017b4776d/c346eec4-40ba-53d7-bb4d-ada017b4776d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT66HCJ%252F699251850%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251850/600 saved to cache
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c346eec4-40ba-53d7-bb4d-ada017b4776d
2026-03-28 22:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251835/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT66HCJ/42797462?sv=2020-08-04&st=2026-03-28T22%3A04%3A39Z&se=2026-03-28T22%3A29%3A39Z&sr=b&sp=r&sig=VJeDgqSMnD6SI2b%2FRQMkxxcpFu7sCUpLlSyJDS8Or6A%3D)
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981134%27 HTTP/1.1" 200 None
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981134 not downloaded yet
2026-03-28 22:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145316/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145316>
2026-03-28 22:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251910/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251910>
2026-03-28 22:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251843/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT66HCJ/42797462?sv=2020-08-04&st=2026-03-28T22%3A04%3A39Z&se=2026-03-28T22%3A29%3A39Z&sr=b&sp=r&sig=VJeDgqSMnD6SI2b%2FRQMkxxcpFu7sCUpLlSyJDS8Or6A%3D)
2026-03-28 22:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145558/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145558>
2026-03-28 22:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146268/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146268>
2026-03-28 22:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251896/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251896>
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981149%27 HTTP/1.1" 200 None
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981149 not downloaded yet
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981191%27 HTTP/1.1" 200 None
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981191 not downloaded yet
2026-03-28 22:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251881/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT66HCJ/42797462?sv=2020-08-04&st=2026-03-28T22%3A04%3A39Z&se=2026-03-28T22%3A29%3A39Z&sr=b&sp=r&sig=VJeDgqSMnD6SI2b%2FRQMkxxcpFu7sCUpLlSyJDS8Or6A%3D)
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981228%27 HTTP/1.1" 200 None
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981228 not downloaded yet
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981283%27 HTTP/1.1" 200 None
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981283 not downloaded yet
2026-03-28 22:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251922/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251922>
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981312%27 HTTP/1.1" 200 None
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981312 not downloaded yet
2026-03-28 22:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976336/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY58NPG/42810706?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=m%2BjvjS4%2BeJxyPZhfktFet4Bo%2BpsamHOTjBnjcUc644A%3D)
2026-03-28 22:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143452/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY14HKC/42811403?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=%2BYxeffQ4HY6floQPvp5Yr65sra111z9jxOTYy7mtf%2FU%3D)
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471698d0>
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c346eec4-40ba-53d7-bb4d-ada017b4776d/c346eec4-40ba-53d7-bb4d-ada017b4776d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT66HCJ%252F699251835%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251835/600 saved to cache
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c346eec4-40ba-53d7-bb4d-ada017b4776d
2026-03-28 22:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251863/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT66HCJ/42797462?sv=2020-08-04&st=2026-03-28T22%3A04%3A39Z&se=2026-03-28T22%3A29%3A39Z&sr=b&sp=r&sig=VJeDgqSMnD6SI2b%2FRQMkxxcpFu7sCUpLlSyJDS8Or6A%3D)
2026-03-28 22:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251870/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT66HCJ/42797462?sv=2020-08-04&st=2026-03-28T22%3A04%3A39Z&se=2026-03-28T22%3A29%3A39Z&sr=b&sp=r&sig=VJeDgqSMnD6SI2b%2FRQMkxxcpFu7sCUpLlSyJDS8Or6A%3D)
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472bedd0>
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c346eec4-40ba-53d7-bb4d-ada017b4776d/c346eec4-40ba-53d7-bb4d-ada017b4776d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT66HCJ%252F699251843%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251843/600 saved to cache
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c346eec4-40ba-53d7-bb4d-ada017b4776d
2026-03-28 22:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251855/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT66HCJ/42797462?sv=2020-08-04&st=2026-03-28T22%3A04%3A39Z&se=2026-03-28T22%3A29%3A39Z&sr=b&sp=r&sig=VJeDgqSMnD6SI2b%2FRQMkxxcpFu7sCUpLlSyJDS8Or6A%3D)
2026-03-28 22:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251896/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT66HCJ/42797462?sv=2020-08-04&st=2026-03-28T22%3A04%3A39Z&se=2026-03-28T22%3A29%3A39Z&sr=b&sp=r&sig=VJeDgqSMnD6SI2b%2FRQMkxxcpFu7sCUpLlSyJDS8Or6A%3D)
2026-03-28 22:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146268/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK12WBW/42811322?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=zrDQXpGJ59OXDPhU47QBcrd8BHKRhOWFkFPoLF1d7pk%3D)
2026-03-28 22:04:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472bc590>
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c346eec4-40ba-53d7-bb4d-ada017b4776d/c346eec4-40ba-53d7-bb4d-ada017b4776d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT66HCJ%252F699251881%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251881/600 saved to cache
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c346eec4-40ba-53d7-bb4d-ada017b4776d
2026-03-28 22:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145558/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LY64DTU/42811373?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=nlvyE6o%2BjOSTCR6ZUHB9E%2BOFaaB84Hiq02HBTHcoq8g%3D)
2026-03-28 22:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VF15KKY/42810796?sv=2020-08-04&st=2026-03-28T22%3A04%3A44Z&se=2026-03-28T22%3A29%3A44Z&sr=b&sp=r&sig=N7cgNbL%2FASZL5X1rnPo5iRbHozMBybglsDq6dl%2BjyDQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145316/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM61DYD/42811410?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=bDvqRxwLzIpEHYLUXTs40ur1RioMfasSNgu0Yug2sj4%3D)
2026-03-28 22:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251910/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT66HCJ/42797462?sv=2020-08-04&st=2026-03-28T22%3A04%3A39Z&se=2026-03-28T22%3A29%3A39Z&sr=b&sp=r&sig=VJeDgqSMnD6SI2b%2FRQMkxxcpFu7sCUpLlSyJDS8Or6A%3D)
2026-03-28 22:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981117/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981117>
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54717d790>
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96f4e7fc-b83e-5062-87d7-e0a26a3eaa65/96f4e7fc-b83e-5062-87d7-e0a26a3eaa65_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY58NPG%252F698976336%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976336/600 saved to cache
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65
2026-03-28 22:04:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65, skipping ID generation
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65 sending to next pipeline
2026-03-28 22:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65, identifier: HY58%20NPG
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5573ac0d0>
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4878bd96-ecc6-5172-b9f4-32abbb9ae940/4878bd96-ecc6-5172-b9f4-32abbb9ae940_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY14HKC%252F699143452%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143452/600 saved to cache
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4878bd96-ecc6-5172-b9f4-32abbb9ae940
2026-03-28 22:04:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4878bd96-ecc6-5172-b9f4-32abbb9ae940, skipping ID generation
2026-03-28 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4878bd96-ecc6-5172-b9f4-32abbb9ae940 sending to next pipeline
2026-03-28 22:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4878bd96-ecc6-5172-b9f4-32abbb9ae940, identifier: EY14%20HKC
2026-03-28 22:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65 with identifier: HY58%20NPG
2026-03-28 22:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65 with identifier: HY58%20NPG
2026-03-28 22:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65 with identifier: HY58%20NPG to the API
2026-03-28 22:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976336/600>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96f4e7fc-b83e-5062-87d7-e0a26a3eaa65/96f4e7fc-b83e-5062-87d7-e0a26a3eaa65_expert_report_file_53a8077b-b695-478e-a52d-0bce4948ff90.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HY58%20NPG-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '96f4e7fc-b83e-5062-87d7-e0a26a3eaa65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HY58 NPG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HY58%20NPG&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 140520,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96f4e7fc-b83e-5062-87d7-e0a26a3eaa65/96f4e7fc-b83e-5062-87d7-e0a26a3eaa65_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42526,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976330/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96f4e7fc-b83e-5062-87d7-e0a26a3eaa65/96f4e7fc-b83e-5062-87d7-e0a26a3eaa65_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41270,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976336/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96f4e7fc-b83e-5062-87d7-e0a26a3eaa65/96f4e7fc-b83e-5062-87d7-e0a26a3eaa65_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40031,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976355/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96f4e7fc-b83e-5062-87d7-e0a26a3eaa65/96f4e7fc-b83e-5062-87d7-e0a26a3eaa65_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40671,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976368/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96f4e7fc-b83e-5062-87d7-e0a26a3eaa65/96f4e7fc-b83e-5062-87d7-e0a26a3eaa65_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39000,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976387/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96f4e7fc-b83e-5062-87d7-e0a26a3eaa65/96f4e7fc-b83e-5062-87d7-e0a26a3eaa65_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36749,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976406/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96f4e7fc-b83e-5062-87d7-e0a26a3eaa65/96f4e7fc-b83e-5062-87d7-e0a26a3eaa65_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93223,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976442/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96f4e7fc-b83e-5062-87d7-e0a26a3eaa65/96f4e7fc-b83e-5062-87d7-e0a26a3eaa65_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79321,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976472/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96f4e7fc-b83e-5062-87d7-e0a26a3eaa65/96f4e7fc-b83e-5062-87d7-e0a26a3eaa65_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89142,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976491/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96f4e7fc-b83e-5062-87d7-e0a26a3eaa65/96f4e7fc-b83e-5062-87d7-e0a26a3eaa65_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85291,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY58NPG/698976518/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.6 ACENTA S Hatchback',
'transmission': 'automatic',
'trim': 'ACENTA S',
'vin': 'SJNFCAE11U1305326',
'year': 2008}
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY58%2520NPG%27 HTTP/1.1" 200 None
2026-03-28 22:04:46 [bca.uk] INFO: Saving data for HY58%20NPG: {'created_time': 1774735486.209775, 'last_price_update_time': 1774735486.20979, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HY58%2520NPG') HTTP/1.1" 204 0
2026-03-28 22:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4878bd96-ecc6-5172-b9f4-32abbb9ae940 with identifier: EY14%20HKC
2026-03-28 22:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4878bd96-ecc6-5172-b9f4-32abbb9ae940 with identifier: EY14%20HKC
2026-03-28 22:04:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4878bd96-ecc6-5172-b9f4-32abbb9ae940 with identifier: EY14%20HKC to the API
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143452/600>
{'auction_title': '',
'c_o_2_emission_value': 98,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4878bd96-ecc6-5172-b9f4-32abbb9ae940/4878bd96-ecc6-5172-b9f4-32abbb9ae940_expert_report_file_cb991dfc-6fc9-43c0-96ff-9e2a0a19feca.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EY14%20HKC-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4878bd96-ecc6-5172-b9f4-32abbb9ae940',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EY14 HKC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EY14%20HKC&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'PEUGEOT',
'model': '2008',
'odometer': 58304,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4878bd96-ecc6-5172-b9f4-32abbb9ae940/4878bd96-ecc6-5172-b9f4-32abbb9ae940_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50279,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143445/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4878bd96-ecc6-5172-b9f4-32abbb9ae940/4878bd96-ecc6-5172-b9f4-32abbb9ae940_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47003,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143452/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4878bd96-ecc6-5172-b9f4-32abbb9ae940/4878bd96-ecc6-5172-b9f4-32abbb9ae940_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45640,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143458/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4878bd96-ecc6-5172-b9f4-32abbb9ae940/4878bd96-ecc6-5172-b9f4-32abbb9ae940_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46525,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143465/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4878bd96-ecc6-5172-b9f4-32abbb9ae940/4878bd96-ecc6-5172-b9f4-32abbb9ae940_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47391,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143476/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4878bd96-ecc6-5172-b9f4-32abbb9ae940/4878bd96-ecc6-5172-b9f4-32abbb9ae940_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44954,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143481/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4878bd96-ecc6-5172-b9f4-32abbb9ae940/4878bd96-ecc6-5172-b9f4-32abbb9ae940_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89444,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143490/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4878bd96-ecc6-5172-b9f4-32abbb9ae940/4878bd96-ecc6-5172-b9f4-32abbb9ae940_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65535,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143507/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4878bd96-ecc6-5172-b9f4-32abbb9ae940/4878bd96-ecc6-5172-b9f4-32abbb9ae940_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84298,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143527/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4878bd96-ecc6-5172-b9f4-32abbb9ae940/4878bd96-ecc6-5172-b9f4-32abbb9ae940_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91339,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY14HKC/699143551/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'PEUGEOT 2008 1.6 E-HDI ALLURE EGC MPV',
'transmission': 'automatic',
'trim': 'E-HDI ALLURE EGC',
'vin': 'VF3CU9HP8EY018378',
'year': 2014}
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY14%2520HKC%27 HTTP/1.1" 200 None
2026-03-28 22:04:46 [bca.uk] INFO: Saving data for EY14%20HKC: {'created_time': 1774735486.577863, 'last_price_update_time': 1774735486.577876, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EY14%2520HKC') HTTP/1.1" 204 0
2026-03-28 22:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981094/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981094>
2026-03-28 22:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981149/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981149>
2026-03-28 22:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981134/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981134>
2026-03-28 22:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981191/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981191>
2026-03-28 22:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981312/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981312>
2026-03-28 22:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981283/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981283>
2026-03-28 22:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981228/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981228>
2026-03-28 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251922/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT66HCJ/42797462?sv=2020-08-04&st=2026-03-28T22%3A04%3A39Z&se=2026-03-28T22%3A29%3A39Z&sr=b&sp=r&sig=VJeDgqSMnD6SI2b%2FRQMkxxcpFu7sCUpLlSyJDS8Or6A%3D)
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b21250>
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c346eec4-40ba-53d7-bb4d-ada017b4776d/c346eec4-40ba-53d7-bb4d-ada017b4776d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT66HCJ%252F699251863%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251863/600 saved to cache
2026-03-28 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c346eec4-40ba-53d7-bb4d-ada017b4776d
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554302850>
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c346eec4-40ba-53d7-bb4d-ada017b4776d/c346eec4-40ba-53d7-bb4d-ada017b4776d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT66HCJ%252F699251870%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251870/600 saved to cache
2026-03-28 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c346eec4-40ba-53d7-bb4d-ada017b4776d
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547265450>
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c346eec4-40ba-53d7-bb4d-ada017b4776d/c346eec4-40ba-53d7-bb4d-ada017b4776d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT66HCJ%252F699251855%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251855/600 saved to cache
2026-03-28 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c346eec4-40ba-53d7-bb4d-ada017b4776d
2026-03-28 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474f4e10>
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c346eec4-40ba-53d7-bb4d-ada017b4776d/c346eec4-40ba-53d7-bb4d-ada017b4776d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT66HCJ%252F699251896%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251896/600 saved to cache
2026-03-28 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c346eec4-40ba-53d7-bb4d-ada017b4776d
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547265fd0>
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5057cc2-c58a-5e78-ab90-b97e6edb6582/c5057cc2-c58a-5e78-ab90-b97e6edb6582_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK12WBW%252F699146268%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146268/600 saved to cache
2026-03-28 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5057cc2-c58a-5e78-ab90-b97e6edb6582
2026-03-28 22:04:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5057cc2-c58a-5e78-ab90-b97e6edb6582, skipping ID generation
2026-03-28 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5057cc2-c58a-5e78-ab90-b97e6edb6582 sending to next pipeline
2026-03-28 22:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c5057cc2-c58a-5e78-ab90-b97e6edb6582, identifier: RK12%20WBW
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471f5750>
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_782aa18e-a0c9-5c10-9106-d797127b5b2a/782aa18e-a0c9-5c10-9106-d797127b5b2a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLY64DTU%252F699145558%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145558/600 saved to cache
2026-03-28 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 782aa18e-a0c9-5c10-9106-d797127b5b2a
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b80590>
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a29049-d0cb-5ad0-80d6-fe24d9cb8763/a3a29049-d0cb-5ad0-80d6-fe24d9cb8763_expert_report_file_5ca79e0a-b2e5-4d73-9155-fa7d95ada42c.pdf HTTP/1.1" 201 0
2026-03-28 22:04:46 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a3a29049-d0cb-5ad0-80d6-fe24d9cb8763
2026-03-28 22:04:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3a29049-d0cb-5ad0-80d6-fe24d9cb8763, skipping ID generation
2026-03-28 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3a29049-d0cb-5ad0-80d6-fe24d9cb8763
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DVF15KKY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VF15KKY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474866d0>
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a59b1b92-68f6-5af6-ad88-8517ad8fae07/a59b1b92-68f6-5af6-ad88-8517ad8fae07_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM61DYD%252F699145316%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145316/600 saved to cache
2026-03-28 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a59b1b92-68f6-5af6-ad88-8517ad8fae07
2026-03-28 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547297150>
2026-03-28 22:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c346eec4-40ba-53d7-bb4d-ada017b4776d/c346eec4-40ba-53d7-bb4d-ada017b4776d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT66HCJ%252F699251910%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251910/600 saved to cache
2026-03-28 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c346eec4-40ba-53d7-bb4d-ada017b4776d
2026-03-28 22:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c5057cc2-c58a-5e78-ab90-b97e6edb6582 with identifier: RK12%20WBW
2026-03-28 22:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c5057cc2-c58a-5e78-ab90-b97e6edb6582 with identifier: RK12%20WBW
2026-03-28 22:04:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c5057cc2-c58a-5e78-ab90-b97e6edb6582 with identifier: RK12%20WBW to the API
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146268/600>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5057cc2-c58a-5e78-ab90-b97e6edb6582/c5057cc2-c58a-5e78-ab90-b97e6edb6582_expert_report_file_3f97b53c-6504-44bd-96e8-397bf57e0ce7.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RK12%20WBW-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c5057cc2-c58a-5e78-ab90-b97e6edb6582',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RK12 WBW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RK12%20WBW&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MINI',
'model': 'COUNTRYMAN',
'odometer': 125648,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5057cc2-c58a-5e78-ab90-b97e6edb6582/c5057cc2-c58a-5e78-ab90-b97e6edb6582_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50153,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146260/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5057cc2-c58a-5e78-ab90-b97e6edb6582/c5057cc2-c58a-5e78-ab90-b97e6edb6582_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46566,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146268/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5057cc2-c58a-5e78-ab90-b97e6edb6582/c5057cc2-c58a-5e78-ab90-b97e6edb6582_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45517,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146276/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5057cc2-c58a-5e78-ab90-b97e6edb6582/c5057cc2-c58a-5e78-ab90-b97e6edb6582_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47359,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146285/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5057cc2-c58a-5e78-ab90-b97e6edb6582/c5057cc2-c58a-5e78-ab90-b97e6edb6582_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47049,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146292/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5057cc2-c58a-5e78-ab90-b97e6edb6582/c5057cc2-c58a-5e78-ab90-b97e6edb6582_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43065,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146298/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5057cc2-c58a-5e78-ab90-b97e6edb6582/c5057cc2-c58a-5e78-ab90-b97e6edb6582_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94375,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146306/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5057cc2-c58a-5e78-ab90-b97e6edb6582/c5057cc2-c58a-5e78-ab90-b97e6edb6582_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62105,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146324/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5057cc2-c58a-5e78-ab90-b97e6edb6582/c5057cc2-c58a-5e78-ab90-b97e6edb6582_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91546,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146339/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5057cc2-c58a-5e78-ab90-b97e6edb6582/c5057cc2-c58a-5e78-ab90-b97e6edb6582_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81853,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK12WBW/699146354/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'MINI COUNTRYMAN 2.0 COOPER D ALL4 Hatchback',
'transmission': 'automatic',
'trim': 'COOPER D ALL4',
'vin': 'WMWXD52070WK79275',
'year': 2012}
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK12%2520WBW%27 HTTP/1.1" 200 None
2026-03-28 22:04:47 [bca.uk] INFO: Saving data for RK12%20WBW: {'created_time': 1774735487.428394, 'last_price_update_time': 1774735487.428405, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RK12%2520WBW') HTTP/1.1" 204 0
2026-03-28 22:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143201/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143201>
2026-03-28 22:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981069/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981069>
2026-03-28 22:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143221/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143221>
2026-03-28 22:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981045/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WN16MXA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147148/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147148>
2026-03-28 22:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KK07YAO/42811138?sv=2020-08-04&st=2026-03-28T22%3A04%3A46Z&se=2026-03-28T22%3A29%3A46Z&sr=b&sp=r&sig=1C6k7rD9GVDdvldVXIZ6nSQFIPqifpaJzEcpMuZ23pI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KK07%20YAO-GB>
2026-03-28 22:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981117/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN16MXA/42810567?sv=2020-08-04&st=2026-03-28T22%3A04%3A42Z&se=2026-03-28T22%3A29%3A42Z&sr=b&sp=r&sig=fbVjWoKfY7E6uGTD9k2kX09K7vWl8YF1h2J1YBI1O3I%3D)
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699247093%27 HTTP/1.1" 200 None
2026-03-28 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699247093 not downloaded yet
2026-03-28 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b72090>
2026-03-28 22:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c346eec4-40ba-53d7-bb4d-ada017b4776d/c346eec4-40ba-53d7-bb4d-ada017b4776d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT66HCJ%252F699251922%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251922/600 saved to cache
2026-03-28 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c346eec4-40ba-53d7-bb4d-ada017b4776d
2026-03-28 22:04:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c346eec4-40ba-53d7-bb4d-ada017b4776d, skipping ID generation
2026-03-28 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c346eec4-40ba-53d7-bb4d-ada017b4776d sending to next pipeline
2026-03-28 22:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c346eec4-40ba-53d7-bb4d-ada017b4776d, identifier: LT66%20HCJ
2026-03-28 22:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981228/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN16MXA/42810567?sv=2020-08-04&st=2026-03-28T22%3A04%3A42Z&se=2026-03-28T22%3A29%3A42Z&sr=b&sp=r&sig=fbVjWoKfY7E6uGTD9k2kX09K7vWl8YF1h2J1YBI1O3I%3D)
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699247100%27 HTTP/1.1" 200 None
2026-03-28 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699247100 not downloaded yet
2026-03-28 22:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c346eec4-40ba-53d7-bb4d-ada017b4776d with identifier: LT66%20HCJ
2026-03-28 22:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c346eec4-40ba-53d7-bb4d-ada017b4776d with identifier: LT66%20HCJ
2026-03-28 22:04:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c346eec4-40ba-53d7-bb4d-ada017b4776d with identifier: LT66%20HCJ to the API
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251922/600>
{'auction_title': '',
'c_o_2_emission_value': 87,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c346eec4-40ba-53d7-bb4d-ada017b4776d/c346eec4-40ba-53d7-bb4d-ada017b4776d_expert_report_file_2c427876-fb4b-4dc9-91e0-6aa66f86db23.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT66%20HCJ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c346eec4-40ba-53d7-bb4d-ada017b4776d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LT66 HCJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LT66%20HCJ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'DS AUTOMOBILES',
'model': 'DS 3',
'odometer': 78739,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c346eec4-40ba-53d7-bb4d-ada017b4776d/c346eec4-40ba-53d7-bb4d-ada017b4776d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38783,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251835/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c346eec4-40ba-53d7-bb4d-ada017b4776d/c346eec4-40ba-53d7-bb4d-ada017b4776d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39867,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251843/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c346eec4-40ba-53d7-bb4d-ada017b4776d/c346eec4-40ba-53d7-bb4d-ada017b4776d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36851,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251850/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c346eec4-40ba-53d7-bb4d-ada017b4776d/c346eec4-40ba-53d7-bb4d-ada017b4776d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36630,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251855/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c346eec4-40ba-53d7-bb4d-ada017b4776d/c346eec4-40ba-53d7-bb4d-ada017b4776d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35359,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251863/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c346eec4-40ba-53d7-bb4d-ada017b4776d/c346eec4-40ba-53d7-bb4d-ada017b4776d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36031,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251870/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c346eec4-40ba-53d7-bb4d-ada017b4776d/c346eec4-40ba-53d7-bb4d-ada017b4776d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82871,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251881/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c346eec4-40ba-53d7-bb4d-ada017b4776d/c346eec4-40ba-53d7-bb4d-ada017b4776d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58143,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251896/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c346eec4-40ba-53d7-bb4d-ada017b4776d/c346eec4-40ba-53d7-bb4d-ada017b4776d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87944,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251910/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c346eec4-40ba-53d7-bb4d-ada017b4776d/c346eec4-40ba-53d7-bb4d-ada017b4776d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96199,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT66HCJ/699251922/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'DS AUTOMOBILES DS 3 1.6 BLUEHDI 100 ELEGANCE Hatchback',
'transmission': 'manual',
'trim': 'BLUEHDI 100 ELEGANCE',
'vin': 'VF7SABHY6GW614383',
'year': 2016}
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT66%2520HCJ%27 HTTP/1.1" 200 None
2026-03-28 22:04:47 [bca.uk] INFO: Saving data for LT66%20HCJ: {'created_time': 1774735487.977072, 'last_price_update_time': 1774735487.977089, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LT66%2520HCJ') HTTP/1.1" 204 0
2026-03-28 22:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981094/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN16MXA/42810567?sv=2020-08-04&st=2026-03-28T22%3A04%3A42Z&se=2026-03-28T22%3A29%3A42Z&sr=b&sp=r&sig=fbVjWoKfY7E6uGTD9k2kX09K7vWl8YF1h2J1YBI1O3I%3D)
2026-03-28 22:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147135/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147135>
2026-03-28 22:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981149/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN16MXA/42810567?sv=2020-08-04&st=2026-03-28T22%3A04%3A42Z&se=2026-03-28T22%3A29%3A42Z&sr=b&sp=r&sig=fbVjWoKfY7E6uGTD9k2kX09K7vWl8YF1h2J1YBI1O3I%3D)
2026-03-28 22:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981134/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN16MXA/42810567?sv=2020-08-04&st=2026-03-28T22%3A04%3A42Z&se=2026-03-28T22%3A29%3A42Z&sr=b&sp=r&sig=fbVjWoKfY7E6uGTD9k2kX09K7vWl8YF1h2J1YBI1O3I%3D)
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699247109%27 HTTP/1.1" 200 None
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699247109 not downloaded yet
2026-03-28 22:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981283/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN16MXA/42810567?sv=2020-08-04&st=2026-03-28T22%3A04%3A42Z&se=2026-03-28T22%3A29%3A42Z&sr=b&sp=r&sig=fbVjWoKfY7E6uGTD9k2kX09K7vWl8YF1h2J1YBI1O3I%3D)
2026-03-28 22:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981312/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN16MXA/42810567?sv=2020-08-04&st=2026-03-28T22%3A04%3A42Z&se=2026-03-28T22%3A29%3A42Z&sr=b&sp=r&sig=fbVjWoKfY7E6uGTD9k2kX09K7vWl8YF1h2J1YBI1O3I%3D)
2026-03-28 22:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981191/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN16MXA/42810567?sv=2020-08-04&st=2026-03-28T22%3A04%3A42Z&se=2026-03-28T22%3A29%3A42Z&sr=b&sp=r&sig=fbVjWoKfY7E6uGTD9k2kX09K7vWl8YF1h2J1YBI1O3I%3D)
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542fff90>
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4011303-c936-5ad4-909d-9af520e69082/c4011303-c936-5ad4-909d-9af520e69082_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN16MXA%252F698981117%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981117/600 saved to cache
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c4011303-c936-5ad4-909d-9af520e69082
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548ba550>
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4011303-c936-5ad4-909d-9af520e69082/c4011303-c936-5ad4-909d-9af520e69082_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN16MXA%252F698981228%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981228/600 saved to cache
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c4011303-c936-5ad4-909d-9af520e69082
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699247116%27 HTTP/1.1" 200 None
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699247116 not downloaded yet
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699247123%27 HTTP/1.1" 200 None
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699247123 not downloaded yet
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54710cd10>
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4011303-c936-5ad4-909d-9af520e69082/c4011303-c936-5ad4-909d-9af520e69082_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN16MXA%252F698981094%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981094/600 saved to cache
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c4011303-c936-5ad4-909d-9af520e69082
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a8e110>
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4011303-c936-5ad4-909d-9af520e69082/c4011303-c936-5ad4-909d-9af520e69082_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN16MXA%252F698981149%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981149/600 saved to cache
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c4011303-c936-5ad4-909d-9af520e69082
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477a7d90>
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4011303-c936-5ad4-909d-9af520e69082/c4011303-c936-5ad4-909d-9af520e69082_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN16MXA%252F698981134%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981134/600 saved to cache
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c4011303-c936-5ad4-909d-9af520e69082
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557132990>
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4011303-c936-5ad4-909d-9af520e69082/c4011303-c936-5ad4-909d-9af520e69082_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN16MXA%252F698981283%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981283/600 saved to cache
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c4011303-c936-5ad4-909d-9af520e69082
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b6e10>
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4011303-c936-5ad4-909d-9af520e69082/c4011303-c936-5ad4-909d-9af520e69082_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN16MXA%252F698981312%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981312/600 saved to cache
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c4011303-c936-5ad4-909d-9af520e69082
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a8e810>
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4011303-c936-5ad4-909d-9af520e69082/c4011303-c936-5ad4-909d-9af520e69082_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN16MXA%252F698981191%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981191/600 saved to cache
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c4011303-c936-5ad4-909d-9af520e69082
2026-03-28 22:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981045/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN16MXA/42810567?sv=2020-08-04&st=2026-03-28T22%3A04%3A42Z&se=2026-03-28T22%3A29%3A42Z&sr=b&sp=r&sig=fbVjWoKfY7E6uGTD9k2kX09K7vWl8YF1h2J1YBI1O3I%3D)
2026-03-28 22:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143201/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DV14VNO/42811439?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=AJzvLw0izZRKfov%2BeUrE5UmVQvMJLyUVerbX0NanFzs%3D)
2026-03-28 22:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247093/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699247093>
2026-03-28 22:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981069/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN16MXA/42810567?sv=2020-08-04&st=2026-03-28T22%3A04%3A42Z&se=2026-03-28T22%3A29%3A42Z&sr=b&sp=r&sig=fbVjWoKfY7E6uGTD9k2kX09K7vWl8YF1h2J1YBI1O3I%3D)
2026-03-28 22:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247087/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VF15KKY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699247140%27 HTTP/1.1" 200 None
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699247140 not downloaded yet
2026-03-28 22:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KK07YAO/42811138?sv=2020-08-04&st=2026-03-28T22%3A04%3A46Z&se=2026-03-28T22%3A29%3A46Z&sr=b&sp=r&sig=1C6k7rD9GVDdvldVXIZ6nSQFIPqifpaJzEcpMuZ23pI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147148/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK11VUF/42811158?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=l8QAasE0E%2FzQR5QTuF2laotj8hcmBnHx0u13mVzzHt8%3D)
2026-03-28 22:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143221/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DV14VNO/42811439?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=AJzvLw0izZRKfov%2BeUrE5UmVQvMJLyUVerbX0NanFzs%3D)
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699247154%27 HTTP/1.1" 200 None
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699247154 not downloaded yet
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699247167%27 HTTP/1.1" 200 None
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699247167 not downloaded yet
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699247184%27 HTTP/1.1" 200 None
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699247184 not downloaded yet
2026-03-28 22:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247100/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699247100>
2026-03-28 22:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147135/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK11VUF/42811158?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=l8QAasE0E%2FzQR5QTuF2laotj8hcmBnHx0u13mVzzHt8%3D)
2026-03-28 22:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147129/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147129>
2026-03-28 22:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145548/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145548>
2026-03-28 22:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143186/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143186>
2026-03-28 22:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145298/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145298>
2026-03-28 22:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE58YDD/42811268?sv=2020-08-04&st=2026-03-28T22%3A04%3A48Z&se=2026-03-28T22%3A29%3A48Z&sr=b&sp=r&sig=Y1l2KePDWqatVWtNYtuojwlTGPRJVAXG56IIpdU6uog%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AE58%20YDD-GB>
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54723ad90>
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4011303-c936-5ad4-909d-9af520e69082/c4011303-c936-5ad4-909d-9af520e69082_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN16MXA%252F698981045%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981045/600 saved to cache
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c4011303-c936-5ad4-909d-9af520e69082
2026-03-28 22:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247087/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VF15KKY/42810796?sv=2020-08-04&st=2026-03-28T22%3A04%3A44Z&se=2026-03-28T22%3A29%3A44Z&sr=b&sp=r&sig=N7cgNbL%2FASZL5X1rnPo5iRbHozMBybglsDq6dl%2BjyDQ%3D)
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555e131d0>
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b6294-9845-5eb5-8c1d-a1f98760f95e/ef7b6294-9845-5eb5-8c1d-a1f98760f95e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDV14VNO%252F699143201%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143201/600 saved to cache
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ef7b6294-9845-5eb5-8c1d-a1f98760f95e
2026-03-28 22:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247093/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VF15KKY/42810796?sv=2020-08-04&st=2026-03-28T22%3A04%3A44Z&se=2026-03-28T22%3A29%3A44Z&sr=b&sp=r&sig=N7cgNbL%2FASZL5X1rnPo5iRbHozMBybglsDq6dl%2BjyDQ%3D)
2026-03-28 22:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247123/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699247123>
2026-03-28 22:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247116/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699247116>
2026-03-28 22:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145542/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145542>
2026-03-28 22:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247109/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699247109>
2026-03-28 22:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145293/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145293>
2026-03-28 22:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MM67RNV/42737455?sv=2020-08-04&st=2026-03-28T22%3A04%3A48Z&se=2026-03-28T22%3A29%3A48Z&sr=b&sp=r&sig=HrZML0scvzW6ZnaJ%2F1KJbgiG35c42n1%2BuEJCuynP2qg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MM67%20RNV-GB>
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471b8e50>
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4011303-c936-5ad4-909d-9af520e69082/c4011303-c936-5ad4-909d-9af520e69082_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN16MXA%252F698981069%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981069/600 saved to cache
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c4011303-c936-5ad4-909d-9af520e69082
2026-03-28 22:04:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c4011303-c936-5ad4-909d-9af520e69082, skipping ID generation
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c4011303-c936-5ad4-909d-9af520e69082 sending to next pipeline
2026-03-28 22:04:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c4011303-c936-5ad4-909d-9af520e69082, identifier: WN16%20MXA
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5571333d0>
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f9f14f-130c-5d1a-99c0-15c1239aa436/d5f9f14f-130c-5d1a-99c0-15c1239aa436_expert_report_file_da84524a-4120-4e9f-a1f8-bb5dcd5ca808.pdf HTTP/1.1" 201 0
2026-03-28 22:04:48 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d5f9f14f-130c-5d1a-99c0-15c1239aa436
2026-03-28 22:04:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d5f9f14f-130c-5d1a-99c0-15c1239aa436, skipping ID generation
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d5f9f14f-130c-5d1a-99c0-15c1239aa436
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKK07YAO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KK07YAO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554940f90>
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db8298e-1099-5db2-81d1-5141138419a2/3db8298e-1099-5db2-81d1-5141138419a2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK11VUF%252F699147148%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147148/600 saved to cache
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3db8298e-1099-5db2-81d1-5141138419a2
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472390d0>
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b6294-9845-5eb5-8c1d-a1f98760f95e/ef7b6294-9845-5eb5-8c1d-a1f98760f95e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDV14VNO%252F699143221%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143221/600 saved to cache
2026-03-28 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ef7b6294-9845-5eb5-8c1d-a1f98760f95e
2026-03-28 22:04:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c4011303-c936-5ad4-909d-9af520e69082 with identifier: WN16%20MXA
2026-03-28 22:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c4011303-c936-5ad4-909d-9af520e69082 with identifier: WN16%20MXA
2026-03-28 22:04:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c4011303-c936-5ad4-909d-9af520e69082 with identifier: WN16%20MXA to the API
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981069/600>
{'auction_title': '',
'c_o_2_emission_value': 144,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4011303-c936-5ad4-909d-9af520e69082/c4011303-c936-5ad4-909d-9af520e69082_expert_report_file_2d225adc-2f4e-4419-9162-fca6dac17fc7.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WN16%20MXA-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c4011303-c936-5ad4-909d-9af520e69082',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WN16 MXA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WN16%20MXA&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FIAT',
'model': '500X',
'odometer': 73944,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4011303-c936-5ad4-909d-9af520e69082/c4011303-c936-5ad4-909d-9af520e69082_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41100,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981045/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4011303-c936-5ad4-909d-9af520e69082/c4011303-c936-5ad4-909d-9af520e69082_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40689,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981069/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4011303-c936-5ad4-909d-9af520e69082/c4011303-c936-5ad4-909d-9af520e69082_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40785,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981094/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4011303-c936-5ad4-909d-9af520e69082/c4011303-c936-5ad4-909d-9af520e69082_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41195,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981117/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4011303-c936-5ad4-909d-9af520e69082/c4011303-c936-5ad4-909d-9af520e69082_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38594,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981134/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4011303-c936-5ad4-909d-9af520e69082/c4011303-c936-5ad4-909d-9af520e69082_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37551,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981149/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4011303-c936-5ad4-909d-9af520e69082/c4011303-c936-5ad4-909d-9af520e69082_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105054,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981191/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4011303-c936-5ad4-909d-9af520e69082/c4011303-c936-5ad4-909d-9af520e69082_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93706,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981228/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4011303-c936-5ad4-909d-9af520e69082/c4011303-c936-5ad4-909d-9af520e69082_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109566,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981283/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4011303-c936-5ad4-909d-9af520e69082/c4011303-c936-5ad4-909d-9af520e69082_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91117,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN16MXA/698981312/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FIAT 500X 2.0 M/JET 140 4X4 CROSS PLUS Hatchback',
'transmission': 'automatic',
'trim': 'M/JET 140 4X4 CROSS PLUS',
'vin': 'ZFA3340000P442918',
'year': 2016}
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN16%2520MXA%27 HTTP/1.1" 200 None
2026-03-28 22:04:49 [bca.uk] INFO: Saving data for WN16%20MXA: {'created_time': 1774735489.423702, 'last_price_update_time': 1774735489.423716, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WN16%2520MXA') HTTP/1.1" 204 0
2026-03-28 22:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247100/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VF15KKY/42810796?sv=2020-08-04&st=2026-03-28T22%3A04%3A44Z&se=2026-03-28T22%3A29%3A44Z&sr=b&sp=r&sig=N7cgNbL%2FASZL5X1rnPo5iRbHozMBybglsDq6dl%2BjyDQ%3D)
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082593%27 HTTP/1.1" 200 None
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082593 not downloaded yet
2026-03-28 22:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145548/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LY64DTU/42811373?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=nlvyE6o%2BjOSTCR6ZUHB9E%2BOFaaB84Hiq02HBTHcoq8g%3D)
2026-03-28 22:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147129/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK11VUF/42811158?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=l8QAasE0E%2FzQR5QTuF2laotj8hcmBnHx0u13mVzzHt8%3D)
2026-03-28 22:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145298/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM61DYD/42811410?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=bDvqRxwLzIpEHYLUXTs40ur1RioMfasSNgu0Yug2sj4%3D)
2026-03-28 22:04:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247167/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699247167>
2026-03-28 22:04:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247184/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699247184>
2026-03-28 22:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143186/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DV14VNO/42811439?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=AJzvLw0izZRKfov%2BeUrE5UmVQvMJLyUVerbX0NanFzs%3D)
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082606%27 HTTP/1.1" 200 None
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082606 not downloaded yet
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549400d0>
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db8298e-1099-5db2-81d1-5141138419a2/3db8298e-1099-5db2-81d1-5141138419a2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK11VUF%252F699147135%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147135/600 saved to cache
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3db8298e-1099-5db2-81d1-5141138419a2
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472b3a10>
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a29049-d0cb-5ad0-80d6-fe24d9cb8763/a3a29049-d0cb-5ad0-80d6-fe24d9cb8763_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVF15KKY%252F699247087%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247087/600 saved to cache
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3a29049-d0cb-5ad0-80d6-fe24d9cb8763
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543d3a90>
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a29049-d0cb-5ad0-80d6-fe24d9cb8763/a3a29049-d0cb-5ad0-80d6-fe24d9cb8763_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVF15KKY%252F699247093%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247093/600 saved to cache
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3a29049-d0cb-5ad0-80d6-fe24d9cb8763
2026-03-28 22:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE58YDD/42811268?sv=2020-08-04&st=2026-03-28T22%3A04%3A48Z&se=2026-03-28T22%3A29%3A48Z&sr=b&sp=r&sig=Y1l2KePDWqatVWtNYtuojwlTGPRJVAXG56IIpdU6uog%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082616%27 HTTP/1.1" 200 None
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082616 not downloaded yet
2026-03-28 22:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247123/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VF15KKY/42810796?sv=2020-08-04&st=2026-03-28T22%3A04%3A44Z&se=2026-03-28T22%3A29%3A44Z&sr=b&sp=r&sig=N7cgNbL%2FASZL5X1rnPo5iRbHozMBybglsDq6dl%2BjyDQ%3D)
2026-03-28 22:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145542/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LY64DTU/42811373?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=nlvyE6o%2BjOSTCR6ZUHB9E%2BOFaaB84Hiq02HBTHcoq8g%3D)
2026-03-28 22:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247116/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VF15KKY/42810796?sv=2020-08-04&st=2026-03-28T22%3A04%3A44Z&se=2026-03-28T22%3A29%3A44Z&sr=b&sp=r&sig=N7cgNbL%2FASZL5X1rnPo5iRbHozMBybglsDq6dl%2BjyDQ%3D)
2026-03-28 22:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247109/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VF15KKY/42810796?sv=2020-08-04&st=2026-03-28T22%3A04%3A44Z&se=2026-03-28T22%3A29%3A44Z&sr=b&sp=r&sig=N7cgNbL%2FASZL5X1rnPo5iRbHozMBybglsDq6dl%2BjyDQ%3D)
2026-03-28 22:04:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247154/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699247154>
2026-03-28 22:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145293/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM61DYD/42811410?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=bDvqRxwLzIpEHYLUXTs40ur1RioMfasSNgu0Yug2sj4%3D)
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082638%27 HTTP/1.1" 200 None
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082638 not downloaded yet
2026-03-28 22:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MM67RNV/42737455?sv=2020-08-04&st=2026-03-28T22%3A04%3A48Z&se=2026-03-28T22%3A29%3A48Z&sr=b&sp=r&sig=HrZML0scvzW6ZnaJ%2F1KJbgiG35c42n1%2BuEJCuynP2qg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082652%27 HTTP/1.1" 200 None
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082652 not downloaded yet
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b758d0>
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a29049-d0cb-5ad0-80d6-fe24d9cb8763/a3a29049-d0cb-5ad0-80d6-fe24d9cb8763_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVF15KKY%252F699247100%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247100/600 saved to cache
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3a29049-d0cb-5ad0-80d6-fe24d9cb8763
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554832110>
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_782aa18e-a0c9-5c10-9106-d797127b5b2a/782aa18e-a0c9-5c10-9106-d797127b5b2a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLY64DTU%252F699145548%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145548/600 saved to cache
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 782aa18e-a0c9-5c10-9106-d797127b5b2a
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547486b50>
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db8298e-1099-5db2-81d1-5141138419a2/3db8298e-1099-5db2-81d1-5141138419a2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK11VUF%252F699147129%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147129/600 saved to cache
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3db8298e-1099-5db2-81d1-5141138419a2
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547703a90>
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a59b1b92-68f6-5af6-ad88-8517ad8fae07/a59b1b92-68f6-5af6-ad88-8517ad8fae07_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM61DYD%252F699145298%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145298/600 saved to cache
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a59b1b92-68f6-5af6-ad88-8517ad8fae07
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474872d0>
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b6294-9845-5eb5-8c1d-a1f98760f95e/ef7b6294-9845-5eb5-8c1d-a1f98760f95e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDV14VNO%252F699143186%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143186/600 saved to cache
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef7b6294-9845-5eb5-8c1d-a1f98760f95e
2026-03-28 22:04:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143172/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143172>
2026-03-28 22:04:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147122/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147122>
2026-03-28 22:04:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247140/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699247140>
2026-03-28 22:04:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT18GME/42811082?sv=2020-08-04&st=2026-03-28T22%3A04%3A49Z&se=2026-03-28T22%3A29%3A49Z&sr=b&sp=r&sig=6iLNj7Dme1PiMHT%2FtlPWrXr5r9sQm7nV6ipvluGkHm4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DT18%20GME-GB>
2026-03-28 22:04:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082584/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KK07YAO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082677%27 HTTP/1.1" 200 None
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082677 not downloaded yet
2026-03-28 22:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247167/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VF15KKY/42810796?sv=2020-08-04&st=2026-03-28T22%3A04%3A44Z&se=2026-03-28T22%3A29%3A44Z&sr=b&sp=r&sig=N7cgNbL%2FASZL5X1rnPo5iRbHozMBybglsDq6dl%2BjyDQ%3D)
2026-03-28 22:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247184/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VF15KKY/42810796?sv=2020-08-04&st=2026-03-28T22%3A04%3A44Z&se=2026-03-28T22%3A29%3A44Z&sr=b&sp=r&sig=N7cgNbL%2FASZL5X1rnPo5iRbHozMBybglsDq6dl%2BjyDQ%3D)
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082701%27 HTTP/1.1" 200 None
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082701 not downloaded yet
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547266050>
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8291a8f-ab36-539f-839d-bb424053b7c9/a8291a8f-ab36-539f-839d-bb424053b7c9_expert_report_file_9a44b6f5-7521-4014-a9a7-00492fd7dc4c.pdf HTTP/1.1" 201 0
2026-03-28 22:04:49 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a8291a8f-ab36-539f-839d-bb424053b7c9
2026-03-28 22:04:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8291a8f-ab36-539f-839d-bb424053b7c9, skipping ID generation
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a8291a8f-ab36-539f-839d-bb424053b7c9
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAE58YDD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AE58YDD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474f4d90>
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a29049-d0cb-5ad0-80d6-fe24d9cb8763/a3a29049-d0cb-5ad0-80d6-fe24d9cb8763_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVF15KKY%252F699247123%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247123/600 saved to cache
2026-03-28 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3a29049-d0cb-5ad0-80d6-fe24d9cb8763
2026-03-28 22:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54744e9d0>
2026-03-28 22:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_782aa18e-a0c9-5c10-9106-d797127b5b2a/782aa18e-a0c9-5c10-9106-d797127b5b2a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLY64DTU%252F699145542%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145542/600 saved to cache
2026-03-28 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 782aa18e-a0c9-5c10-9106-d797127b5b2a
2026-03-28 22:04:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 782aa18e-a0c9-5c10-9106-d797127b5b2a, skipping ID generation
2026-03-28 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 782aa18e-a0c9-5c10-9106-d797127b5b2a sending to next pipeline
2026-03-28 22:04:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 782aa18e-a0c9-5c10-9106-d797127b5b2a, identifier: LY64%20DTU
2026-03-28 22:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557fdd410>
2026-03-28 22:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a29049-d0cb-5ad0-80d6-fe24d9cb8763/a3a29049-d0cb-5ad0-80d6-fe24d9cb8763_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVF15KKY%252F699247116%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247116/600 saved to cache
2026-03-28 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3a29049-d0cb-5ad0-80d6-fe24d9cb8763
2026-03-28 22:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548c3fd0>
2026-03-28 22:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a29049-d0cb-5ad0-80d6-fe24d9cb8763/a3a29049-d0cb-5ad0-80d6-fe24d9cb8763_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVF15KKY%252F699247109%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247109/600 saved to cache
2026-03-28 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3a29049-d0cb-5ad0-80d6-fe24d9cb8763
2026-03-28 22:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543d1450>
2026-03-28 22:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a59b1b92-68f6-5af6-ad88-8517ad8fae07/a59b1b92-68f6-5af6-ad88-8517ad8fae07_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM61DYD%252F699145293%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145293/600 saved to cache
2026-03-28 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a59b1b92-68f6-5af6-ad88-8517ad8fae07
2026-03-28 22:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547700d90>
2026-03-28 22:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2aaf8e0-6656-5ea0-a55c-8214d714b81c/a2aaf8e0-6656-5ea0-a55c-8214d714b81c_expert_report_file_4c781057-9fa3-4e8d-adaa-5f21afdbe83d.pdf HTTP/1.1" 201 0
2026-03-28 22:04:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a2aaf8e0-6656-5ea0-a55c-8214d714b81c
2026-03-28 22:04:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2aaf8e0-6656-5ea0-a55c-8214d714b81c, skipping ID generation
2026-03-28 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2aaf8e0-6656-5ea0-a55c-8214d714b81c
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMM67RNV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MM67RNV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082724%27 HTTP/1.1" 200 None
2026-03-28 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082724 not downloaded yet
2026-03-28 22:04:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 782aa18e-a0c9-5c10-9106-d797127b5b2a with identifier: LY64%20DTU
2026-03-28 22:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 782aa18e-a0c9-5c10-9106-d797127b5b2a with identifier: LY64%20DTU
2026-03-28 22:04:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 782aa18e-a0c9-5c10-9106-d797127b5b2a with identifier: LY64%20DTU to the API
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145542/600>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_782aa18e-a0c9-5c10-9106-d797127b5b2a/782aa18e-a0c9-5c10-9106-d797127b5b2a_expert_report_file_43477cc5-7f0c-4e37-a1ab-d82dbb508493.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LY64%20DTU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Electric',
'id': '782aa18e-a0c9-5c10-9106-d797127b5b2a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LY64 DTU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LY64%20DTU&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'NISSAN',
'model': 'LEAF',
'odometer': 60547,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_782aa18e-a0c9-5c10-9106-d797127b5b2a/782aa18e-a0c9-5c10-9106-d797127b5b2a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47019,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145534/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_782aa18e-a0c9-5c10-9106-d797127b5b2a/782aa18e-a0c9-5c10-9106-d797127b5b2a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44208,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145540/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_782aa18e-a0c9-5c10-9106-d797127b5b2a/782aa18e-a0c9-5c10-9106-d797127b5b2a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44699,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145542/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_782aa18e-a0c9-5c10-9106-d797127b5b2a/782aa18e-a0c9-5c10-9106-d797127b5b2a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45796,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145548/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_782aa18e-a0c9-5c10-9106-d797127b5b2a/782aa18e-a0c9-5c10-9106-d797127b5b2a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43437,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145552/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_782aa18e-a0c9-5c10-9106-d797127b5b2a/782aa18e-a0c9-5c10-9106-d797127b5b2a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41243,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145558/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_782aa18e-a0c9-5c10-9106-d797127b5b2a/782aa18e-a0c9-5c10-9106-d797127b5b2a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90087,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145565/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_782aa18e-a0c9-5c10-9106-d797127b5b2a/782aa18e-a0c9-5c10-9106-d797127b5b2a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71051,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145575/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_782aa18e-a0c9-5c10-9106-d797127b5b2a/782aa18e-a0c9-5c10-9106-d797127b5b2a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91095,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145581/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_782aa18e-a0c9-5c10-9106-d797127b5b2a/782aa18e-a0c9-5c10-9106-d797127b5b2a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70229,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY64DTU/699145592/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'NISSAN LEAF ACENTA Hatchback',
'transmission': 'automatic',
'trim': 'ACENTA',
'vin': 'SJNFAAZE0U6025533',
'year': 2015}
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY64%2520DTU%27 HTTP/1.1" 200 None
2026-03-28 22:04:50 [bca.uk] INFO: Saving data for LY64%20DTU: {'created_time': 1774735490.834261, 'last_price_update_time': 1774735490.834272, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LY64%2520DTU') HTTP/1.1" 204 0
2026-03-28 22:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145283/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145283>
2026-03-28 22:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143166/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143166>
2026-03-28 22:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082638/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082638>
2026-03-28 22:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147113/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147113>
2026-03-28 22:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082606/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082606>
2026-03-28 22:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT70LPK/42811187?sv=2020-08-04&st=2026-03-28T22%3A04%3A49Z&se=2026-03-28T22%3A29%3A49Z&sr=b&sp=r&sig=ry2x%2BNb8bS2nNDCyAHAjNET%2BaiMQ6fKajLL2W7XD%2B3w%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YT70%20LPK-GB>
2026-03-28 22:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082593/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082593>
2026-03-28 22:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247154/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VF15KKY/42810796?sv=2020-08-04&st=2026-03-28T22%3A04%3A44Z&se=2026-03-28T22%3A29%3A44Z&sr=b&sp=r&sig=N7cgNbL%2FASZL5X1rnPo5iRbHozMBybglsDq6dl%2BjyDQ%3D)
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126428%27 HTTP/1.1" 200 None
2026-03-28 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126428 not downloaded yet
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252280%27 HTTP/1.1" 200 None
2026-03-28 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252280 not downloaded yet
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082741%27 HTTP/1.1" 200 None
2026-03-28 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082741 not downloaded yet
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126443%27 HTTP/1.1" 200 None
2026-03-28 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126443 not downloaded yet
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252285%27 HTTP/1.1" 200 None
2026-03-28 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252285 not downloaded yet
2026-03-28 22:04:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5572a1a10>
2026-03-28 22:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a29049-d0cb-5ad0-80d6-fe24d9cb8763/a3a29049-d0cb-5ad0-80d6-fe24d9cb8763_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVF15KKY%252F699247167%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247167/600 saved to cache
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a3a29049-d0cb-5ad0-80d6-fe24d9cb8763
2026-03-28 22:04:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54762b5d0>
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a29049-d0cb-5ad0-80d6-fe24d9cb8763/a3a29049-d0cb-5ad0-80d6-fe24d9cb8763_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVF15KKY%252F699247184%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247184/600 saved to cache
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a3a29049-d0cb-5ad0-80d6-fe24d9cb8763
2026-03-28 22:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082584/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KK07YAO/42811138?sv=2020-08-04&st=2026-03-28T22%3A04%3A46Z&se=2026-03-28T22%3A29%3A46Z&sr=b&sp=r&sig=1C6k7rD9GVDdvldVXIZ6nSQFIPqifpaJzEcpMuZ23pI%3D)
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126470%27 HTTP/1.1" 200 None
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126470 not downloaded yet
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252296%27 HTTP/1.1" 200 None
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252296 not downloaded yet
2026-03-28 22:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147122/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK11VUF/42811158?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=l8QAasE0E%2FzQR5QTuF2laotj8hcmBnHx0u13mVzzHt8%3D)
2026-03-28 22:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143172/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DV14VNO/42811439?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=AJzvLw0izZRKfov%2BeUrE5UmVQvMJLyUVerbX0NanFzs%3D)
2026-03-28 22:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082652/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082652>
2026-03-28 22:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082616/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082616>
2026-03-28 22:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082593/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KK07YAO/42811138?sv=2020-08-04&st=2026-03-28T22%3A04%3A46Z&se=2026-03-28T22%3A29%3A46Z&sr=b&sp=r&sig=1C6k7rD9GVDdvldVXIZ6nSQFIPqifpaJzEcpMuZ23pI%3D)
2026-03-28 22:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247140/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VF15KKY/42810796?sv=2020-08-04&st=2026-03-28T22%3A04%3A44Z&se=2026-03-28T22%3A29%3A44Z&sr=b&sp=r&sig=N7cgNbL%2FASZL5X1rnPo5iRbHozMBybglsDq6dl%2BjyDQ%3D)
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126488%27 HTTP/1.1" 200 None
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126488 not downloaded yet
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252306%27 HTTP/1.1" 200 None
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252306 not downloaded yet
2026-03-28 22:04:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a6eb50>
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a29049-d0cb-5ad0-80d6-fe24d9cb8763/a3a29049-d0cb-5ad0-80d6-fe24d9cb8763_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVF15KKY%252F699247154%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247154/600 saved to cache
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3a29049-d0cb-5ad0-80d6-fe24d9cb8763
2026-03-28 22:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT18GME/42811082?sv=2020-08-04&st=2026-03-28T22%3A04%3A49Z&se=2026-03-28T22%3A29%3A49Z&sr=b&sp=r&sig=6iLNj7Dme1PiMHT%2FtlPWrXr5r9sQm7nV6ipvluGkHm4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126506%27 HTTP/1.1" 200 None
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126506 not downloaded yet
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252314%27 HTTP/1.1" 200 None
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252314 not downloaded yet
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126538%27 HTTP/1.1" 200 None
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126538 not downloaded yet
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252330%27 HTTP/1.1" 200 None
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252330 not downloaded yet
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544a9ed0>
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f9f14f-130c-5d1a-99c0-15c1239aa436/d5f9f14f-130c-5d1a-99c0-15c1239aa436_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKK07YAO%252F699082584%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082584/600 saved to cache
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d5f9f14f-130c-5d1a-99c0-15c1239aa436
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b4dd90>
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db8298e-1099-5db2-81d1-5141138419a2/3db8298e-1099-5db2-81d1-5141138419a2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK11VUF%252F699147122%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147122/600 saved to cache
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3db8298e-1099-5db2-81d1-5141138419a2
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544a9ed0>
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b6294-9845-5eb5-8c1d-a1f98760f95e/ef7b6294-9845-5eb5-8c1d-a1f98760f95e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDV14VNO%252F699143172%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143172/600 saved to cache
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef7b6294-9845-5eb5-8c1d-a1f98760f95e
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547278890>
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f9f14f-130c-5d1a-99c0-15c1239aa436/d5f9f14f-130c-5d1a-99c0-15c1239aa436_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKK07YAO%252F699082593%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082593/600 saved to cache
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d5f9f14f-130c-5d1a-99c0-15c1239aa436
2026-03-28 22:04:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543d1910>
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a29049-d0cb-5ad0-80d6-fe24d9cb8763/a3a29049-d0cb-5ad0-80d6-fe24d9cb8763_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVF15KKY%252F699247140%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247140/600 saved to cache
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3a29049-d0cb-5ad0-80d6-fe24d9cb8763
2026-03-28 22:04:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3a29049-d0cb-5ad0-80d6-fe24d9cb8763, skipping ID generation
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3a29049-d0cb-5ad0-80d6-fe24d9cb8763 sending to next pipeline
2026-03-28 22:04:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a3a29049-d0cb-5ad0-80d6-fe24d9cb8763, identifier: VF15%20KKY
2026-03-28 22:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145283/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM61DYD/42811410?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=bDvqRxwLzIpEHYLUXTs40ur1RioMfasSNgu0Yug2sj4%3D)
2026-03-28 22:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082638/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KK07YAO/42811138?sv=2020-08-04&st=2026-03-28T22%3A04%3A46Z&se=2026-03-28T22%3A29%3A46Z&sr=b&sp=r&sig=1C6k7rD9GVDdvldVXIZ6nSQFIPqifpaJzEcpMuZ23pI%3D)
2026-03-28 22:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143166/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DV14VNO/42811439?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=AJzvLw0izZRKfov%2BeUrE5UmVQvMJLyUVerbX0NanFzs%3D)
2026-03-28 22:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082606/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KK07YAO/42811138?sv=2020-08-04&st=2026-03-28T22%3A04%3A46Z&se=2026-03-28T22%3A29%3A46Z&sr=b&sp=r&sig=1C6k7rD9GVDdvldVXIZ6nSQFIPqifpaJzEcpMuZ23pI%3D)
2026-03-28 22:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147113/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK11VUF/42811158?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=l8QAasE0E%2FzQR5QTuF2laotj8hcmBnHx0u13mVzzHt8%3D)
2026-03-28 22:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252275/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MM67RNV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126560%27 HTTP/1.1" 200 None
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126560 not downloaded yet
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252340%27 HTTP/1.1" 200 None
2026-03-28 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252340 not downloaded yet
2026-03-28 22:04:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a3a29049-d0cb-5ad0-80d6-fe24d9cb8763 with identifier: VF15%20KKY
2026-03-28 22:04:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a3a29049-d0cb-5ad0-80d6-fe24d9cb8763 with identifier: VF15%20KKY
2026-03-28 22:04:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a3a29049-d0cb-5ad0-80d6-fe24d9cb8763 with identifier: VF15%20KKY to the API
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247140/600>
{'auction_title': '',
'c_o_2_emission_value': 39,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a29049-d0cb-5ad0-80d6-fe24d9cb8763/a3a29049-d0cb-5ad0-80d6-fe24d9cb8763_expert_report_file_5ca79e0a-b2e5-4d73-9155-fa7d95ada42c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VF15%20KKY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'a3a29049-d0cb-5ad0-80d6-fe24d9cb8763',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VF15 KKY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VF15%20KKY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 115945,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a29049-d0cb-5ad0-80d6-fe24d9cb8763/a3a29049-d0cb-5ad0-80d6-fe24d9cb8763_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39224,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247087/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a29049-d0cb-5ad0-80d6-fe24d9cb8763/a3a29049-d0cb-5ad0-80d6-fe24d9cb8763_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38988,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247093/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a29049-d0cb-5ad0-80d6-fe24d9cb8763/a3a29049-d0cb-5ad0-80d6-fe24d9cb8763_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37164,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247100/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a29049-d0cb-5ad0-80d6-fe24d9cb8763/a3a29049-d0cb-5ad0-80d6-fe24d9cb8763_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37912,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247109/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a29049-d0cb-5ad0-80d6-fe24d9cb8763/a3a29049-d0cb-5ad0-80d6-fe24d9cb8763_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36488,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247116/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a29049-d0cb-5ad0-80d6-fe24d9cb8763/a3a29049-d0cb-5ad0-80d6-fe24d9cb8763_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36284,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247123/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a29049-d0cb-5ad0-80d6-fe24d9cb8763/a3a29049-d0cb-5ad0-80d6-fe24d9cb8763_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97260,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247140/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a29049-d0cb-5ad0-80d6-fe24d9cb8763/a3a29049-d0cb-5ad0-80d6-fe24d9cb8763_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70934,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247154/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a29049-d0cb-5ad0-80d6-fe24d9cb8763/a3a29049-d0cb-5ad0-80d6-fe24d9cb8763_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85803,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247167/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a29049-d0cb-5ad0-80d6-fe24d9cb8763/a3a29049-d0cb-5ad0-80d6-fe24d9cb8763_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96860,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VF15KKY/699247184/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.4 TSI GTE DSG Hatchback',
'transmission': 'automatic',
'trim': 'TSI GTE DSG',
'vin': 'WVWZZZAUZGW801392',
'year': 2015}
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VF15%2520KKY%27 HTTP/1.1" 200 None
2026-03-28 22:04:51 [bca.uk] INFO: Saving data for VF15%20KKY: {'created_time': 1774735491.967205, 'last_price_update_time': 1774735491.967217, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VF15%2520KKY') HTTP/1.1" 204 0
2026-03-28 22:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252285/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252285>
2026-03-28 22:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT70LPK/42811187?sv=2020-08-04&st=2026-03-28T22%3A04%3A49Z&se=2026-03-28T22%3A29%3A49Z&sr=b&sp=r&sig=ry2x%2BNb8bS2nNDCyAHAjNET%2BaiMQ6fKajLL2W7XD%2B3w%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126577%27 HTTP/1.1" 200 None
2026-03-28 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126577 not downloaded yet
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252357%27 HTTP/1.1" 200 None
2026-03-28 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252357 not downloaded yet
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126593%27 HTTP/1.1" 200 None
2026-03-28 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126593 not downloaded yet
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252372%27 HTTP/1.1" 200 None
2026-03-28 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252372 not downloaded yet
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477efc50>
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa1c404-6451-54cd-8c9e-13c4279fa00e/bfa1c404-6451-54cd-8c9e-13c4279fa00e_expert_report_file_1476e5fa-60d3-47e7-8b44-e250d0d4412f.pdf HTTP/1.1" 201 0
2026-03-28 22:04:52 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item bfa1c404-6451-54cd-8c9e-13c4279fa00e
2026-03-28 22:04:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bfa1c404-6451-54cd-8c9e-13c4279fa00e, skipping ID generation
2026-03-28 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bfa1c404-6451-54cd-8c9e-13c4279fa00e
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDT18GME-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DT18GME-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547444990>
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a59b1b92-68f6-5af6-ad88-8517ad8fae07/a59b1b92-68f6-5af6-ad88-8517ad8fae07_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM61DYD%252F699145283%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145283/600 saved to cache
2026-03-28 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a59b1b92-68f6-5af6-ad88-8517ad8fae07
2026-03-28 22:04:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a59b1b92-68f6-5af6-ad88-8517ad8fae07, skipping ID generation
2026-03-28 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a59b1b92-68f6-5af6-ad88-8517ad8fae07 sending to next pipeline
2026-03-28 22:04:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a59b1b92-68f6-5af6-ad88-8517ad8fae07, identifier: LM61%20DYD
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe564c29350>
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f9f14f-130c-5d1a-99c0-15c1239aa436/d5f9f14f-130c-5d1a-99c0-15c1239aa436_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKK07YAO%252F699082638%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082638/600 saved to cache
2026-03-28 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d5f9f14f-130c-5d1a-99c0-15c1239aa436
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477c5a10>
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b6294-9845-5eb5-8c1d-a1f98760f95e/ef7b6294-9845-5eb5-8c1d-a1f98760f95e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDV14VNO%252F699143166%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143166/600 saved to cache
2026-03-28 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef7b6294-9845-5eb5-8c1d-a1f98760f95e
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f92050>
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f9f14f-130c-5d1a-99c0-15c1239aa436/d5f9f14f-130c-5d1a-99c0-15c1239aa436_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKK07YAO%252F699082606%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082606/600 saved to cache
2026-03-28 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d5f9f14f-130c-5d1a-99c0-15c1239aa436
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547307f90>
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db8298e-1099-5db2-81d1-5141138419a2/3db8298e-1099-5db2-81d1-5141138419a2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK11VUF%252F699147113%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147113/600 saved to cache
2026-03-28 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3db8298e-1099-5db2-81d1-5141138419a2
2026-03-28 22:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082652/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KK07YAO/42811138?sv=2020-08-04&st=2026-03-28T22%3A04%3A46Z&se=2026-03-28T22%3A29%3A46Z&sr=b&sp=r&sig=1C6k7rD9GVDdvldVXIZ6nSQFIPqifpaJzEcpMuZ23pI%3D)
2026-03-28 22:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082616/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KK07YAO/42811138?sv=2020-08-04&st=2026-03-28T22%3A04%3A46Z&se=2026-03-28T22%3A29%3A46Z&sr=b&sp=r&sig=1C6k7rD9GVDdvldVXIZ6nSQFIPqifpaJzEcpMuZ23pI%3D)
2026-03-28 22:04:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126470/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126470>
2026-03-28 22:04:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126443/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126443>
2026-03-28 22:04:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252296/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252296>
2026-03-28 22:04:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252306/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252306>
2026-03-28 22:04:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082741/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082741>
2026-03-28 22:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252285/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MM67RNV/42737455?sv=2020-08-04&st=2026-03-28T22%3A04%3A48Z&se=2026-03-28T22%3A29%3A48Z&sr=b&sp=r&sig=HrZML0scvzW6ZnaJ%2F1KJbgiG35c42n1%2BuEJCuynP2qg%3D)
2026-03-28 22:04:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a59b1b92-68f6-5af6-ad88-8517ad8fae07 with identifier: LM61%20DYD
2026-03-28 22:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a59b1b92-68f6-5af6-ad88-8517ad8fae07 with identifier: LM61%20DYD
2026-03-28 22:04:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a59b1b92-68f6-5af6-ad88-8517ad8fae07 with identifier: LM61%20DYD to the API
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145283/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a59b1b92-68f6-5af6-ad88-8517ad8fae07/a59b1b92-68f6-5af6-ad88-8517ad8fae07_expert_report_file_356850cf-139b-4931-8a7a-b4e8a4fb2760.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM61%20DYD-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a59b1b92-68f6-5af6-ad88-8517ad8fae07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LM61 DYD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LM61%20DYD&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'S-MAX',
'odometer': 110561,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a59b1b92-68f6-5af6-ad88-8517ad8fae07/a59b1b92-68f6-5af6-ad88-8517ad8fae07_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49200,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145274/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a59b1b92-68f6-5af6-ad88-8517ad8fae07/a59b1b92-68f6-5af6-ad88-8517ad8fae07_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47530,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145283/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a59b1b92-68f6-5af6-ad88-8517ad8fae07/a59b1b92-68f6-5af6-ad88-8517ad8fae07_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46817,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145293/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a59b1b92-68f6-5af6-ad88-8517ad8fae07/a59b1b92-68f6-5af6-ad88-8517ad8fae07_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49457,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145298/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a59b1b92-68f6-5af6-ad88-8517ad8fae07/a59b1b92-68f6-5af6-ad88-8517ad8fae07_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48055,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145309/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a59b1b92-68f6-5af6-ad88-8517ad8fae07/a59b1b92-68f6-5af6-ad88-8517ad8fae07_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45495,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145316/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a59b1b92-68f6-5af6-ad88-8517ad8fae07/a59b1b92-68f6-5af6-ad88-8517ad8fae07_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93097,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145325/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a59b1b92-68f6-5af6-ad88-8517ad8fae07/a59b1b92-68f6-5af6-ad88-8517ad8fae07_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65835,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145335/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a59b1b92-68f6-5af6-ad88-8517ad8fae07/a59b1b92-68f6-5af6-ad88-8517ad8fae07_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80983,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145344/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a59b1b92-68f6-5af6-ad88-8517ad8fae07/a59b1b92-68f6-5af6-ad88-8517ad8fae07_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72743,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM61DYD/699145354/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'FORD S-MAX 1.6 TDCI 115 TITANIUM S/S MPV',
'transmission': 'manual',
'trim': 'TDCI 115 TITANIUM S/S',
'vin': 'WF0SXXGBWSBS47186',
'year': 2011}
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM61%2520DYD%27 HTTP/1.1" 200 None
2026-03-28 22:04:52 [bca.uk] INFO: Saving data for LM61%20DYD: {'created_time': 1774735492.853763, 'last_price_update_time': 1774735492.853772, 'auction_closing_time': 1774951200.0}
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LM61%2520DYD') HTTP/1.1" 204 0
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082533%27 HTTP/1.1" 200 None
2026-03-28 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082533 not downloaded yet
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55431a350>
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56c1109-0372-5f69-97bc-e780b3d8ac65/c56c1109-0372-5f69-97bc-e780b3d8ac65_expert_report_file_35710641-f72b-460e-845c-e78e8f286b7a.pdf HTTP/1.1" 201 0
2026-03-28 22:04:52 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c56c1109-0372-5f69-97bc-e780b3d8ac65
2026-03-28 22:04:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c56c1109-0372-5f69-97bc-e780b3d8ac65, skipping ID generation
2026-03-28 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c56c1109-0372-5f69-97bc-e780b3d8ac65
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYT70LPK-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YT70LPK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082547%27 HTTP/1.1" 200 None
2026-03-28 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082547 not downloaded yet
2026-03-28 22:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252275/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MM67RNV/42737455?sv=2020-08-04&st=2026-03-28T22%3A04%3A48Z&se=2026-03-28T22%3A29%3A48Z&sr=b&sp=r&sig=HrZML0scvzW6ZnaJ%2F1KJbgiG35c42n1%2BuEJCuynP2qg%3D)
2026-03-28 22:04:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126488/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126488>
2026-03-28 22:04:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126538/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126538>
2026-03-28 22:04:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126506/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126506>
2026-03-28 22:04:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252330/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252330>
2026-03-28 22:04:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252340/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252340>
2026-03-28 22:04:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252314/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252314>
2026-03-28 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110894%27 HTTP/1.1" 200 None
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110894 not downloaded yet
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a008d0>
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f9f14f-130c-5d1a-99c0-15c1239aa436/d5f9f14f-130c-5d1a-99c0-15c1239aa436_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKK07YAO%252F699082652%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082652/600 saved to cache
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d5f9f14f-130c-5d1a-99c0-15c1239aa436
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471a1e50>
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f9f14f-130c-5d1a-99c0-15c1239aa436/d5f9f14f-130c-5d1a-99c0-15c1239aa436_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKK07YAO%252F699082616%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082616/600 saved to cache
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d5f9f14f-130c-5d1a-99c0-15c1239aa436
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477743d0>
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2aaf8e0-6656-5ea0-a55c-8214d714b81c/a2aaf8e0-6656-5ea0-a55c-8214d714b81c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMM67RNV%252F699252285%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252285/600 saved to cache
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2aaf8e0-6656-5ea0-a55c-8214d714b81c
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082559%27 HTTP/1.1" 200 None
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082559 not downloaded yet
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110901%27 HTTP/1.1" 200 None
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110901 not downloaded yet
2026-03-28 22:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082741/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KK07YAO/42811138?sv=2020-08-04&st=2026-03-28T22%3A04%3A46Z&se=2026-03-28T22%3A29%3A46Z&sr=b&sp=r&sig=1C6k7rD9GVDdvldVXIZ6nSQFIPqifpaJzEcpMuZ23pI%3D)
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082570%27 HTTP/1.1" 200 None
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082570 not downloaded yet
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548c1d90>
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2aaf8e0-6656-5ea0-a55c-8214d714b81c/a2aaf8e0-6656-5ea0-a55c-8214d714b81c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMM67RNV%252F699252275%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252275/600 saved to cache
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2aaf8e0-6656-5ea0-a55c-8214d714b81c
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110916%27 HTTP/1.1" 200 None
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110916 not downloaded yet
2026-03-28 22:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126443/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE58YDD/42811268?sv=2020-08-04&st=2026-03-28T22%3A04%3A48Z&se=2026-03-28T22%3A29%3A48Z&sr=b&sp=r&sig=Y1l2KePDWqatVWtNYtuojwlTGPRJVAXG56IIpdU6uog%3D)
2026-03-28 22:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126470/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE58YDD/42811268?sv=2020-08-04&st=2026-03-28T22%3A04%3A48Z&se=2026-03-28T22%3A29%3A48Z&sr=b&sp=r&sig=Y1l2KePDWqatVWtNYtuojwlTGPRJVAXG56IIpdU6uog%3D)
2026-03-28 22:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126560/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126560>
2026-03-28 22:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252357/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252357>
2026-03-28 22:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126577/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126577>
2026-03-28 22:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252306/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MM67RNV/42737455?sv=2020-08-04&st=2026-03-28T22%3A04%3A48Z&se=2026-03-28T22%3A29%3A48Z&sr=b&sp=r&sig=HrZML0scvzW6ZnaJ%2F1KJbgiG35c42n1%2BuEJCuynP2qg%3D)
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082581%27 HTTP/1.1" 200 None
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082581 not downloaded yet
2026-03-28 22:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252296/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MM67RNV/42737455?sv=2020-08-04&st=2026-03-28T22%3A04%3A48Z&se=2026-03-28T22%3A29%3A48Z&sr=b&sp=r&sig=HrZML0scvzW6ZnaJ%2F1KJbgiG35c42n1%2BuEJCuynP2qg%3D)
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110928%27 HTTP/1.1" 200 None
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110928 not downloaded yet
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082601%27 HTTP/1.1" 200 None
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082601 not downloaded yet
2026-03-28 22:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252314/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MM67RNV/42737455?sv=2020-08-04&st=2026-03-28T22%3A04%3A48Z&se=2026-03-28T22%3A29%3A48Z&sr=b&sp=r&sig=HrZML0scvzW6ZnaJ%2F1KJbgiG35c42n1%2BuEJCuynP2qg%3D)
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110944%27 HTTP/1.1" 200 None
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110944 not downloaded yet
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082622%27 HTTP/1.1" 200 None
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082622 not downloaded yet
2026-03-28 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471c1710>
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f9f14f-130c-5d1a-99c0-15c1239aa436/d5f9f14f-130c-5d1a-99c0-15c1239aa436_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKK07YAO%252F699082741%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082741/600 saved to cache
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d5f9f14f-130c-5d1a-99c0-15c1239aa436
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110965%27 HTTP/1.1" 200 None
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110965 not downloaded yet
2026-03-28 22:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126506/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE58YDD/42811268?sv=2020-08-04&st=2026-03-28T22%3A04%3A48Z&se=2026-03-28T22%3A29%3A48Z&sr=b&sp=r&sig=Y1l2KePDWqatVWtNYtuojwlTGPRJVAXG56IIpdU6uog%3D)
2026-03-28 22:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126488/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE58YDD/42811268?sv=2020-08-04&st=2026-03-28T22%3A04%3A48Z&se=2026-03-28T22%3A29%3A48Z&sr=b&sp=r&sig=Y1l2KePDWqatVWtNYtuojwlTGPRJVAXG56IIpdU6uog%3D)
2026-03-28 22:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082559/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082559>
2026-03-28 22:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110887/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YT70LPK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082649%27 HTTP/1.1" 200 None
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082649 not downloaded yet
2026-03-28 22:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126538/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE58YDD/42811268?sv=2020-08-04&st=2026-03-28T22%3A04%3A48Z&se=2026-03-28T22%3A29%3A48Z&sr=b&sp=r&sig=Y1l2KePDWqatVWtNYtuojwlTGPRJVAXG56IIpdU6uog%3D)
2026-03-28 22:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252340/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MM67RNV/42737455?sv=2020-08-04&st=2026-03-28T22%3A04%3A48Z&se=2026-03-28T22%3A29%3A48Z&sr=b&sp=r&sig=HrZML0scvzW6ZnaJ%2F1KJbgiG35c42n1%2BuEJCuynP2qg%3D)
2026-03-28 22:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252330/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MM67RNV/42737455?sv=2020-08-04&st=2026-03-28T22%3A04%3A48Z&se=2026-03-28T22%3A29%3A48Z&sr=b&sp=r&sig=HrZML0scvzW6ZnaJ%2F1KJbgiG35c42n1%2BuEJCuynP2qg%3D)
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110986%27 HTTP/1.1" 200 None
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110986 not downloaded yet
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699082682%27 HTTP/1.1" 200 None
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082682 not downloaded yet
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699111012%27 HTTP/1.1" 200 None
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699111012 not downloaded yet
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549cb450>
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8291a8f-ab36-539f-839d-bb424053b7c9/a8291a8f-ab36-539f-839d-bb424053b7c9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE58YDD%252F699126443%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126443/600 saved to cache
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a8291a8f-ab36-539f-839d-bb424053b7c9
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5545a25d0>
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8291a8f-ab36-539f-839d-bb424053b7c9/a8291a8f-ab36-539f-839d-bb424053b7c9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE58YDD%252F699126470%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126470/600 saved to cache
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a8291a8f-ab36-539f-839d-bb424053b7c9
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549087d0>
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2aaf8e0-6656-5ea0-a55c-8214d714b81c/a2aaf8e0-6656-5ea0-a55c-8214d714b81c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMM67RNV%252F699252306%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252306/600 saved to cache
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2aaf8e0-6656-5ea0-a55c-8214d714b81c
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471c1ad0>
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2aaf8e0-6656-5ea0-a55c-8214d714b81c/a2aaf8e0-6656-5ea0-a55c-8214d714b81c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMM67RNV%252F699252296%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252296/600 saved to cache
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a2aaf8e0-6656-5ea0-a55c-8214d714b81c
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547604d10>
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2aaf8e0-6656-5ea0-a55c-8214d714b81c/a2aaf8e0-6656-5ea0-a55c-8214d714b81c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMM67RNV%252F699252314%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252314/600 saved to cache
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a2aaf8e0-6656-5ea0-a55c-8214d714b81c
2026-03-28 22:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126577/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE58YDD/42811268?sv=2020-08-04&st=2026-03-28T22%3A04%3A48Z&se=2026-03-28T22%3A29%3A48Z&sr=b&sp=r&sig=Y1l2KePDWqatVWtNYtuojwlTGPRJVAXG56IIpdU6uog%3D)
2026-03-28 22:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082570/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082570>
2026-03-28 22:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110916/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110916>
2026-03-28 22:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110894/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110894>
2026-03-28 22:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082601/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082601>
2026-03-28 22:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110901/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110901>
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699111027%27 HTTP/1.1" 200 None
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699111027 not downloaded yet
2026-03-28 22:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252357/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MM67RNV/42737455?sv=2020-08-04&st=2026-03-28T22%3A04%3A48Z&se=2026-03-28T22%3A29%3A48Z&sr=b&sp=r&sig=HrZML0scvzW6ZnaJ%2F1KJbgiG35c42n1%2BuEJCuynP2qg%3D)
2026-03-28 22:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126560/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE58YDD/42811268?sv=2020-08-04&st=2026-03-28T22%3A04%3A48Z&se=2026-03-28T22%3A29%3A48Z&sr=b&sp=r&sig=Y1l2KePDWqatVWtNYtuojwlTGPRJVAXG56IIpdU6uog%3D)
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f91f10>
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8291a8f-ab36-539f-839d-bb424053b7c9/a8291a8f-ab36-539f-839d-bb424053b7c9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE58YDD%252F699126506%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126506/600 saved to cache
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a8291a8f-ab36-539f-839d-bb424053b7c9
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556fdccd0>
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8291a8f-ab36-539f-839d-bb424053b7c9/a8291a8f-ab36-539f-839d-bb424053b7c9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE58YDD%252F699126488%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126488/600 saved to cache
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a8291a8f-ab36-539f-839d-bb424053b7c9
2026-03-28 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555caa150>
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8291a8f-ab36-539f-839d-bb424053b7c9/a8291a8f-ab36-539f-839d-bb424053b7c9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE58YDD%252F699126538%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126538/600 saved to cache
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a8291a8f-ab36-539f-839d-bb424053b7c9
2026-03-28 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542fdb90>
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2aaf8e0-6656-5ea0-a55c-8214d714b81c/a2aaf8e0-6656-5ea0-a55c-8214d714b81c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMM67RNV%252F699252340%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252340/600 saved to cache
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a2aaf8e0-6656-5ea0-a55c-8214d714b81c
2026-03-28 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556fdce90>
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2aaf8e0-6656-5ea0-a55c-8214d714b81c/a2aaf8e0-6656-5ea0-a55c-8214d714b81c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMM67RNV%252F699252330%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252330/600 saved to cache
2026-03-28 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a2aaf8e0-6656-5ea0-a55c-8214d714b81c
2026-03-28 22:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110887/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT70LPK/42811187?sv=2020-08-04&st=2026-03-28T22%3A04%3A49Z&se=2026-03-28T22%3A29%3A49Z&sr=b&sp=r&sig=ry2x%2BNb8bS2nNDCyAHAjNET%2BaiMQ6fKajLL2W7XD%2B3w%3D)
2026-03-28 22:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110901/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT70LPK/42811187?sv=2020-08-04&st=2026-03-28T22%3A04%3A49Z&se=2026-03-28T22%3A29%3A49Z&sr=b&sp=r&sig=ry2x%2BNb8bS2nNDCyAHAjNET%2BaiMQ6fKajLL2W7XD%2B3w%3D)
2026-03-28 22:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110944/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110944>
2026-03-28 22:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082622/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082622>
2026-03-28 22:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110965/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110965>
2026-03-28 22:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082581/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082581>
2026-03-28 22:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110928/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110928>
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477d9990>
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8291a8f-ab36-539f-839d-bb424053b7c9/a8291a8f-ab36-539f-839d-bb424053b7c9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE58YDD%252F699126577%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126577/600 saved to cache
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a8291a8f-ab36-539f-839d-bb424053b7c9
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54744c5d0>
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2aaf8e0-6656-5ea0-a55c-8214d714b81c/a2aaf8e0-6656-5ea0-a55c-8214d714b81c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMM67RNV%252F699252357%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252357/600 saved to cache
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a2aaf8e0-6656-5ea0-a55c-8214d714b81c
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fa8990>
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8291a8f-ab36-539f-839d-bb424053b7c9/a8291a8f-ab36-539f-839d-bb424053b7c9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE58YDD%252F699126560%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126560/600 saved to cache
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a8291a8f-ab36-539f-839d-bb424053b7c9
2026-03-28 22:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082559/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT18GME/42811082?sv=2020-08-04&st=2026-03-28T22%3A04%3A49Z&se=2026-03-28T22%3A29%3A49Z&sr=b&sp=r&sig=6iLNj7Dme1PiMHT%2FtlPWrXr5r9sQm7nV6ipvluGkHm4%3D)
2026-03-28 22:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110894/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT70LPK/42811187?sv=2020-08-04&st=2026-03-28T22%3A04%3A49Z&se=2026-03-28T22%3A29%3A49Z&sr=b&sp=r&sig=ry2x%2BNb8bS2nNDCyAHAjNET%2BaiMQ6fKajLL2W7XD%2B3w%3D)
2026-03-28 22:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110986/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110986>
2026-03-28 22:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082682/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082682>
2026-03-28 22:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699111012/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699111012>
2026-03-28 22:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082570/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT18GME/42811082?sv=2020-08-04&st=2026-03-28T22%3A04%3A49Z&se=2026-03-28T22%3A29%3A49Z&sr=b&sp=r&sig=6iLNj7Dme1PiMHT%2FtlPWrXr5r9sQm7nV6ipvluGkHm4%3D)
2026-03-28 22:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110916/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT70LPK/42811187?sv=2020-08-04&st=2026-03-28T22%3A04%3A49Z&se=2026-03-28T22%3A29%3A49Z&sr=b&sp=r&sig=ry2x%2BNb8bS2nNDCyAHAjNET%2BaiMQ6fKajLL2W7XD%2B3w%3D)
2026-03-28 22:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082601/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT18GME/42811082?sv=2020-08-04&st=2026-03-28T22%3A04%3A49Z&se=2026-03-28T22%3A29%3A49Z&sr=b&sp=r&sig=6iLNj7Dme1PiMHT%2FtlPWrXr5r9sQm7nV6ipvluGkHm4%3D)
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5545cdb90>
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56c1109-0372-5f69-97bc-e780b3d8ac65/c56c1109-0372-5f69-97bc-e780b3d8ac65_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT70LPK%252F699110887%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110887/600 saved to cache
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c56c1109-0372-5f69-97bc-e780b3d8ac65
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547305b50>
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56c1109-0372-5f69-97bc-e780b3d8ac65/c56c1109-0372-5f69-97bc-e780b3d8ac65_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT70LPK%252F699110901%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110901/600 saved to cache
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c56c1109-0372-5f69-97bc-e780b3d8ac65
2026-03-28 22:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082581/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT18GME/42811082?sv=2020-08-04&st=2026-03-28T22%3A04%3A49Z&se=2026-03-28T22%3A29%3A49Z&sr=b&sp=r&sig=6iLNj7Dme1PiMHT%2FtlPWrXr5r9sQm7nV6ipvluGkHm4%3D)
2026-03-28 22:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699111027/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699111027>
2026-03-28 22:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082649/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082649>
2026-03-28 22:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110944/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT70LPK/42811187?sv=2020-08-04&st=2026-03-28T22%3A04%3A49Z&se=2026-03-28T22%3A29%3A49Z&sr=b&sp=r&sig=ry2x%2BNb8bS2nNDCyAHAjNET%2BaiMQ6fKajLL2W7XD%2B3w%3D)
2026-03-28 22:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110928/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT70LPK/42811187?sv=2020-08-04&st=2026-03-28T22%3A04%3A49Z&se=2026-03-28T22%3A29%3A49Z&sr=b&sp=r&sig=ry2x%2BNb8bS2nNDCyAHAjNET%2BaiMQ6fKajLL2W7XD%2B3w%3D)
2026-03-28 22:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110965/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT70LPK/42811187?sv=2020-08-04&st=2026-03-28T22%3A04%3A49Z&se=2026-03-28T22%3A29%3A49Z&sr=b&sp=r&sig=ry2x%2BNb8bS2nNDCyAHAjNET%2BaiMQ6fKajLL2W7XD%2B3w%3D)
2026-03-28 22:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082622/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT18GME/42811082?sv=2020-08-04&st=2026-03-28T22%3A04%3A49Z&se=2026-03-28T22%3A29%3A49Z&sr=b&sp=r&sig=6iLNj7Dme1PiMHT%2FtlPWrXr5r9sQm7nV6ipvluGkHm4%3D)
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554201310>
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa1c404-6451-54cd-8c9e-13c4279fa00e/bfa1c404-6451-54cd-8c9e-13c4279fa00e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT18GME%252F699082559%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082559/600 saved to cache
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bfa1c404-6451-54cd-8c9e-13c4279fa00e
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b397d0>
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56c1109-0372-5f69-97bc-e780b3d8ac65/c56c1109-0372-5f69-97bc-e780b3d8ac65_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT70LPK%252F699110894%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110894/600 saved to cache
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c56c1109-0372-5f69-97bc-e780b3d8ac65
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547206890>
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa1c404-6451-54cd-8c9e-13c4279fa00e/bfa1c404-6451-54cd-8c9e-13c4279fa00e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT18GME%252F699082570%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082570/600 saved to cache
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bfa1c404-6451-54cd-8c9e-13c4279fa00e
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474f4690>
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56c1109-0372-5f69-97bc-e780b3d8ac65/c56c1109-0372-5f69-97bc-e780b3d8ac65_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT70LPK%252F699110916%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110916/600 saved to cache
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c56c1109-0372-5f69-97bc-e780b3d8ac65
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54713d790>
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa1c404-6451-54cd-8c9e-13c4279fa00e/bfa1c404-6451-54cd-8c9e-13c4279fa00e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT18GME%252F699082601%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082601/600 saved to cache
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bfa1c404-6451-54cd-8c9e-13c4279fa00e
2026-03-28 22:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082547/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082547>
2026-03-28 22:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082533/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082533>
2026-03-28 22:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082519/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DT18GME-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699111012/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT70LPK/42811187?sv=2020-08-04&st=2026-03-28T22%3A04%3A49Z&se=2026-03-28T22%3A29%3A49Z&sr=b&sp=r&sig=ry2x%2BNb8bS2nNDCyAHAjNET%2BaiMQ6fKajLL2W7XD%2B3w%3D)
2026-03-28 22:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082682/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT18GME/42811082?sv=2020-08-04&st=2026-03-28T22%3A04%3A49Z&se=2026-03-28T22%3A29%3A49Z&sr=b&sp=r&sig=6iLNj7Dme1PiMHT%2FtlPWrXr5r9sQm7nV6ipvluGkHm4%3D)
2026-03-28 22:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110986/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT70LPK/42811187?sv=2020-08-04&st=2026-03-28T22%3A04%3A49Z&se=2026-03-28T22%3A29%3A49Z&sr=b&sp=r&sig=ry2x%2BNb8bS2nNDCyAHAjNET%2BaiMQ6fKajLL2W7XD%2B3w%3D)
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557fdbd10>
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa1c404-6451-54cd-8c9e-13c4279fa00e/bfa1c404-6451-54cd-8c9e-13c4279fa00e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT18GME%252F699082581%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082581/600 saved to cache
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bfa1c404-6451-54cd-8c9e-13c4279fa00e
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477ef3d0>
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56c1109-0372-5f69-97bc-e780b3d8ac65/c56c1109-0372-5f69-97bc-e780b3d8ac65_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT70LPK%252F699110944%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110944/600 saved to cache
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c56c1109-0372-5f69-97bc-e780b3d8ac65
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548c2710>
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56c1109-0372-5f69-97bc-e780b3d8ac65/c56c1109-0372-5f69-97bc-e780b3d8ac65_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT70LPK%252F699110928%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110928/600 saved to cache
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c56c1109-0372-5f69-97bc-e780b3d8ac65
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b38490>
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56c1109-0372-5f69-97bc-e780b3d8ac65/c56c1109-0372-5f69-97bc-e780b3d8ac65_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT70LPK%252F699110965%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110965/600 saved to cache
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c56c1109-0372-5f69-97bc-e780b3d8ac65
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b22290>
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa1c404-6451-54cd-8c9e-13c4279fa00e/bfa1c404-6451-54cd-8c9e-13c4279fa00e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT18GME%252F699082622%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082622/600 saved to cache
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bfa1c404-6451-54cd-8c9e-13c4279fa00e
2026-03-28 22:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252372/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252372>
2026-03-28 22:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126593/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126593>
2026-03-28 22:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252280/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252280>
2026-03-28 22:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082649/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT18GME/42811082?sv=2020-08-04&st=2026-03-28T22%3A04%3A49Z&se=2026-03-28T22%3A29%3A49Z&sr=b&sp=r&sig=6iLNj7Dme1PiMHT%2FtlPWrXr5r9sQm7nV6ipvluGkHm4%3D)
2026-03-28 22:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699111027/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT70LPK/42811187?sv=2020-08-04&st=2026-03-28T22%3A04%3A49Z&se=2026-03-28T22%3A29%3A49Z&sr=b&sp=r&sig=ry2x%2BNb8bS2nNDCyAHAjNET%2BaiMQ6fKajLL2W7XD%2B3w%3D)
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554802e10>
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56c1109-0372-5f69-97bc-e780b3d8ac65/c56c1109-0372-5f69-97bc-e780b3d8ac65_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT70LPK%252F699111012%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699111012/600 saved to cache
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c56c1109-0372-5f69-97bc-e780b3d8ac65
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554316d10>
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa1c404-6451-54cd-8c9e-13c4279fa00e/bfa1c404-6451-54cd-8c9e-13c4279fa00e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT18GME%252F699082682%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082682/600 saved to cache
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bfa1c404-6451-54cd-8c9e-13c4279fa00e
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477cda10>
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56c1109-0372-5f69-97bc-e780b3d8ac65/c56c1109-0372-5f69-97bc-e780b3d8ac65_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT70LPK%252F699110986%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110986/600 saved to cache
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c56c1109-0372-5f69-97bc-e780b3d8ac65
2026-03-28 22:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082519/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT18GME/42811082?sv=2020-08-04&st=2026-03-28T22%3A04%3A49Z&se=2026-03-28T22%3A29%3A49Z&sr=b&sp=r&sig=6iLNj7Dme1PiMHT%2FtlPWrXr5r9sQm7nV6ipvluGkHm4%3D)
2026-03-28 22:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082724/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082724>
2026-03-28 22:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126414/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AE58YDD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126428/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126428>
2026-03-28 22:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082533/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT18GME/42811082?sv=2020-08-04&st=2026-03-28T22%3A04%3A49Z&se=2026-03-28T22%3A29%3A49Z&sr=b&sp=r&sig=6iLNj7Dme1PiMHT%2FtlPWrXr5r9sQm7nV6ipvluGkHm4%3D)
2026-03-28 22:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082701/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082701>
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554314050>
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa1c404-6451-54cd-8c9e-13c4279fa00e/bfa1c404-6451-54cd-8c9e-13c4279fa00e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT18GME%252F699082649%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082649/600 saved to cache
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bfa1c404-6451-54cd-8c9e-13c4279fa00e
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a6ee50>
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56c1109-0372-5f69-97bc-e780b3d8ac65/c56c1109-0372-5f69-97bc-e780b3d8ac65_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT70LPK%252F699111027%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699111027/600 saved to cache
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c56c1109-0372-5f69-97bc-e780b3d8ac65
2026-03-28 22:04:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c56c1109-0372-5f69-97bc-e780b3d8ac65, skipping ID generation
2026-03-28 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c56c1109-0372-5f69-97bc-e780b3d8ac65 sending to next pipeline
2026-03-28 22:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c56c1109-0372-5f69-97bc-e780b3d8ac65, identifier: YT70%20LPK
2026-03-28 22:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c56c1109-0372-5f69-97bc-e780b3d8ac65 with identifier: YT70%20LPK
2026-03-28 22:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c56c1109-0372-5f69-97bc-e780b3d8ac65 with identifier: YT70%20LPK
2026-03-28 22:04:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c56c1109-0372-5f69-97bc-e780b3d8ac65 with identifier: YT70%20LPK to the API
2026-03-28 22:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699111027/600>
{'auction_title': '',
'c_o_2_emission_value': 92,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56c1109-0372-5f69-97bc-e780b3d8ac65/c56c1109-0372-5f69-97bc-e780b3d8ac65_expert_report_file_35710641-f72b-460e-845c-e78e8f286b7a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YT70%20LPK-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'c56c1109-0372-5f69-97bc-e780b3d8ac65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YT70 LPK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YT70%20LPK&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 30573,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56c1109-0372-5f69-97bc-e780b3d8ac65/c56c1109-0372-5f69-97bc-e780b3d8ac65_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39284,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110887/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56c1109-0372-5f69-97bc-e780b3d8ac65/c56c1109-0372-5f69-97bc-e780b3d8ac65_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39066,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110894/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56c1109-0372-5f69-97bc-e780b3d8ac65/c56c1109-0372-5f69-97bc-e780b3d8ac65_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38055,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110901/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56c1109-0372-5f69-97bc-e780b3d8ac65/c56c1109-0372-5f69-97bc-e780b3d8ac65_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38829,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110916/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56c1109-0372-5f69-97bc-e780b3d8ac65/c56c1109-0372-5f69-97bc-e780b3d8ac65_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37565,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110928/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56c1109-0372-5f69-97bc-e780b3d8ac65/c56c1109-0372-5f69-97bc-e780b3d8ac65_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36679,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110944/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56c1109-0372-5f69-97bc-e780b3d8ac65/c56c1109-0372-5f69-97bc-e780b3d8ac65_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88103,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110965/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56c1109-0372-5f69-97bc-e780b3d8ac65/c56c1109-0372-5f69-97bc-e780b3d8ac65_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66463,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699110986/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56c1109-0372-5f69-97bc-e780b3d8ac65/c56c1109-0372-5f69-97bc-e780b3d8ac65_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84646,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699111012/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56c1109-0372-5f69-97bc-e780b3d8ac65/c56c1109-0372-5f69-97bc-e780b3d8ac65_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90280,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT70LPK/699111027/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.5 HYBRID DESIGN Hatchback',
'transmission': 'automatic',
'trim': 'HYBRID DESIGN',
'vin': 'VNKKBAC370A013280',
'year': 2020}
2026-03-28 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT70%2520LPK%27 HTTP/1.1" 200 None
2026-03-28 22:04:55 [bca.uk] INFO: Saving data for YT70%20LPK: {'created_time': 1774735495.558422, 'last_price_update_time': 1774735495.558432, 'auction_closing_time': 1774951200.0}
2026-03-28 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YT70%2520LPK') HTTP/1.1" 204 0
2026-03-28 22:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082547/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DT18GME/42811082?sv=2020-08-04&st=2026-03-28T22%3A04%3A49Z&se=2026-03-28T22%3A29%3A49Z&sr=b&sp=r&sig=6iLNj7Dme1PiMHT%2FtlPWrXr5r9sQm7nV6ipvluGkHm4%3D)
2026-03-28 22:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082677/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699082677>
2026-03-28 22:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252280/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MM67RNV/42737455?sv=2020-08-04&st=2026-03-28T22%3A04%3A48Z&se=2026-03-28T22%3A29%3A48Z&sr=b&sp=r&sig=HrZML0scvzW6ZnaJ%2F1KJbgiG35c42n1%2BuEJCuynP2qg%3D)
2026-03-28 22:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK20LVZ/42810609?sv=2020-08-04&st=2026-03-28T22%3A04%3A54Z&se=2026-03-28T22%3A29%3A54Z&sr=b&sp=r&sig=1rlMrLgnScXfscprI2w%2F9uGrt4kZZOWiG68r4kKHBnY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PK20%20LVZ-GB>
2026-03-28 22:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143138/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DV14VNO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147108/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147108>
2026-03-28 22:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126593/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE58YDD/42811268?sv=2020-08-04&st=2026-03-28T22%3A04%3A48Z&se=2026-03-28T22%3A29%3A48Z&sr=b&sp=r&sig=Y1l2KePDWqatVWtNYtuojwlTGPRJVAXG56IIpdU6uog%3D)
2026-03-28 22:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252372/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MM67RNV/42737455?sv=2020-08-04&st=2026-03-28T22%3A04%3A48Z&se=2026-03-28T22%3A29%3A48Z&sr=b&sp=r&sig=HrZML0scvzW6ZnaJ%2F1KJbgiG35c42n1%2BuEJCuynP2qg%3D)
2026-03-28 22:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f7be90>
2026-03-28 22:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa1c404-6451-54cd-8c9e-13c4279fa00e/bfa1c404-6451-54cd-8c9e-13c4279fa00e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT18GME%252F699082519%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082519/600 saved to cache
2026-03-28 22:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bfa1c404-6451-54cd-8c9e-13c4279fa00e
2026-03-28 22:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5570f0f10>
2026-03-28 22:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa1c404-6451-54cd-8c9e-13c4279fa00e/bfa1c404-6451-54cd-8c9e-13c4279fa00e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT18GME%252F699082533%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082533/600 saved to cache
2026-03-28 22:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bfa1c404-6451-54cd-8c9e-13c4279fa00e
2026-03-28 22:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126428/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE58YDD/42811268?sv=2020-08-04&st=2026-03-28T22%3A04%3A48Z&se=2026-03-28T22%3A29%3A48Z&sr=b&sp=r&sig=Y1l2KePDWqatVWtNYtuojwlTGPRJVAXG56IIpdU6uog%3D)
2026-03-28 22:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147099/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YK11VUF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082701/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KK07YAO/42811138?sv=2020-08-04&st=2026-03-28T22%3A04%3A46Z&se=2026-03-28T22%3A29%3A46Z&sr=b&sp=r&sig=1C6k7rD9GVDdvldVXIZ6nSQFIPqifpaJzEcpMuZ23pI%3D)
2026-03-28 22:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082724/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KK07YAO/42811138?sv=2020-08-04&st=2026-03-28T22%3A04%3A46Z&se=2026-03-28T22%3A29%3A46Z&sr=b&sp=r&sig=1C6k7rD9GVDdvldVXIZ6nSQFIPqifpaJzEcpMuZ23pI%3D)
2026-03-28 22:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126414/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE58YDD/42811268?sv=2020-08-04&st=2026-03-28T22%3A04%3A48Z&se=2026-03-28T22%3A29%3A48Z&sr=b&sp=r&sig=Y1l2KePDWqatVWtNYtuojwlTGPRJVAXG56IIpdU6uog%3D)
2026-03-28 22:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GP19AEE/42811089?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=m2GwNhLE1oLLg2uEAdtJl2qVGUgskjehRSLF0UCk37I%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GP19%20AEE-GB>
2026-03-28 22:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147108/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK11VUF/42811158?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=l8QAasE0E%2FzQR5QTuF2laotj8hcmBnHx0u13mVzzHt8%3D)
2026-03-28 22:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143138/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DV14VNO/42811439?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=AJzvLw0izZRKfov%2BeUrE5UmVQvMJLyUVerbX0NanFzs%3D)
2026-03-28 22:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX68ZHP/42810694?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=si7ibII3zklzEd48I6uQdL1wWUDROLg4nnXu4hDS6%2Bg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DX68%20ZHP-GB>
2026-03-28 22:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT69LRX/42811057?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=xSu1S1pUAV%2FKH7UFrNhtZx2jiqToKptH3cOErKy0wVg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YT69%20LRX-GB>
2026-03-28 22:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LY69GMG/42810675?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=jeye3MQSCliPIESqh1i5%2FjRkuwpNu0nmf1qtCgdbQf4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LY69%20GMG-GB>
2026-03-28 22:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543b82d0>
2026-03-28 22:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa1c404-6451-54cd-8c9e-13c4279fa00e/bfa1c404-6451-54cd-8c9e-13c4279fa00e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDT18GME%252F699082547%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082547/600 saved to cache
2026-03-28 22:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bfa1c404-6451-54cd-8c9e-13c4279fa00e
2026-03-28 22:04:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bfa1c404-6451-54cd-8c9e-13c4279fa00e, skipping ID generation
2026-03-28 22:04:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bfa1c404-6451-54cd-8c9e-13c4279fa00e sending to next pipeline
2026-03-28 22:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bfa1c404-6451-54cd-8c9e-13c4279fa00e, identifier: DT18%20GME
2026-03-28 22:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082677/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KK07YAO/42811138?sv=2020-08-04&st=2026-03-28T22%3A04%3A46Z&se=2026-03-28T22%3A29%3A46Z&sr=b&sp=r&sig=1C6k7rD9GVDdvldVXIZ6nSQFIPqifpaJzEcpMuZ23pI%3D)
2026-03-28 22:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bfa1c404-6451-54cd-8c9e-13c4279fa00e with identifier: DT18%20GME
2026-03-28 22:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bfa1c404-6451-54cd-8c9e-13c4279fa00e with identifier: DT18%20GME
2026-03-28 22:04:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bfa1c404-6451-54cd-8c9e-13c4279fa00e with identifier: DT18%20GME to the API
2026-03-28 22:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082547/600>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa1c404-6451-54cd-8c9e-13c4279fa00e/bfa1c404-6451-54cd-8c9e-13c4279fa00e_expert_report_file_1476e5fa-60d3-47e7-8b44-e250d0d4412f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DT18%20GME-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bfa1c404-6451-54cd-8c9e-13c4279fa00e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DT18 GME',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DT18%20GME&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 40221,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa1c404-6451-54cd-8c9e-13c4279fa00e/bfa1c404-6451-54cd-8c9e-13c4279fa00e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38172,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082519/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa1c404-6451-54cd-8c9e-13c4279fa00e/bfa1c404-6451-54cd-8c9e-13c4279fa00e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40333,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082533/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa1c404-6451-54cd-8c9e-13c4279fa00e/bfa1c404-6451-54cd-8c9e-13c4279fa00e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39259,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082547/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa1c404-6451-54cd-8c9e-13c4279fa00e/bfa1c404-6451-54cd-8c9e-13c4279fa00e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39413,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082559/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa1c404-6451-54cd-8c9e-13c4279fa00e/bfa1c404-6451-54cd-8c9e-13c4279fa00e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36616,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082570/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa1c404-6451-54cd-8c9e-13c4279fa00e/bfa1c404-6451-54cd-8c9e-13c4279fa00e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36182,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082581/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa1c404-6451-54cd-8c9e-13c4279fa00e/bfa1c404-6451-54cd-8c9e-13c4279fa00e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95330,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082601/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa1c404-6451-54cd-8c9e-13c4279fa00e/bfa1c404-6451-54cd-8c9e-13c4279fa00e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68143,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082622/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa1c404-6451-54cd-8c9e-13c4279fa00e/bfa1c404-6451-54cd-8c9e-13c4279fa00e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96518,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082649/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa1c404-6451-54cd-8c9e-13c4279fa00e/bfa1c404-6451-54cd-8c9e-13c4279fa00e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84003,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DT18GME/699082682/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.4 90 SE Hatchback',
'transmission': 'automatic',
'trim': '90 SE',
'vin': 'W0V0XEP08J6064276',
'year': 2018}
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT18%2520GME%27 HTTP/1.1" 200 None
2026-03-28 22:04:56 [bca.uk] INFO: Saving data for DT18%20GME: {'created_time': 1774735496.272889, 'last_price_update_time': 1774735496.2729, 'auction_closing_time': 1774951200.0}
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DT18%2520GME') HTTP/1.1" 204 0
2026-03-28 22:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147099/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK11VUF/42811158?sv=2020-08-04&st=2026-03-28T22%3A03%3A20Z&se=2026-03-28T22%3A28%3A20Z&sr=b&sp=r&sig=l8QAasE0E%2FzQR5QTuF2laotj8hcmBnHx0u13mVzzHt8%3D)
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547134d10>
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2aaf8e0-6656-5ea0-a55c-8214d714b81c/a2aaf8e0-6656-5ea0-a55c-8214d714b81c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMM67RNV%252F699252280%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252280/600 saved to cache
2026-03-28 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a2aaf8e0-6656-5ea0-a55c-8214d714b81c
2026-03-28 22:04:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54760f9d0>
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8291a8f-ab36-539f-839d-bb424053b7c9/a8291a8f-ab36-539f-839d-bb424053b7c9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE58YDD%252F699126593%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126593/600 saved to cache
2026-03-28 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a8291a8f-ab36-539f-839d-bb424053b7c9
2026-03-28 22:04:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472aa910>
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2aaf8e0-6656-5ea0-a55c-8214d714b81c/a2aaf8e0-6656-5ea0-a55c-8214d714b81c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMM67RNV%252F699252372%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252372/600 saved to cache
2026-03-28 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a2aaf8e0-6656-5ea0-a55c-8214d714b81c
2026-03-28 22:04:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2aaf8e0-6656-5ea0-a55c-8214d714b81c, skipping ID generation
2026-03-28 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2aaf8e0-6656-5ea0-a55c-8214d714b81c sending to next pipeline
2026-03-28 22:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a2aaf8e0-6656-5ea0-a55c-8214d714b81c, identifier: MM67%20RNV
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547700210>
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8291a8f-ab36-539f-839d-bb424053b7c9/a8291a8f-ab36-539f-839d-bb424053b7c9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE58YDD%252F699126428%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126428/600 saved to cache
2026-03-28 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a8291a8f-ab36-539f-839d-bb424053b7c9
2026-03-28 22:04:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554301d50>
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f9f14f-130c-5d1a-99c0-15c1239aa436/d5f9f14f-130c-5d1a-99c0-15c1239aa436_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKK07YAO%252F699082701%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082701/600 saved to cache
2026-03-28 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d5f9f14f-130c-5d1a-99c0-15c1239aa436
2026-03-28 22:04:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472aa310>
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f9f14f-130c-5d1a-99c0-15c1239aa436/d5f9f14f-130c-5d1a-99c0-15c1239aa436_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKK07YAO%252F699082724%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082724/600 saved to cache
2026-03-28 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d5f9f14f-130c-5d1a-99c0-15c1239aa436
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554238350>
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8291a8f-ab36-539f-839d-bb424053b7c9/a8291a8f-ab36-539f-839d-bb424053b7c9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE58YDD%252F699126414%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126414/600 saved to cache
2026-03-28 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a8291a8f-ab36-539f-839d-bb424053b7c9
2026-03-28 22:04:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8291a8f-ab36-539f-839d-bb424053b7c9, skipping ID generation
2026-03-28 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a8291a8f-ab36-539f-839d-bb424053b7c9 sending to next pipeline
2026-03-28 22:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a8291a8f-ab36-539f-839d-bb424053b7c9, identifier: AE58%20YDD
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472bd110>
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db8298e-1099-5db2-81d1-5141138419a2/3db8298e-1099-5db2-81d1-5141138419a2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK11VUF%252F699147108%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147108/600 saved to cache
2026-03-28 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3db8298e-1099-5db2-81d1-5141138419a2
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547373510>
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b6294-9845-5eb5-8c1d-a1f98760f95e/ef7b6294-9845-5eb5-8c1d-a1f98760f95e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDV14VNO%252F699143138%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143138/600 saved to cache
2026-03-28 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef7b6294-9845-5eb5-8c1d-a1f98760f95e
2026-03-28 22:04:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef7b6294-9845-5eb5-8c1d-a1f98760f95e, skipping ID generation
2026-03-28 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef7b6294-9845-5eb5-8c1d-a1f98760f95e sending to next pipeline
2026-03-28 22:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ef7b6294-9845-5eb5-8c1d-a1f98760f95e, identifier: DV14%20VNO
2026-03-28 22:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a2aaf8e0-6656-5ea0-a55c-8214d714b81c with identifier: MM67%20RNV
2026-03-28 22:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a2aaf8e0-6656-5ea0-a55c-8214d714b81c with identifier: MM67%20RNV
2026-03-28 22:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a2aaf8e0-6656-5ea0-a55c-8214d714b81c with identifier: MM67%20RNV to the API
2026-03-28 22:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252372/600>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2aaf8e0-6656-5ea0-a55c-8214d714b81c/a2aaf8e0-6656-5ea0-a55c-8214d714b81c_expert_report_file_4c781057-9fa3-4e8d-adaa-5f21afdbe83d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MM67%20RNV-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a2aaf8e0-6656-5ea0-a55c-8214d714b81c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MM67 RNV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MM67%20RNV&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'ECOSPORT',
'odometer': 45455,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2aaf8e0-6656-5ea0-a55c-8214d714b81c/a2aaf8e0-6656-5ea0-a55c-8214d714b81c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39973,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252275/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2aaf8e0-6656-5ea0-a55c-8214d714b81c/a2aaf8e0-6656-5ea0-a55c-8214d714b81c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40635,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252280/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2aaf8e0-6656-5ea0-a55c-8214d714b81c/a2aaf8e0-6656-5ea0-a55c-8214d714b81c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40560,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252285/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2aaf8e0-6656-5ea0-a55c-8214d714b81c/a2aaf8e0-6656-5ea0-a55c-8214d714b81c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41274,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252296/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2aaf8e0-6656-5ea0-a55c-8214d714b81c/a2aaf8e0-6656-5ea0-a55c-8214d714b81c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39374,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252306/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2aaf8e0-6656-5ea0-a55c-8214d714b81c/a2aaf8e0-6656-5ea0-a55c-8214d714b81c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38579,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252314/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2aaf8e0-6656-5ea0-a55c-8214d714b81c/a2aaf8e0-6656-5ea0-a55c-8214d714b81c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96561,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252330/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2aaf8e0-6656-5ea0-a55c-8214d714b81c/a2aaf8e0-6656-5ea0-a55c-8214d714b81c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89263,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252340/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2aaf8e0-6656-5ea0-a55c-8214d714b81c/a2aaf8e0-6656-5ea0-a55c-8214d714b81c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99587,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252357/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2aaf8e0-6656-5ea0-a55c-8214d714b81c/a2aaf8e0-6656-5ea0-a55c-8214d714b81c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83890,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM67RNV/699252372/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FORD ECOSPORT 1.0 E/B 125 ST-LINE StationWagon',
'transmission': 'automatic',
'trim': 'E/B 125 ST-LINE',
'vin': 'WF01XXERK1JY37600',
'year': 2018}
2026-03-28 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM67%2520RNV%27 HTTP/1.1" 200 None
2026-03-28 22:04:57 [bca.uk] INFO: Saving data for MM67%20RNV: {'created_time': 1774735497.308188, 'last_price_update_time': 1774735497.308202, 'auction_closing_time': 1774951200.0}
2026-03-28 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MM67%2520RNV') HTTP/1.1" 204 0
2026-03-28 22:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a8291a8f-ab36-539f-839d-bb424053b7c9 with identifier: AE58%20YDD
2026-03-28 22:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a8291a8f-ab36-539f-839d-bb424053b7c9 with identifier: AE58%20YDD
2026-03-28 22:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a8291a8f-ab36-539f-839d-bb424053b7c9 with identifier: AE58%20YDD to the API
2026-03-28 22:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126414/600>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8291a8f-ab36-539f-839d-bb424053b7c9/a8291a8f-ab36-539f-839d-bb424053b7c9_expert_report_file_9a44b6f5-7521-4014-a9a7-00492fd7dc4c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AE58%20YDD-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a8291a8f-ab36-539f-839d-bb424053b7c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AE58 YDD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AE58%20YDD&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 62528,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8291a8f-ab36-539f-839d-bb424053b7c9/a8291a8f-ab36-539f-839d-bb424053b7c9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38556,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126414/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8291a8f-ab36-539f-839d-bb424053b7c9/a8291a8f-ab36-539f-839d-bb424053b7c9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38747,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126428/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8291a8f-ab36-539f-839d-bb424053b7c9/a8291a8f-ab36-539f-839d-bb424053b7c9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39332,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126443/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8291a8f-ab36-539f-839d-bb424053b7c9/a8291a8f-ab36-539f-839d-bb424053b7c9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40492,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126470/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8291a8f-ab36-539f-839d-bb424053b7c9/a8291a8f-ab36-539f-839d-bb424053b7c9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36902,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126488/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8291a8f-ab36-539f-839d-bb424053b7c9/a8291a8f-ab36-539f-839d-bb424053b7c9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35331,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126506/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8291a8f-ab36-539f-839d-bb424053b7c9/a8291a8f-ab36-539f-839d-bb424053b7c9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112508,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126538/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8291a8f-ab36-539f-839d-bb424053b7c9/a8291a8f-ab36-539f-839d-bb424053b7c9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84859,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126560/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8291a8f-ab36-539f-839d-bb424053b7c9/a8291a8f-ab36-539f-839d-bb424053b7c9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90504,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126577/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8291a8f-ab36-539f-839d-bb424053b7c9/a8291a8f-ab36-539f-839d-bb424053b7c9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77815,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE58YDD/699126593/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.4 SXI 16V Hatchback',
'transmission': 'manual',
'trim': 'SXI 16V',
'vin': 'W0L0SDL6894049935',
'year': 2008}
2026-03-28 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE58%2520YDD%27 HTTP/1.1" 200 None
2026-03-28 22:04:57 [bca.uk] INFO: Saving data for AE58%20YDD: {'created_time': 1774735497.688483, 'last_price_update_time': 1774735497.688496, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AE58%2520YDD') HTTP/1.1" 204 0
2026-03-28 22:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ef7b6294-9845-5eb5-8c1d-a1f98760f95e with identifier: DV14%20VNO
2026-03-28 22:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ef7b6294-9845-5eb5-8c1d-a1f98760f95e with identifier: DV14%20VNO
2026-03-28 22:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ef7b6294-9845-5eb5-8c1d-a1f98760f95e with identifier: DV14%20VNO to the API
2026-03-28 22:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143138/600>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b6294-9845-5eb5-8c1d-a1f98760f95e/ef7b6294-9845-5eb5-8c1d-a1f98760f95e_expert_report_file_208a02d9-db28-4753-888b-245dc2600b33.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DV14%20VNO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ef7b6294-9845-5eb5-8c1d-a1f98760f95e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DV14 VNO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DV14%20VNO&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'KA',
'odometer': 75831,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b6294-9845-5eb5-8c1d-a1f98760f95e/ef7b6294-9845-5eb5-8c1d-a1f98760f95e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45517,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143138/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b6294-9845-5eb5-8c1d-a1f98760f95e/ef7b6294-9845-5eb5-8c1d-a1f98760f95e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42414,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143151/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b6294-9845-5eb5-8c1d-a1f98760f95e/ef7b6294-9845-5eb5-8c1d-a1f98760f95e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43119,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143166/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b6294-9845-5eb5-8c1d-a1f98760f95e/ef7b6294-9845-5eb5-8c1d-a1f98760f95e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43940,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143172/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b6294-9845-5eb5-8c1d-a1f98760f95e/ef7b6294-9845-5eb5-8c1d-a1f98760f95e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45930,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143186/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b6294-9845-5eb5-8c1d-a1f98760f95e/ef7b6294-9845-5eb5-8c1d-a1f98760f95e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43739,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143201/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b6294-9845-5eb5-8c1d-a1f98760f95e/ef7b6294-9845-5eb5-8c1d-a1f98760f95e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85062,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143221/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b6294-9845-5eb5-8c1d-a1f98760f95e/ef7b6294-9845-5eb5-8c1d-a1f98760f95e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45727,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143238/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b6294-9845-5eb5-8c1d-a1f98760f95e/ef7b6294-9845-5eb5-8c1d-a1f98760f95e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93679,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143255/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b6294-9845-5eb5-8c1d-a1f98760f95e/ef7b6294-9845-5eb5-8c1d-a1f98760f95e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73925,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV14VNO/699143271/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD KA 1.2 METAL S/S Hatchback',
'transmission': 'manual',
'trim': 'METAL S/S',
'vin': 'WF0UXXLTRUEL57243',
'year': 2014}
2026-03-28 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV14%2520VNO%27 HTTP/1.1" 200 None
2026-03-28 22:04:58 [bca.uk] INFO: Saving data for DV14%20VNO: {'created_time': 1774735498.076667, 'last_price_update_time': 1774735498.076678, 'auction_closing_time': 1774951200.0}
2026-03-28 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DV14%2520VNO') HTTP/1.1" 204 0
2026-03-28 22:04:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:04:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:04:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:04:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472ab0d0>
2026-03-28 22:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f9f14f-130c-5d1a-99c0-15c1239aa436/d5f9f14f-130c-5d1a-99c0-15c1239aa436_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKK07YAO%252F699082677%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082677/600 saved to cache
2026-03-28 22:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d5f9f14f-130c-5d1a-99c0-15c1239aa436
2026-03-28 22:04:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d5f9f14f-130c-5d1a-99c0-15c1239aa436, skipping ID generation
2026-03-28 22:04:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d5f9f14f-130c-5d1a-99c0-15c1239aa436 sending to next pipeline
2026-03-28 22:04:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d5f9f14f-130c-5d1a-99c0-15c1239aa436, identifier: KK07%20YAO
2026-03-28 22:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK20LVZ/42810609?sv=2020-08-04&st=2026-03-28T22%3A04%3A54Z&se=2026-03-28T22%3A29%3A54Z&sr=b&sp=r&sig=1rlMrLgnScXfscprI2w%2F9uGrt4kZZOWiG68r4kKHBnY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d5f9f14f-130c-5d1a-99c0-15c1239aa436 with identifier: KK07%20YAO
2026-03-28 22:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d5f9f14f-130c-5d1a-99c0-15c1239aa436 with identifier: KK07%20YAO
2026-03-28 22:04:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d5f9f14f-130c-5d1a-99c0-15c1239aa436 with identifier: KK07%20YAO to the API
2026-03-28 22:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082677/600>
{'auction_title': '',
'c_o_2_emission_value': 355,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f9f14f-130c-5d1a-99c0-15c1239aa436/d5f9f14f-130c-5d1a-99c0-15c1239aa436_expert_report_file_da84524a-4120-4e9f-a1f8-bb5dcd5ca808.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KK07%20YAO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd5f9f14f-130c-5d1a-99c0-15c1239aa436',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KK07 YAO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KK07%20YAO&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MAZDA',
'model': '5',
'odometer': 132337,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f9f14f-130c-5d1a-99c0-15c1239aa436/d5f9f14f-130c-5d1a-99c0-15c1239aa436_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38951,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082584/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f9f14f-130c-5d1a-99c0-15c1239aa436/d5f9f14f-130c-5d1a-99c0-15c1239aa436_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39158,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082593/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f9f14f-130c-5d1a-99c0-15c1239aa436/d5f9f14f-130c-5d1a-99c0-15c1239aa436_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39784,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082606/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f9f14f-130c-5d1a-99c0-15c1239aa436/d5f9f14f-130c-5d1a-99c0-15c1239aa436_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41002,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082616/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f9f14f-130c-5d1a-99c0-15c1239aa436/d5f9f14f-130c-5d1a-99c0-15c1239aa436_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36744,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082638/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f9f14f-130c-5d1a-99c0-15c1239aa436/d5f9f14f-130c-5d1a-99c0-15c1239aa436_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35231,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082652/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f9f14f-130c-5d1a-99c0-15c1239aa436/d5f9f14f-130c-5d1a-99c0-15c1239aa436_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107838,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082677/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f9f14f-130c-5d1a-99c0-15c1239aa436/d5f9f14f-130c-5d1a-99c0-15c1239aa436_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86410,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082701/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f9f14f-130c-5d1a-99c0-15c1239aa436/d5f9f14f-130c-5d1a-99c0-15c1239aa436_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97035,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082724/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f9f14f-130c-5d1a-99c0-15c1239aa436/d5f9f14f-130c-5d1a-99c0-15c1239aa436_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86223,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KK07YAO/699082741/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'MAZDA 5 1.8 TS2 MPV',
'transmission': 'manual',
'trim': 'TS2',
'vin': 'JMZCR198200215100',
'year': 2007}
2026-03-28 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KK07%2520YAO%27 HTTP/1.1" 200 None
2026-03-28 22:04:58 [bca.uk] INFO: Saving data for KK07%20YAO: {'created_time': 1774735498.56025, 'last_price_update_time': 1774735498.56026, 'auction_closing_time': 1774864800.0}
2026-03-28 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KK07%2520YAO') HTTP/1.1" 204 0
2026-03-28 22:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX68ZHP/42810694?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=si7ibII3zklzEd48I6uQdL1wWUDROLg4nnXu4hDS6%2Bg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GP19AEE/42811089?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=m2GwNhLE1oLLg2uEAdtJl2qVGUgskjehRSLF0UCk37I%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT69LRX/42811057?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=xSu1S1pUAV%2FKH7UFrNhtZx2jiqToKptH3cOErKy0wVg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LY69GMG/42810675?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=jeye3MQSCliPIESqh1i5%2FjRkuwpNu0nmf1qtCgdbQf4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543df750>
2026-03-28 22:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db8298e-1099-5db2-81d1-5141138419a2/3db8298e-1099-5db2-81d1-5141138419a2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK11VUF%252F699147099%252F600') HTTP/1.1" 204 0
2026-03-28 22:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147099/600 saved to cache
2026-03-28 22:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3db8298e-1099-5db2-81d1-5141138419a2
2026-03-28 22:04:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3db8298e-1099-5db2-81d1-5141138419a2, skipping ID generation
2026-03-28 22:04:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3db8298e-1099-5db2-81d1-5141138419a2 sending to next pipeline
2026-03-28 22:04:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3db8298e-1099-5db2-81d1-5141138419a2, identifier: YK11%20VUF
2026-03-28 22:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3db8298e-1099-5db2-81d1-5141138419a2 with identifier: YK11%20VUF
2026-03-28 22:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3db8298e-1099-5db2-81d1-5141138419a2 with identifier: YK11%20VUF
2026-03-28 22:04:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3db8298e-1099-5db2-81d1-5141138419a2 with identifier: YK11%20VUF to the API
2026-03-28 22:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:04:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147099/600>
{'auction_title': '',
'c_o_2_emission_value': 263,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3db8298e-1099-5db2-81d1-5141138419a2/3db8298e-1099-5db2-81d1-5141138419a2_expert_report_file_febde9ad-e343-44ee-891c-3c76d3118f59.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YK11%20VUF-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '4.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3db8298e-1099-5db2-81d1-5141138419a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YK11 VUF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YK11%20VUF&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'BMW',
'model': 'M3',
'odometer': 80126,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3db8298e-1099-5db2-81d1-5141138419a2/3db8298e-1099-5db2-81d1-5141138419a2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44341,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147099/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3db8298e-1099-5db2-81d1-5141138419a2/3db8298e-1099-5db2-81d1-5141138419a2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41984,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147108/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3db8298e-1099-5db2-81d1-5141138419a2/3db8298e-1099-5db2-81d1-5141138419a2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42316,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147113/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3db8298e-1099-5db2-81d1-5141138419a2/3db8298e-1099-5db2-81d1-5141138419a2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45128,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147122/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3db8298e-1099-5db2-81d1-5141138419a2/3db8298e-1099-5db2-81d1-5141138419a2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42708,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147129/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3db8298e-1099-5db2-81d1-5141138419a2/3db8298e-1099-5db2-81d1-5141138419a2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39244,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147135/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3db8298e-1099-5db2-81d1-5141138419a2/3db8298e-1099-5db2-81d1-5141138419a2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81717,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147148/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3db8298e-1099-5db2-81d1-5141138419a2/3db8298e-1099-5db2-81d1-5141138419a2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45864,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147158/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3db8298e-1099-5db2-81d1-5141138419a2/3db8298e-1099-5db2-81d1-5141138419a2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87752,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147174/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3db8298e-1099-5db2-81d1-5141138419a2/3db8298e-1099-5db2-81d1-5141138419a2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75959,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK11VUF/699147190/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'BMW M3 4.0 V8 DCT Coupe',
'transmission': 'automatic',
'trim': 'V8 DCT',
'vin': 'WBSKG92080E697645',
'year': 2011}
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK11%2520VUF%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [bca.uk] INFO: Saving data for YK11%20VUF: {'created_time': 1774735499.09047, 'last_price_update_time': 1774735499.090483, 'auction_closing_time': 1774951200.0}
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YK11%2520VUF') HTTP/1.1" 204 0
2026-03-28 22:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543dda10>
2026-03-28 22:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672f5a9d-28c4-530d-bba8-ceb046fc83e2/672f5a9d-28c4-530d-bba8-ceb046fc83e2_expert_report_file_92813a64-2b79-43d0-b82e-d1db2e87fea0.pdf HTTP/1.1" 201 0
2026-03-28 22:04:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 672f5a9d-28c4-530d-bba8-ceb046fc83e2
2026-03-28 22:04:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 672f5a9d-28c4-530d-bba8-ceb046fc83e2, skipping ID generation
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 672f5a9d-28c4-530d-bba8-ceb046fc83e2
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPK20LVZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PK20LVZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994436%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994436 not downloaded yet
2026-03-28 22:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472786d0>
2026-03-28 22:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_423a16e7-0aa7-505e-9fca-30afcd20041f/423a16e7-0aa7-505e-9fca-30afcd20041f_expert_report_file_fefcd4cf-b792-4cc7-821d-aad4bd8fb7f7.pdf HTTP/1.1" 201 0
2026-03-28 22:04:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 423a16e7-0aa7-505e-9fca-30afcd20041f
2026-03-28 22:04:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 423a16e7-0aa7-505e-9fca-30afcd20041f, skipping ID generation
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 423a16e7-0aa7-505e-9fca-30afcd20041f
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDX68ZHP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DX68ZHP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543943d0>
2026-03-28 22:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb674af7-fcd3-5648-bd02-bf57f2b6d8c9/cb674af7-fcd3-5648-bd02-bf57f2b6d8c9_expert_report_file_506cafde-55ac-43a7-aa70-ac684900a7ca.pdf HTTP/1.1" 201 0
2026-03-28 22:04:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cb674af7-fcd3-5648-bd02-bf57f2b6d8c9
2026-03-28 22:04:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb674af7-fcd3-5648-bd02-bf57f2b6d8c9, skipping ID generation
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb674af7-fcd3-5648-bd02-bf57f2b6d8c9
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGP19AEE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GP19AEE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554947090>
2026-03-28 22:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01670b58-a63c-5bbc-b764-269e297cd699/01670b58-a63c-5bbc-b764-269e297cd699_expert_report_file_8cdc6d40-07ca-4d9c-abff-8da92793d6da.pdf HTTP/1.1" 201 0
2026-03-28 22:04:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 01670b58-a63c-5bbc-b764-269e297cd699
2026-03-28 22:04:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01670b58-a63c-5bbc-b764-269e297cd699, skipping ID generation
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01670b58-a63c-5bbc-b764-269e297cd699
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYT69LRX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YT69LRX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554396410>
2026-03-28 22:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c46e0b3-fe77-5881-ab60-346741749047/4c46e0b3-fe77-5881-ab60-346741749047_expert_report_file_bd4b8949-c856-465a-a871-de967c5f3ca5.pdf HTTP/1.1" 201 0
2026-03-28 22:04:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4c46e0b3-fe77-5881-ab60-346741749047
2026-03-28 22:04:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c46e0b3-fe77-5881-ab60-346741749047, skipping ID generation
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c46e0b3-fe77-5881-ab60-346741749047
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLY69GMG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LY69GMG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994459%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994459 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011265%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011265 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073154%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073154 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073155%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073155 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011355%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011355 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994469%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994469 not downloaded yet
2026-03-28 22:04:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994418/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PK20LVZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011276%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011276 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073174%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073174 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073167%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073167 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011364%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011364 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994486%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994486 not downloaded yet
2026-03-28 22:04:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994436/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994436>
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011289%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011289 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073187%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073187 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073181%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073181 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011373%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011373 not downloaded yet
2026-03-28 22:04:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011344/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LY69GMG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX68ZHP/699011251/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DX68ZHP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073145/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YT69LRX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP19AEE/699073144/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GP19AEE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994501%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994501 not downloaded yet
2026-03-28 22:04:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994459/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994459>
2026-03-28 22:04:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011355/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011355>
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011303%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011303 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073198%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073198 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073194%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073194 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011387%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011387 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994523%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994523 not downloaded yet
2026-03-28 22:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994418/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK20LVZ/42810609?sv=2020-08-04&st=2026-03-28T22%3A04%3A54Z&se=2026-03-28T22%3A29%3A54Z&sr=b&sp=r&sig=1rlMrLgnScXfscprI2w%2F9uGrt4kZZOWiG68r4kKHBnY%3D)
2026-03-28 22:04:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX68ZHP/699011265/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011265>
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011309%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011309 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073209%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073209 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073208%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073208 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011404%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011404 not downloaded yet
2026-03-28 22:04:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073155/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073155>
2026-03-28 22:04:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994469/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994469>
2026-03-28 22:04:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP19AEE/699073154/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073154>
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994547%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994547 not downloaded yet
2026-03-28 22:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP19AEE/699073144/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GP19AEE/42811089?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=m2GwNhLE1oLLg2uEAdtJl2qVGUgskjehRSLF0UCk37I%3D)
2026-03-28 22:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX68ZHP/699011251/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX68ZHP/42810694?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=si7ibII3zklzEd48I6uQdL1wWUDROLg4nnXu4hDS6%2Bg%3D)
2026-03-28 22:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073145/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT69LRX/42811057?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=xSu1S1pUAV%2FKH7UFrNhtZx2jiqToKptH3cOErKy0wVg%3D)
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011324%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011324 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073223%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073223 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073222%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073222 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011442%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011442 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994570%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994570 not downloaded yet
2026-03-28 22:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011344/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LY69GMG/42810675?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=jeye3MQSCliPIESqh1i5%2FjRkuwpNu0nmf1qtCgdbQf4%3D)
2026-03-28 22:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994436/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK20LVZ/42810609?sv=2020-08-04&st=2026-03-28T22%3A04%3A54Z&se=2026-03-28T22%3A29%3A54Z&sr=b&sp=r&sig=1rlMrLgnScXfscprI2w%2F9uGrt4kZZOWiG68r4kKHBnY%3D)
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011335%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011335 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073231%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073231 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073232%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073232 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011476%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011476 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994598%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994598 not downloaded yet
2026-03-28 22:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011355/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LY69GMG/42810675?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=jeye3MQSCliPIESqh1i5%2FjRkuwpNu0nmf1qtCgdbQf4%3D)
2026-03-28 22:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994459/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK20LVZ/42810609?sv=2020-08-04&st=2026-03-28T22%3A04%3A54Z&se=2026-03-28T22%3A29%3A54Z&sr=b&sp=r&sig=1rlMrLgnScXfscprI2w%2F9uGrt4kZZOWiG68r4kKHBnY%3D)
2026-03-28 22:04:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073167/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073167>
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011350%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011350 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073246%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073246 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073251%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073251 not downloaded yet
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011499%27 HTTP/1.1" 200 None
2026-03-28 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011499 not downloaded yet
2026-03-28 22:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547613050>
2026-03-28 22:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672f5a9d-28c4-530d-bba8-ceb046fc83e2/672f5a9d-28c4-530d-bba8-ceb046fc83e2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK20LVZ%252F698994418%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994418/600 saved to cache
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 672f5a9d-28c4-530d-bba8-ceb046fc83e2
2026-03-28 22:05:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994486/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994486>
2026-03-28 22:05:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011364/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011364>
2026-03-28 22:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX68ZHP/699011265/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX68ZHP/42810694?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=si7ibII3zklzEd48I6uQdL1wWUDROLg4nnXu4hDS6%2Bg%3D)
2026-03-28 22:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP19AEE/699073154/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GP19AEE/42811089?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=m2GwNhLE1oLLg2uEAdtJl2qVGUgskjehRSLF0UCk37I%3D)
2026-03-28 22:05:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011387/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011387>
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011367%27 HTTP/1.1" 200 None
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011367 not downloaded yet
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073264%27 HTTP/1.1" 200 None
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073264 not downloaded yet
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073268%27 HTTP/1.1" 200 None
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073268 not downloaded yet
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011528%27 HTTP/1.1" 200 None
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011528 not downloaded yet
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55431b510>
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb674af7-fcd3-5648-bd02-bf57f2b6d8c9/cb674af7-fcd3-5648-bd02-bf57f2b6d8c9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGP19AEE%252F699073144%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP19AEE/699073144/600 saved to cache
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb674af7-fcd3-5648-bd02-bf57f2b6d8c9
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542fe2d0>
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_423a16e7-0aa7-505e-9fca-30afcd20041f/423a16e7-0aa7-505e-9fca-30afcd20041f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX68ZHP%252F699011251%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX68ZHP/699011251/600 saved to cache
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 423a16e7-0aa7-505e-9fca-30afcd20041f
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b37250>
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01670b58-a63c-5bbc-b764-269e297cd699/01670b58-a63c-5bbc-b764-269e297cd699_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT69LRX%252F699073145%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073145/600 saved to cache
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01670b58-a63c-5bbc-b764-269e297cd699
2026-03-28 22:05:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011404/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011404>
2026-03-28 22:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073155/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT69LRX/42811057?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=xSu1S1pUAV%2FKH7UFrNhtZx2jiqToKptH3cOErKy0wVg%3D)
2026-03-28 22:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547641990>
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c46e0b3-fe77-5881-ab60-346741749047/4c46e0b3-fe77-5881-ab60-346741749047_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLY69GMG%252F699011344%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011344/600 saved to cache
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c46e0b3-fe77-5881-ab60-346741749047
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477cf610>
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672f5a9d-28c4-530d-bba8-ceb046fc83e2/672f5a9d-28c4-530d-bba8-ceb046fc83e2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK20LVZ%252F698994436%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994436/600 saved to cache
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 672f5a9d-28c4-530d-bba8-ceb046fc83e2
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55729c690>
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c46e0b3-fe77-5881-ab60-346741749047/4c46e0b3-fe77-5881-ab60-346741749047_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLY69GMG%252F699011355%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011355/600 saved to cache
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c46e0b3-fe77-5881-ab60-346741749047
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a8f990>
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672f5a9d-28c4-530d-bba8-ceb046fc83e2/672f5a9d-28c4-530d-bba8-ceb046fc83e2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK20LVZ%252F698994459%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994459/600 saved to cache
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 672f5a9d-28c4-530d-bba8-ceb046fc83e2
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542feb50>
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_423a16e7-0aa7-505e-9fca-30afcd20041f/423a16e7-0aa7-505e-9fca-30afcd20041f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX68ZHP%252F699011265%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX68ZHP/699011265/600 saved to cache
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 423a16e7-0aa7-505e-9fca-30afcd20041f
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477ef390>
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb674af7-fcd3-5648-bd02-bf57f2b6d8c9/cb674af7-fcd3-5648-bd02-bf57f2b6d8c9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGP19AEE%252F699073154%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP19AEE/699073154/600 saved to cache
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb674af7-fcd3-5648-bd02-bf57f2b6d8c9
2026-03-28 22:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073167/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT69LRX/42811057?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=xSu1S1pUAV%2FKH7UFrNhtZx2jiqToKptH3cOErKy0wVg%3D)
2026-03-28 22:05:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073208/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073208>
2026-03-28 22:05:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011442/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011442>
2026-03-28 22:05:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073222/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073222>
2026-03-28 22:05:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP19AEE/699073209/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073209>
2026-03-28 22:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994469/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK20LVZ/42810609?sv=2020-08-04&st=2026-03-28T22%3A04%3A54Z&se=2026-03-28T22%3A29%3A54Z&sr=b&sp=r&sig=1rlMrLgnScXfscprI2w%2F9uGrt4kZZOWiG68r4kKHBnY%3D)
2026-03-28 22:05:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011476/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011476>
2026-03-28 22:05:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073232/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073232>
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55433b3d0>
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01670b58-a63c-5bbc-b764-269e297cd699/01670b58-a63c-5bbc-b764-269e297cd699_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT69LRX%252F699073155%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073155/600 saved to cache
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 01670b58-a63c-5bbc-b764-269e297cd699
2026-03-28 22:05:00 [bca.uk] INFO: Total items found: 100
2026-03-28 22:05:00 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded
2026-03-28 22:05:00 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 22:05:00 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 22:05:00 [bca.uk] INFO: Found listing with ID: GF67%20XMD
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF67%2520XMD%27 HTTP/1.1" 200 None
2026-03-28 22:05:00 [bca.uk] INFO: Scrape type for GF67%20XMD: 1
2026-03-28 22:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73245291-7014-5e92-9739-b929afc3bb3a with identifier: GF67%20XMD
2026-03-28 22:05:00 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 73245291-7014-5e92-9739-b929afc3bb3a
2026-03-28 22:05:00 [bca.uk] INFO: Found listing with ID: DE57%20JFF
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE57%2520JFF%27 HTTP/1.1" 200 None
2026-03-28 22:05:00 [bca.uk] INFO: Scrape type for DE57%20JFF: 0
2026-03-28 22:05:00 [bca.uk] INFO: Found listing with ID: GJ67%20HWW
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ67%2520HWW%27 HTTP/1.1" 200 None
2026-03-28 22:05:00 [bca.uk] INFO: Scrape type for GJ67%20HWW: 1
2026-03-28 22:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e220b51-e3aa-5dfc-97bc-648f804c494e with identifier: GJ67%20HWW
2026-03-28 22:05:00 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2e220b51-e3aa-5dfc-97bc-648f804c494e
2026-03-28 22:05:00 [bca.uk] INFO: Found listing with ID: SB15%20DHF
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB15%2520DHF%27 HTTP/1.1" 200 None
2026-03-28 22:05:00 [bca.uk] INFO: Scrape type for SB15%20DHF: 1
2026-03-28 22:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d with identifier: SB15%20DHF
2026-03-28 22:05:00 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547641850>
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01670b58-a63c-5bbc-b764-269e297cd699/01670b58-a63c-5bbc-b764-269e297cd699_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT69LRX%252F699073167%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073167/600 saved to cache
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 01670b58-a63c-5bbc-b764-269e297cd699
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547754550>
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672f5a9d-28c4-530d-bba8-ceb046fc83e2/672f5a9d-28c4-530d-bba8-ceb046fc83e2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK20LVZ%252F698994469%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994469/600 saved to cache
2026-03-28 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 672f5a9d-28c4-530d-bba8-ceb046fc83e2
2026-03-28 22:05:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073251/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073251>
2026-03-28 22:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011404/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LY69GMG/42810675?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=jeye3MQSCliPIESqh1i5%2FjRkuwpNu0nmf1qtCgdbQf4%3D)
2026-03-28 22:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011387/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LY69GMG/42810675?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=jeye3MQSCliPIESqh1i5%2FjRkuwpNu0nmf1qtCgdbQf4%3D)
2026-03-28 22:05:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011499/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011499>
2026-03-28 22:05:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073268/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073268>
2026-03-28 22:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011364/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LY69GMG/42810675?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=jeye3MQSCliPIESqh1i5%2FjRkuwpNu0nmf1qtCgdbQf4%3D)
2026-03-28 22:05:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011528/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011528>
2026-03-28 22:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994486/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK20LVZ/42810609?sv=2020-08-04&st=2026-03-28T22%3A04%3A54Z&se=2026-03-28T22%3A29%3A54Z&sr=b&sp=r&sig=1rlMrLgnScXfscprI2w%2F9uGrt4kZZOWiG68r4kKHBnY%3D)
2026-03-28 22:05:00 [bca.uk] INFO: Found listing with ID: BD18%20RFJ
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD18%2520RFJ%27 HTTP/1.1" 200 None
2026-03-28 22:05:00 [bca.uk] INFO: Scrape type for BD18%20RFJ: 1
2026-03-28 22:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0ba24d3-8587-5eee-9f39-5a8e165a6cdc with identifier: BD18%20RFJ
2026-03-28 22:05:00 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f0ba24d3-8587-5eee-9f39-5a8e165a6cdc
2026-03-28 22:05:00 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 22:05:00 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 22:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 22:05:00 [bca.uk] INFO: Found listing with ID: PX15%20ZPR
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX15%2520ZPR%27 HTTP/1.1" 200 None
2026-03-28 22:05:00 [bca.uk] INFO: Scrape type for PX15%20ZPR: 1
2026-03-28 22:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 867b722d-9875-5e9c-b6b5-4614e36a0cad with identifier: PX15%20ZPR
2026-03-28 22:05:00 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 867b722d-9875-5e9c-b6b5-4614e36a0cad
2026-03-28 22:05:00 [bca.uk] INFO: Found listing with ID: FD17%20FAM
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD17%2520FAM%27 HTTP/1.1" 200 None
2026-03-28 22:05:00 [bca.uk] INFO: Scrape type for FD17%20FAM: 1
2026-03-28 22:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b4494bc-d302-5d25-af44-49f73fc6f3e8 with identifier: FD17%20FAM
2026-03-28 22:05:00 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3b4494bc-d302-5d25-af44-49f73fc6f3e8
2026-03-28 22:05:00 [bca.uk] INFO: Found listing with ID: ML14%20AHZ
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML14%2520AHZ%27 HTTP/1.1" 200 None
2026-03-28 22:05:00 [bca.uk] INFO: Scrape type for ML14%20AHZ: 0
2026-03-28 22:05:00 [bca.uk] INFO: Found listing with ID: DN60%20UOP
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN60%2520UOP%27 HTTP/1.1" 200 None
2026-03-28 22:05:00 [bca.uk] INFO: Scrape type for DN60%20UOP: 0
2026-03-28 22:05:00 [bca.uk] INFO: Found listing with ID: LN03%20XSM
2026-03-28 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN03%2520XSM%27 HTTP/1.1" 200 None
2026-03-28 22:05:01 [bca.uk] INFO: Scrape type for LN03%20XSM: 2
2026-03-28 22:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8aa6468d-a0af-5b55-ae84-c596442f3580 with identifier: LN03%20XSM
2026-03-28 22:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8aa6468d-a0af-5b55-ae84-c596442f3580 with scrape type 2
2026-03-28 22:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8aa6468d-a0af-5b55-ae84-c596442f3580 with scrape type 2
2026-03-28 22:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8aa6468d-a0af-5b55-ae84-c596442f3580, identifier: LN03%20XSM
2026-03-28 22:05:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8aa6468d-a0af-5b55-ae84-c596442f3580 with identifier: LN03%20XSM
2026-03-28 22:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8aa6468d-a0af-5b55-ae84-c596442f3580 with identifier: LN03%20XSM
2026-03-28 22:05:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8aa6468d-a0af-5b55-ae84-c596442f3580 with identifier: LN03%20XSM to the API
2026-03-28 22:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 212,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LN03%20XSM-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8aa6468d-a0af-5b55-ae84-c596442f3580',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LN03 XSM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LN03%20XSM&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'MERCEDES-BENZ',
'model': 'C200',
'odometer': 79640,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C200 1.8 K AVANTGARDE SE Saloon',
'transmission': 'manual',
'trim': 'K AVANTGARDE SE',
'vin': 'WDC2030422R102206',
'year': 2003}
2026-03-28 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN03%2520XSM%27 HTTP/1.1" 200 None
2026-03-28 22:05:01 [bca.uk] INFO: Saving data for LN03%20XSM: {'auction_closing_time': 1774864800.0, 'created_time': 1774304070.782947, 'last_price_update_time': 1774735501.863865}
2026-03-28 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LN03%2520XSM') HTTP/1.1" 204 0
2026-03-28 22:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP19AEE/699073209/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GP19AEE/42811089?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=m2GwNhLE1oLLg2uEAdtJl2qVGUgskjehRSLF0UCk37I%3D)
2026-03-28 22:05:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP19AEE/699073264/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073264>
2026-03-28 22:05:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX68ZHP/699011367/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011367>
2026-03-28 22:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073208/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT69LRX/42811057?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=xSu1S1pUAV%2FKH7UFrNhtZx2jiqToKptH3cOErKy0wVg%3D)
2026-03-28 22:05:02 [bca.uk] INFO: Found listing with ID: KF54%20RYD
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF54%2520RYD%27 HTTP/1.1" 200 None
2026-03-28 22:05:02 [bca.uk] INFO: Scrape type for KF54%20RYD: 0
2026-03-28 22:05:02 [bca.uk] INFO: Found listing with ID: DE59%20LRX
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE59%2520LRX%27 HTTP/1.1" 200 None
2026-03-28 22:05:02 [bca.uk] INFO: Scrape type for DE59%20LRX: 0
2026-03-28 22:05:02 [bca.uk] INFO: Found listing with ID: ND05%20TWY
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND05%2520TWY%27 HTTP/1.1" 200 None
2026-03-28 22:05:02 [bca.uk] INFO: Scrape type for ND05%20TWY: 1
2026-03-28 22:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f7d66be-49b7-5d86-a859-5c899ed35afc with identifier: ND05%20TWY
2026-03-28 22:05:02 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8f7d66be-49b7-5d86-a859-5c899ed35afc
2026-03-28 22:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011442/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LY69GMG/42810675?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=jeye3MQSCliPIESqh1i5%2FjRkuwpNu0nmf1qtCgdbQf4%3D)
2026-03-28 22:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011476/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LY69GMG/42810675?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=jeye3MQSCliPIESqh1i5%2FjRkuwpNu0nmf1qtCgdbQf4%3D)
2026-03-28 22:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073222/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT69LRX/42811057?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=xSu1S1pUAV%2FKH7UFrNhtZx2jiqToKptH3cOErKy0wVg%3D)
2026-03-28 22:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073232/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT69LRX/42811057?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=xSu1S1pUAV%2FKH7UFrNhtZx2jiqToKptH3cOErKy0wVg%3D)
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b72390>
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c46e0b3-fe77-5881-ab60-346741749047/4c46e0b3-fe77-5881-ab60-346741749047_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLY69GMG%252F699011404%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011404/600 saved to cache
2026-03-28 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c46e0b3-fe77-5881-ab60-346741749047
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554367f50>
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c46e0b3-fe77-5881-ab60-346741749047/4c46e0b3-fe77-5881-ab60-346741749047_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLY69GMG%252F699011387%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011387/600 saved to cache
2026-03-28 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c46e0b3-fe77-5881-ab60-346741749047
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55420e990>
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c46e0b3-fe77-5881-ab60-346741749047/4c46e0b3-fe77-5881-ab60-346741749047_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLY69GMG%252F699011364%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011364/600 saved to cache
2026-03-28 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c46e0b3-fe77-5881-ab60-346741749047
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54713bd50>
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672f5a9d-28c4-530d-bba8-ceb046fc83e2/672f5a9d-28c4-530d-bba8-ceb046fc83e2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK20LVZ%252F698994486%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994486/600 saved to cache
2026-03-28 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 672f5a9d-28c4-530d-bba8-ceb046fc83e2
2026-03-28 22:05:02 [bca.uk] INFO: Found listing with ID: YB08%20SFN
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB08%2520SFN%27 HTTP/1.1" 200 None
2026-03-28 22:05:02 [bca.uk] INFO: Scrape type for YB08%20SFN: 2
2026-03-28 22:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef473b27-2adc-5a8e-8fc2-8406885a385c with identifier: YB08%20SFN
2026-03-28 22:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef473b27-2adc-5a8e-8fc2-8406885a385c with scrape type 2
2026-03-28 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef473b27-2adc-5a8e-8fc2-8406885a385c with scrape type 2
2026-03-28 22:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ef473b27-2adc-5a8e-8fc2-8406885a385c, identifier: YB08%20SFN
2026-03-28 22:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ef473b27-2adc-5a8e-8fc2-8406885a385c with identifier: YB08%20SFN
2026-03-28 22:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ef473b27-2adc-5a8e-8fc2-8406885a385c with identifier: YB08%20SFN
2026-03-28 22:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ef473b27-2adc-5a8e-8fc2-8406885a385c with identifier: YB08%20SFN to the API
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YB08%20SFN-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ef473b27-2adc-5a8e-8fc2-8406885a385c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YB08 SFN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YB08%20SFN&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'MINI',
'model': 'ONE',
'odometer': 88432,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'MINI ONE 1.4 Hatchback',
'transmission': 'manual',
'trim': '',
'vin': 'WMWME32060TM55559',
'year': 2008}
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB08%2520SFN%27 HTTP/1.1" 200 None
2026-03-28 22:05:02 [bca.uk] INFO: Saving data for YB08%20SFN: {'auction_closing_time': 1774864800.0, 'created_time': 1774621483.623975, 'last_price_update_time': 1774735502.677142}
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YB08%2520SFN') HTTP/1.1" 204 0
2026-03-28 22:05:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB15DHF/42810688?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=z80RjqPqkscTGhJimgx1YcejekegApPhOp4js7HWGmI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SB15%20DHF-GB>
2026-03-28 22:05:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ67HWW/42810839?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=bCH4BiUF13obmrAOV4AiGB4NLH07S%2Bo99SNbSt0wxEM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ67%20HWW-GB>
2026-03-28 22:05:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF67XMD/42810564?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=DCaGeHL1U5FPXugPOzoPJN1lnR3ggJ%2BFYs5kRo3pbmM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF67%20XMD-GB>
2026-03-28 22:05:02 [bca.uk] INFO: Found listing with ID: YK63%20HJU
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK63%2520HJU%27 HTTP/1.1" 200 None
2026-03-28 22:05:02 [bca.uk] INFO: Scrape type for YK63%20HJU: 0
2026-03-28 22:05:02 [bca.uk] INFO: Found listing with ID: VN10%20HZJ
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN10%2520HZJ%27 HTTP/1.1" 200 None
2026-03-28 22:05:02 [bca.uk] INFO: Scrape type for VN10%20HZJ: 2
2026-03-28 22:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af7614dc-d0aa-516f-9e3a-5a12f63942d2 with identifier: VN10%20HZJ
2026-03-28 22:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af7614dc-d0aa-516f-9e3a-5a12f63942d2 with scrape type 2
2026-03-28 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af7614dc-d0aa-516f-9e3a-5a12f63942d2 with scrape type 2
2026-03-28 22:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: af7614dc-d0aa-516f-9e3a-5a12f63942d2, identifier: VN10%20HZJ
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554367e90>
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb674af7-fcd3-5648-bd02-bf57f2b6d8c9/cb674af7-fcd3-5648-bd02-bf57f2b6d8c9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGP19AEE%252F699073209%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP19AEE/699073209/600 saved to cache
2026-03-28 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb674af7-fcd3-5648-bd02-bf57f2b6d8c9
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a8c190>
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01670b58-a63c-5bbc-b764-269e297cd699/01670b58-a63c-5bbc-b764-269e297cd699_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT69LRX%252F699073208%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073208/600 saved to cache
2026-03-28 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 01670b58-a63c-5bbc-b764-269e297cd699
2026-03-28 22:05:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542d4fd0>
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c46e0b3-fe77-5881-ab60-346741749047/4c46e0b3-fe77-5881-ab60-346741749047_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLY69GMG%252F699011442%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011442/600 saved to cache
2026-03-28 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c46e0b3-fe77-5881-ab60-346741749047
2026-03-28 22:05:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473e8b10>
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c46e0b3-fe77-5881-ab60-346741749047/4c46e0b3-fe77-5881-ab60-346741749047_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLY69GMG%252F699011476%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011476/600 saved to cache
2026-03-28 22:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c46e0b3-fe77-5881-ab60-346741749047
2026-03-28 22:05:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547755a90>
2026-03-28 22:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01670b58-a63c-5bbc-b764-269e297cd699/01670b58-a63c-5bbc-b764-269e297cd699_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT69LRX%252F699073222%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073222/600 saved to cache
2026-03-28 22:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 01670b58-a63c-5bbc-b764-269e297cd699
2026-03-28 22:05:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547383b10>
2026-03-28 22:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01670b58-a63c-5bbc-b764-269e297cd699/01670b58-a63c-5bbc-b764-269e297cd699_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT69LRX%252F699073232%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073232/600 saved to cache
2026-03-28 22:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 01670b58-a63c-5bbc-b764-269e297cd699
2026-03-28 22:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011499/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LY69GMG/42810675?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=jeye3MQSCliPIESqh1i5%2FjRkuwpNu0nmf1qtCgdbQf4%3D)
2026-03-28 22:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011528/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LY69GMG/42810675?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=jeye3MQSCliPIESqh1i5%2FjRkuwpNu0nmf1qtCgdbQf4%3D)
2026-03-28 22:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073251/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT69LRX/42811057?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=xSu1S1pUAV%2FKH7UFrNhtZx2jiqToKptH3cOErKy0wVg%3D)
2026-03-28 22:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073268/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT69LRX/42811057?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=xSu1S1pUAV%2FKH7UFrNhtZx2jiqToKptH3cOErKy0wVg%3D)
2026-03-28 22:05:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: af7614dc-d0aa-516f-9e3a-5a12f63942d2 with identifier: VN10%20HZJ
2026-03-28 22:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: af7614dc-d0aa-516f-9e3a-5a12f63942d2 with identifier: VN10%20HZJ
2026-03-28 22:05:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: af7614dc-d0aa-516f-9e3a-5a12f63942d2 with identifier: VN10%20HZJ to the API
2026-03-28 22:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VN10%20HZJ-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'af7614dc-d0aa-516f-9e3a-5a12f63942d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VN10 HZJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VN10%20HZJ&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'KA',
'odometer': 86953,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'FORD KA 1.2 STUDIO Hatchback',
'transmission': 'manual',
'trim': 'STUDIO',
'vin': 'WF0UXXLTRUAS70777',
'year': 2010}
2026-03-28 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN10%2520HZJ%27 HTTP/1.1" 200 None
2026-03-28 22:05:03 [bca.uk] INFO: Saving data for VN10%20HZJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774610896.48492, 'last_price_update_time': 1774735503.906188}
2026-03-28 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VN10%2520HZJ') HTTP/1.1" 204 0
2026-03-28 22:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX68ZHP/699011367/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX68ZHP/42810694?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=si7ibII3zklzEd48I6uQdL1wWUDROLg4nnXu4hDS6%2Bg%3D)
2026-03-28 22:05:03 [bca.uk] INFO: Found listing with ID: RY07%20SLU
2026-03-28 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY07%2520SLU%27 HTTP/1.1" 200 None
2026-03-28 22:05:03 [bca.uk] INFO: Scrape type for RY07%20SLU: 0
2026-03-28 22:05:03 [bca.uk] INFO: Found listing with ID: YX59%20SFY
2026-03-28 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX59%2520SFY%27 HTTP/1.1" 200 None
2026-03-28 22:05:03 [bca.uk] INFO: Scrape type for YX59%20SFY: 0
2026-03-28 22:05:03 [bca.uk] INFO: Found listing with ID: BG66%20TXM
2026-03-28 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG66%2520TXM%27 HTTP/1.1" 200 None
2026-03-28 22:05:03 [bca.uk] INFO: Scrape type for BG66%20TXM: 1
2026-03-28 22:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48ea9338-f3dd-5ad7-81bd-c3333cd89421 with identifier: BG66%20TXM
2026-03-28 22:05:04 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 48ea9338-f3dd-5ad7-81bd-c3333cd89421
2026-03-28 22:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX15ZPR/42810594?sv=2020-08-04&st=2026-03-28T22%3A05%3A03Z&se=2026-03-28T22%3A30%3A03Z&sr=b&sp=r&sig=4Xkg21iEljq20iTBfMl%2BtSswF985h8gnTDKxLA91BF8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PX15%20ZPR-GB>
2026-03-28 22:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD17FAM/42810230?sv=2020-08-04&st=2026-03-28T22%3A05%3A03Z&se=2026-03-28T22%3A30%3A03Z&sr=b&sp=r&sig=%2FfBqToERqV4%2B1yskCr4WrQIIYBY5obdbLLah9TxlYo4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FD17%20FAM-GB>
2026-03-28 22:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP19AEE/699073264/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GP19AEE/42811089?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=m2GwNhLE1oLLg2uEAdtJl2qVGUgskjehRSLF0UCk37I%3D)
2026-03-28 22:05:04 [bca.uk] INFO: Found listing with ID: YX16%20OWF
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX16%2520OWF%27 HTTP/1.1" 200 None
2026-03-28 22:05:04 [bca.uk] INFO: Scrape type for YX16%20OWF: 1
2026-03-28 22:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12dd3ce3-5de5-5fe4-88d0-7054e427658d with identifier: YX16%20OWF
2026-03-28 22:05:04 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 12dd3ce3-5de5-5fe4-88d0-7054e427658d
2026-03-28 22:05:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472b1ed0>
2026-03-28 22:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c46e0b3-fe77-5881-ab60-346741749047/4c46e0b3-fe77-5881-ab60-346741749047_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLY69GMG%252F699011499%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011499/600 saved to cache
2026-03-28 22:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c46e0b3-fe77-5881-ab60-346741749047
2026-03-28 22:05:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55480a5d0>
2026-03-28 22:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c46e0b3-fe77-5881-ab60-346741749047/4c46e0b3-fe77-5881-ab60-346741749047_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLY69GMG%252F699011528%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LY69GMG/699011528/600 saved to cache
2026-03-28 22:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c46e0b3-fe77-5881-ab60-346741749047
2026-03-28 22:05:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548cfdd0>
2026-03-28 22:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01670b58-a63c-5bbc-b764-269e297cd699/01670b58-a63c-5bbc-b764-269e297cd699_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT69LRX%252F699073251%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073251/600 saved to cache
2026-03-28 22:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 01670b58-a63c-5bbc-b764-269e297cd699
2026-03-28 22:05:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55480bad0>
2026-03-28 22:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01670b58-a63c-5bbc-b764-269e297cd699/01670b58-a63c-5bbc-b764-269e297cd699_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT69LRX%252F699073268%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073268/600 saved to cache
2026-03-28 22:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 01670b58-a63c-5bbc-b764-269e297cd699
2026-03-28 22:05:04 [bca.uk] INFO: Found listing with ID: WN64%20EZV
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN64%2520EZV%27 HTTP/1.1" 200 None
2026-03-28 22:05:04 [bca.uk] INFO: Scrape type for WN64%20EZV: 2
2026-03-28 22:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6badd71-ce31-5061-9b70-adf3f6f777d4 with identifier: WN64%20EZV
2026-03-28 22:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6badd71-ce31-5061-9b70-adf3f6f777d4 with scrape type 2
2026-03-28 22:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6badd71-ce31-5061-9b70-adf3f6f777d4 with scrape type 2
2026-03-28 22:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c6badd71-ce31-5061-9b70-adf3f6f777d4, identifier: WN64%20EZV
2026-03-28 22:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX68ZHP/699011350/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011350>
2026-03-28 22:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP19AEE/699073246/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073246>
2026-03-28 22:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD18RFJ/42810641?sv=2020-08-04&st=2026-03-28T22%3A05%3A04Z&se=2026-03-28T22%3A30%3A04Z&sr=b&sp=r&sig=OeX5io3h9yL0VeL9tAHDCwF2HomNIHfIARYDa4NdS30%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BD18%20RFJ-GB>
2026-03-28 22:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c6badd71-ce31-5061-9b70-adf3f6f777d4 with identifier: WN64%20EZV
2026-03-28 22:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c6badd71-ce31-5061-9b70-adf3f6f777d4 with identifier: WN64%20EZV
2026-03-28 22:05:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c6badd71-ce31-5061-9b70-adf3f6f777d4 with identifier: WN64%20EZV to the API
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WN64%20EZV-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c6badd71-ce31-5061-9b70-adf3f6f777d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WN64 EZV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WN64%20EZV&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'MAZDA',
'model': '6',
'odometer': 112158,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'MAZDA 6 2.2 D 150 SPORT Saloon',
'transmission': 'manual',
'trim': 'D 150 SPORT',
'vin': 'JMZGJ621651180856',
'year': 2014}
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN64%2520EZV%27 HTTP/1.1" 200 None
2026-03-28 22:05:04 [bca.uk] INFO: Saving data for WN64%20EZV: {'auction_closing_time': 1774778400.0, 'created_time': 1774622317.122775, 'last_price_update_time': 1774735504.661593}
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WN64%2520EZV') HTTP/1.1" 204 0
2026-03-28 22:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND05TWY/42810553?sv=2020-08-04&st=2026-03-28T22%3A05%3A04Z&se=2026-03-28T22%3A30%3A04Z&sr=b&sp=r&sig=BZ8%2B%2FUFxkJjjZzPfJFab4MBTncPmbBPd%2BnKXlbO2wps%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND05%20TWY-GB>
2026-03-28 22:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994598/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994598>
2026-03-28 22:05:04 [bca.uk] INFO: Found listing with ID: W12%20SWW
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27W12%2520SWW%27 HTTP/1.1" 200 None
2026-03-28 22:05:04 [bca.uk] INFO: Scrape type for W12%20SWW: 0
2026-03-28 22:05:04 [bca.uk] INFO: Found listing with ID: GK16%20EPE
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK16%2520EPE%27 HTTP/1.1" 200 None
2026-03-28 22:05:04 [bca.uk] INFO: Scrape type for GK16%20EPE: 2
2026-03-28 22:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a777a98-5f86-5600-be30-659e3d17b31a with identifier: GK16%20EPE
2026-03-28 22:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a777a98-5f86-5600-be30-659e3d17b31a with scrape type 2
2026-03-28 22:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a777a98-5f86-5600-be30-659e3d17b31a with scrape type 2
2026-03-28 22:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8a777a98-5f86-5600-be30-659e3d17b31a, identifier: GK16%20EPE
2026-03-28 22:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF67XMD/42810564?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=DCaGeHL1U5FPXugPOzoPJN1lnR3ggJ%2BFYs5kRo3pbmM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8a777a98-5f86-5600-be30-659e3d17b31a with identifier: GK16%20EPE
2026-03-28 22:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8a777a98-5f86-5600-be30-659e3d17b31a with identifier: GK16%20EPE
2026-03-28 22:05:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8a777a98-5f86-5600-be30-659e3d17b31a with identifier: GK16%20EPE to the API
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 39,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GK16%20EPE-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '8a777a98-5f86-5600-be30-659e3d17b31a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GK16 EPE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GK16%20EPE&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 101781,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.4 TSI GTE DSG Hatchback',
'transmission': 'automatic',
'trim': 'TSI GTE DSG',
'vin': 'WVWZZZAUZGW812895',
'year': 2016}
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK16%2520EPE%27 HTTP/1.1" 200 None
2026-03-28 22:05:05 [bca.uk] INFO: Saving data for GK16%20EPE: {'auction_closing_time': 1774864800.0, 'created_time': 1774130592.217045, 'last_price_update_time': 1774735505.352112}
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GK16%2520EPE') HTTP/1.1" 204 0
2026-03-28 22:05:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX68ZHP/699011335/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011335>
2026-03-28 22:05:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994570/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994570>
2026-03-28 22:05:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP19AEE/699073231/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073231>
2026-03-28 22:05:05 [bca.uk] INFO: Found listing with ID: SL64%20BNE
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL64%2520BNE%27 HTTP/1.1" 200 None
2026-03-28 22:05:05 [bca.uk] INFO: Scrape type for SL64%20BNE: 0
2026-03-28 22:05:05 [bca.uk] INFO: Found listing with ID: ET12%20EPJ
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET12%2520EPJ%27 HTTP/1.1" 200 None
2026-03-28 22:05:05 [bca.uk] INFO: Scrape type for ET12%20EPJ: 0
2026-03-28 22:05:05 [bca.uk] INFO: Found listing with ID: KT07%20CZW
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT07%2520CZW%27 HTTP/1.1" 200 None
2026-03-28 22:05:05 [bca.uk] INFO: Scrape type for KT07%20CZW: 0
2026-03-28 22:05:05 [bca.uk] INFO: Found listing with ID: LX66%20KVO
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX66%2520KVO%27 HTTP/1.1" 200 None
2026-03-28 22:05:05 [bca.uk] INFO: Scrape type for LX66%20KVO: 0
2026-03-28 22:05:05 [bca.uk] INFO: Found listing with ID: GU05%20LVY
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU05%2520LVY%27 HTTP/1.1" 200 None
2026-03-28 22:05:05 [bca.uk] INFO: Scrape type for GU05%20LVY: 2
2026-03-28 22:05:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05f5389c-b833-5c19-8373-cc7c365a1ca4 with identifier: GU05%20LVY
2026-03-28 22:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05f5389c-b833-5c19-8373-cc7c365a1ca4 with scrape type 2
2026-03-28 22:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05f5389c-b833-5c19-8373-cc7c365a1ca4 with scrape type 2
2026-03-28 22:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 05f5389c-b833-5c19-8373-cc7c365a1ca4, identifier: GU05%20LVY
2026-03-28 22:05:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54739f190>
2026-03-28 22:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_423a16e7-0aa7-505e-9fca-30afcd20041f/423a16e7-0aa7-505e-9fca-30afcd20041f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX68ZHP%252F699011367%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX68ZHP/699011367/600 saved to cache
2026-03-28 22:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 423a16e7-0aa7-505e-9fca-30afcd20041f
2026-03-28 22:05:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55498f790>
2026-03-28 22:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb674af7-fcd3-5648-bd02-bf57f2b6d8c9/cb674af7-fcd3-5648-bd02-bf57f2b6d8c9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGP19AEE%252F699073264%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP19AEE/699073264/600 saved to cache
2026-03-28 22:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb674af7-fcd3-5648-bd02-bf57f2b6d8c9
2026-03-28 22:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB15DHF/42810688?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=z80RjqPqkscTGhJimgx1YcejekegApPhOp4js7HWGmI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ67HWW/42810839?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=bCH4BiUF13obmrAOV4AiGB4NLH07S%2Bo99SNbSt0wxEM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP19AEE/699073223/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073223>
2026-03-28 22:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 05f5389c-b833-5c19-8373-cc7c365a1ca4 with identifier: GU05%20LVY
2026-03-28 22:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 05f5389c-b833-5c19-8373-cc7c365a1ca4 with identifier: GU05%20LVY
2026-03-28 22:05:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 05f5389c-b833-5c19-8373-cc7c365a1ca4 with identifier: GU05%20LVY to the API
2026-03-28 22:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 228,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU05%20LVY-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '05f5389c-b833-5c19-8373-cc7c365a1ca4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU05 LVY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GU05%20LVY&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'PEUGEOT',
'model': '407 SW',
'odometer': 1,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'PEUGEOT 407 SW 2.2 SE LUX PACK Estate',
'transmission': 'manual',
'trim': 'SE LUX PACK',
'vin': 'VF36E3FZF21110907',
'year': 2005}
2026-03-28 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU05%2520LVY%27 HTTP/1.1" 200 None
2026-03-28 22:05:06 [bca.uk] INFO: Saving data for GU05%20LVY: {'auction_closing_time': 1774864800.0, 'created_time': 1774622522.265121, 'last_price_update_time': 1774735506.845147}
2026-03-28 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GU05%2520LVY') HTTP/1.1" 204 0
2026-03-28 22:05:06 [bca.uk] INFO: Found listing with ID: LE04%20AFJ
2026-03-28 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LE04%2520AFJ%27 HTTP/1.1" 200 None
2026-03-28 22:05:06 [bca.uk] INFO: Scrape type for LE04%20AFJ: 0
2026-03-28 22:05:06 [bca.uk] INFO: Found listing with ID: GJ56%20OZO
2026-03-28 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ56%2520OZO%27 HTTP/1.1" 200 None
2026-03-28 22:05:06 [bca.uk] INFO: Scrape type for GJ56%20OZO: 2
2026-03-28 22:05:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 059acf93-d057-5059-8445-f75f7e03be18 with identifier: GJ56%20OZO
2026-03-28 22:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 059acf93-d057-5059-8445-f75f7e03be18 with scrape type 2
2026-03-28 22:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 059acf93-d057-5059-8445-f75f7e03be18 with scrape type 2
2026-03-28 22:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 059acf93-d057-5059-8445-f75f7e03be18, identifier: GJ56%20OZO
2026-03-28 22:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD17FAM/42810230?sv=2020-08-04&st=2026-03-28T22%3A05%3A03Z&se=2026-03-28T22%3A30%3A03Z&sr=b&sp=r&sig=%2FfBqToERqV4%2B1yskCr4WrQIIYBY5obdbLLah9TxlYo4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG66TXM/42810151?sv=2020-08-04&st=2026-03-28T22%3A05%3A05Z&se=2026-03-28T22%3A30%3A05Z&sr=b&sp=r&sig=C1vsp95R4gOA7T0iHNFs%2BZs12NdBkOHyJYbnRQXqRtM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BG66%20TXM-GB>
2026-03-28 22:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 059acf93-d057-5059-8445-f75f7e03be18 with identifier: GJ56%20OZO
2026-03-28 22:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 059acf93-d057-5059-8445-f75f7e03be18 with identifier: GJ56%20OZO
2026-03-28 22:05:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 059acf93-d057-5059-8445-f75f7e03be18 with identifier: GJ56%20OZO to the API
2026-03-28 22:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 157,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ56%20OZO-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '059acf93-d057-5059-8445-f75f7e03be18',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ56 OZO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ56%20OZO&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'MERCEDES-BENZ',
'model': 'B180',
'odometer': 83254,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ B180 2.0 CDI SE Hatchback',
'transmission': 'manual',
'trim': 'CDI SE',
'vin': 'WDD2452072J148312',
'year': 2006}
2026-03-28 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ56%2520OZO%27 HTTP/1.1" 200 None
2026-03-28 22:05:07 [bca.uk] INFO: Saving data for GJ56%20OZO: {'auction_closing_time': 1774864800.0, 'created_time': 1774621407.716843, 'last_price_update_time': 1774735507.341018}
2026-03-28 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ56%2520OZO') HTTP/1.1" 204 0
2026-03-28 22:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54771be50>
2026-03-28 22:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73245291-7014-5e92-9739-b929afc3bb3a/73245291-7014-5e92-9739-b929afc3bb3a_expert_report_file_2bd8a5fb-53c4-4244-b745-e3a29d35ae2f.pdf HTTP/1.1" 201 0
2026-03-28 22:05:07 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 73245291-7014-5e92-9739-b929afc3bb3a
2026-03-28 22:05:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73245291-7014-5e92-9739-b929afc3bb3a, skipping ID generation
2026-03-28 22:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73245291-7014-5e92-9739-b929afc3bb3a
2026-03-28 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGF67XMD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GF67XMD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP19AEE/699073246/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GP19AEE/42811089?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=m2GwNhLE1oLLg2uEAdtJl2qVGUgskjehRSLF0UCk37I%3D)
2026-03-28 22:05:07 [bca.uk] INFO: Found listing with ID: YT64%20TZR
2026-03-28 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT64%2520TZR%27 HTTP/1.1" 200 None
2026-03-28 22:05:07 [bca.uk] INFO: Scrape type for YT64%20TZR: 2
2026-03-28 22:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1269720-b3a5-5548-84d2-56a1fa00737d with identifier: YT64%20TZR
2026-03-28 22:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1269720-b3a5-5548-84d2-56a1fa00737d with scrape type 2
2026-03-28 22:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1269720-b3a5-5548-84d2-56a1fa00737d with scrape type 2
2026-03-28 22:05:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f1269720-b3a5-5548-84d2-56a1fa00737d, identifier: YT64%20TZR
2026-03-28 22:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD18RFJ/42810641?sv=2020-08-04&st=2026-03-28T22%3A05%3A04Z&se=2026-03-28T22%3A30%3A04Z&sr=b&sp=r&sig=OeX5io3h9yL0VeL9tAHDCwF2HomNIHfIARYDa4NdS30%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX15ZPR/42810594?sv=2020-08-04&st=2026-03-28T22%3A05%3A03Z&se=2026-03-28T22%3A30%3A03Z&sr=b&sp=r&sig=4Xkg21iEljq20iTBfMl%2BtSswF985h8gnTDKxLA91BF8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX68ZHP/699011350/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX68ZHP/42810694?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=si7ibII3zklzEd48I6uQdL1wWUDROLg4nnXu4hDS6%2Bg%3D)
2026-03-28 22:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994598/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK20LVZ/42810609?sv=2020-08-04&st=2026-03-28T22%3A04%3A54Z&se=2026-03-28T22%3A29%3A54Z&sr=b&sp=r&sig=1rlMrLgnScXfscprI2w%2F9uGrt4kZZOWiG68r4kKHBnY%3D)
2026-03-28 22:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f1269720-b3a5-5548-84d2-56a1fa00737d with identifier: YT64%20TZR
2026-03-28 22:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f1269720-b3a5-5548-84d2-56a1fa00737d with identifier: YT64%20TZR
2026-03-28 22:05:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f1269720-b3a5-5548-84d2-56a1fa00737d with identifier: YT64%20TZR to the API
2026-03-28 22:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 44,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YT64%20TZR-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'f1269720-b3a5-5548-84d2-56a1fa00737d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YT64 TZR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YT64%20TZR&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'MITSUBISHI',
'model': 'OUTLANDER',
'odometer': 104346,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'MITSUBISHI OUTLANDER 2.0 PHEV GX4HS 4WD StationWagon',
'transmission': 'automatic',
'trim': 'PHEV GX4HS 4WD',
'vin': 'JMAXDGG2WEZC01045',
'year': 2014}
2026-03-28 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT64%2520TZR%27 HTTP/1.1" 200 None
2026-03-28 22:05:08 [bca.uk] INFO: Saving data for YT64%20TZR: {'auction_closing_time': 1774864800.0, 'created_time': 1774437961.552022, 'last_price_update_time': 1774735508.807816}
2026-03-28 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YT64%2520TZR') HTTP/1.1" 204 0
2026-03-28 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699332667%27 HTTP/1.1" 200 None
2026-03-28 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699332667 not downloaded yet
2026-03-28 22:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547343910>
2026-03-28 22:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d/d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d_expert_report_file_f26c2a83-7d0f-49fa-9b60-e9a22cbb159d.pdf HTTP/1.1" 201 0
2026-03-28 22:05:08 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d
2026-03-28 22:05:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d, skipping ID generation
2026-03-28 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d
2026-03-28 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSB15DHF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SB15DHF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547479a90>
2026-03-28 22:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e220b51-e3aa-5dfc-97bc-648f804c494e/2e220b51-e3aa-5dfc-97bc-648f804c494e_expert_report_file_256e9df2-402e-4c83-a370-c1b3092f3baf.pdf HTTP/1.1" 201 0
2026-03-28 22:05:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2e220b51-e3aa-5dfc-97bc-648f804c494e
2026-03-28 22:05:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e220b51-e3aa-5dfc-97bc-648f804c494e, skipping ID generation
2026-03-28 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e220b51-e3aa-5dfc-97bc-648f804c494e
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGJ67HWW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GJ67HWW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:09 [bca.uk] INFO: Found listing with ID: DN13%20WOV
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN13%2520WOV%27 HTTP/1.1" 200 None
2026-03-28 22:05:09 [bca.uk] INFO: Scrape type for DN13%20WOV: 2
2026-03-28 22:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42729d14-217d-56b3-bd10-a260b7bfd9d2 with identifier: DN13%20WOV
2026-03-28 22:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42729d14-217d-56b3-bd10-a260b7bfd9d2 with scrape type 2
2026-03-28 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42729d14-217d-56b3-bd10-a260b7bfd9d2 with scrape type 2
2026-03-28 22:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 42729d14-217d-56b3-bd10-a260b7bfd9d2, identifier: DN13%20WOV
2026-03-28 22:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 22:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994570/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK20LVZ/42810609?sv=2020-08-04&st=2026-03-28T22%3A04%3A54Z&se=2026-03-28T22%3A29%3A54Z&sr=b&sp=r&sig=1rlMrLgnScXfscprI2w%2F9uGrt4kZZOWiG68r4kKHBnY%3D)
2026-03-28 22:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP19AEE/699073231/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GP19AEE/42811089?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=m2GwNhLE1oLLg2uEAdtJl2qVGUgskjehRSLF0UCk37I%3D)
2026-03-28 22:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 42729d14-217d-56b3-bd10-a260b7bfd9d2 with identifier: DN13%20WOV
2026-03-28 22:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 42729d14-217d-56b3-bd10-a260b7bfd9d2 with identifier: DN13%20WOV
2026-03-28 22:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 42729d14-217d-56b3-bd10-a260b7bfd9d2 with identifier: DN13%20WOV to the API
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DN13%20WOV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '42729d14-217d-56b3-bd10-a260b7bfd9d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DN13 WOV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DN13%20WOV&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 112277,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 2.0 CDTI 16V 165 E/F SRI S/S Hatchback',
'transmission': 'manual',
'trim': 'CDTI 16V 165 E/F SRI S/S',
'vin': 'W0LPF6EN4DG099079',
'year': 2013}
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN13%2520WOV%27 HTTP/1.1" 200 None
2026-03-28 22:05:09 [bca.uk] INFO: Saving data for DN13%20WOV: {'auction_closing_time': 1774864800.0, 'created_time': 1774621405.366188, 'last_price_update_time': 1774735509.507021}
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DN13%2520WOV') HTTP/1.1" 204 0
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699332672%27 HTTP/1.1" 200 None
2026-03-28 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699332672 not downloaded yet
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970547%27 HTTP/1.1" 200 None
2026-03-28 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970547 not downloaded yet
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994495%27 HTTP/1.1" 200 None
2026-03-28 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994495 not downloaded yet
2026-03-28 22:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a8e5d0>
2026-03-28 22:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4494bc-d302-5d25-af44-49f73fc6f3e8/3b4494bc-d302-5d25-af44-49f73fc6f3e8_expert_report_file_5615a9c8-70f6-4cb8-8c91-ae7b531995ab.pdf HTTP/1.1" 201 0
2026-03-28 22:05:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3b4494bc-d302-5d25-af44-49f73fc6f3e8
2026-03-28 22:05:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b4494bc-d302-5d25-af44-49f73fc6f3e8, skipping ID generation
2026-03-28 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b4494bc-d302-5d25-af44-49f73fc6f3e8
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFD17FAM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FD17FAM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554965ad0>
2026-03-28 22:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb674af7-fcd3-5648-bd02-bf57f2b6d8c9/cb674af7-fcd3-5648-bd02-bf57f2b6d8c9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGP19AEE%252F699073246%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP19AEE/699073246/600 saved to cache
2026-03-28 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb674af7-fcd3-5648-bd02-bf57f2b6d8c9
2026-03-28 22:05:09 [bca.uk] INFO: Found listing with ID: SL60%20TLY
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL60%2520TLY%27 HTTP/1.1" 200 None
2026-03-28 22:05:09 [bca.uk] INFO: Scrape type for SL60%20TLY: 2
2026-03-28 22:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f872912-6c80-592c-99ea-edc541a9babf with identifier: SL60%20TLY
2026-03-28 22:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f872912-6c80-592c-99ea-edc541a9babf with scrape type 2
2026-03-28 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f872912-6c80-592c-99ea-edc541a9babf with scrape type 2
2026-03-28 22:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2f872912-6c80-592c-99ea-edc541a9babf, identifier: SL60%20TLY
2026-03-28 22:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND05TWY/42810553?sv=2020-08-04&st=2026-03-28T22%3A05%3A04Z&se=2026-03-28T22%3A30%3A04Z&sr=b&sp=r&sig=BZ8%2B%2FUFxkJjjZzPfJFab4MBTncPmbBPd%2BnKXlbO2wps%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX68ZHP/699011324/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011324>
2026-03-28 22:05:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YX16OWF/42810933?sv=2020-08-04&st=2026-03-28T22%3A05%3A09Z&se=2026-03-28T22%3A30%3A09Z&sr=b&sp=r&sig=3EOZGDetp00%2FdUCWDR68oq2Rwg5gxQSyaFaneq5tB70%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YX16%20OWF-GB>
2026-03-28 22:05:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994547/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994547>
2026-03-28 22:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP19AEE/699073223/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GP19AEE/42811089?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=m2GwNhLE1oLLg2uEAdtJl2qVGUgskjehRSLF0UCk37I%3D)
2026-03-28 22:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX68ZHP/699011335/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX68ZHP/42810694?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=si7ibII3zklzEd48I6uQdL1wWUDROLg4nnXu4hDS6%2Bg%3D)
2026-03-28 22:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2f872912-6c80-592c-99ea-edc541a9babf with identifier: SL60%20TLY
2026-03-28 22:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2f872912-6c80-592c-99ea-edc541a9babf with identifier: SL60%20TLY
2026-03-28 22:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2f872912-6c80-592c-99ea-edc541a9babf with identifier: SL60%20TLY to the API
2026-03-28 22:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 127,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SL60%20TLY-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2f872912-6c80-592c-99ea-edc541a9babf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SL60 TLY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SL60%20TLY&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'MINI',
'model': 'ONE',
'odometer': 75844,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'MINI ONE 1.6 Hatchback',
'transmission': 'manual',
'trim': '',
'vin': 'WMWSR32020T025491',
'year': 2010}
2026-03-28 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL60%2520TLY%27 HTTP/1.1" 200 None
2026-03-28 22:05:10 [bca.uk] INFO: Saving data for SL60%20TLY: {'auction_closing_time': 1774864800.0, 'created_time': 1774621403.612124, 'last_price_update_time': 1774735510.842532}
2026-03-28 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SL60%2520TLY') HTTP/1.1" 204 0
2026-03-28 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699332674%27 HTTP/1.1" 200 None
2026-03-28 22:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699332674 not downloaded yet
2026-03-28 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970564%27 HTTP/1.1" 200 None
2026-03-28 22:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970564 not downloaded yet
2026-03-28 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994509%27 HTTP/1.1" 200 None
2026-03-28 22:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994509 not downloaded yet
2026-03-28 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285681%27 HTTP/1.1" 200 None
2026-03-28 22:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285681 not downloaded yet
2026-03-28 22:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472f4410>
2026-03-28 22:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ba24d3-8587-5eee-9f39-5a8e165a6cdc/f0ba24d3-8587-5eee-9f39-5a8e165a6cdc_expert_report_file_09676f4d-62fe-46ca-bc55-d64d550b6fca.pdf HTTP/1.1" 201 0
2026-03-28 22:05:10 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f0ba24d3-8587-5eee-9f39-5a8e165a6cdc
2026-03-28 22:05:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f0ba24d3-8587-5eee-9f39-5a8e165a6cdc, skipping ID generation
2026-03-28 22:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f0ba24d3-8587-5eee-9f39-5a8e165a6cdc
2026-03-28 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBD18RFJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BD18RFJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f99e50>
2026-03-28 22:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_867b722d-9875-5e9c-b6b5-4614e36a0cad/867b722d-9875-5e9c-b6b5-4614e36a0cad_expert_report_file_0f4b99e2-28a5-45e6-a752-b0a5a660cf47.pdf HTTP/1.1" 201 0
2026-03-28 22:05:11 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 867b722d-9875-5e9c-b6b5-4614e36a0cad
2026-03-28 22:05:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 867b722d-9875-5e9c-b6b5-4614e36a0cad, skipping ID generation
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 867b722d-9875-5e9c-b6b5-4614e36a0cad
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPX15ZPR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PX15ZPR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547170c10>
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_423a16e7-0aa7-505e-9fca-30afcd20041f/423a16e7-0aa7-505e-9fca-30afcd20041f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX68ZHP%252F699011350%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX68ZHP/699011350/600 saved to cache
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 423a16e7-0aa7-505e-9fca-30afcd20041f
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554381690>
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672f5a9d-28c4-530d-bba8-ceb046fc83e2/672f5a9d-28c4-530d-bba8-ceb046fc83e2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK20LVZ%252F698994598%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994598/600 saved to cache
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 672f5a9d-28c4-530d-bba8-ceb046fc83e2
2026-03-28 22:05:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX68ZHP/699011309/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011309>
2026-03-28 22:05:11 [scrapy.extensions.logstats] INFO: Crawled 161 pages (at 35 pages/min), scraped 229 items (at 59 items/min)
2026-03-28 22:05:11 [scrapy.extensions.memusage] INFO: Peak memory usage is 191MiB
2026-03-28 22:05:11 [bca.uk] INFO: Found listing with ID: DF13%20OAN
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF13%2520OAN%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [bca.uk] INFO: Scrape type for DF13%20OAN: 0
2026-03-28 22:05:11 [bca.uk] INFO: Found listing with ID: SO05%20MZE
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SO05%2520MZE%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [bca.uk] INFO: Scrape type for SO05%20MZE: 0
2026-03-28 22:05:11 [bca.uk] INFO: Found listing with ID: LS17%20NKK
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS17%2520NKK%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [bca.uk] INFO: Scrape type for LS17%20NKK: 1
2026-03-28 22:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02973e2d-8c75-5ccc-9b7b-41da970665ce with identifier: LS17%20NKK
2026-03-28 22:05:11 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 02973e2d-8c75-5ccc-9b7b-41da970665ce
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699332678%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699332678 not downloaded yet
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970581%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970581 not downloaded yet
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994517%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994517 not downloaded yet
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285692%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285692 not downloaded yet
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698971708%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971708 not downloaded yet
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699330933%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330933 not downloaded yet
2026-03-28 22:05:11 [bca.uk] INFO: Total items found: 100
2026-03-28 22:05:11 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded
2026-03-28 22:05:11 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 22:05:11 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b9590>
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672f5a9d-28c4-530d-bba8-ceb046fc83e2/672f5a9d-28c4-530d-bba8-ceb046fc83e2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK20LVZ%252F698994570%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994570/600 saved to cache
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 672f5a9d-28c4-530d-bba8-ceb046fc83e2
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543a7950>
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb674af7-fcd3-5648-bd02-bf57f2b6d8c9/cb674af7-fcd3-5648-bd02-bf57f2b6d8c9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGP19AEE%252F699073231%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP19AEE/699073231/600 saved to cache
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb674af7-fcd3-5648-bd02-bf57f2b6d8c9
2026-03-28 22:05:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073194/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073194>
2026-03-28 22:05:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994523/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994523>
2026-03-28 22:05:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX68ZHP/699011303/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011303>
2026-03-28 22:05:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP19AEE/699073198/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073198>
2026-03-28 22:05:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ67HWW/698994475/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GJ67HWW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF67XMD/699332665/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GF67XMD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:11 [bca.uk] INFO: Found listing with ID: ET67%20ZTJ
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET67%2520ZTJ%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [bca.uk] INFO: Scrape type for ET67%20ZTJ: 1
2026-03-28 22:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be5863b6-8fde-56af-98bb-9604e79b2c92 with identifier: ET67%20ZTJ
2026-03-28 22:05:11 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item be5863b6-8fde-56af-98bb-9604e79b2c92
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547646e50>
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7d66be-49b7-5d86-a859-5c899ed35afc/8f7d66be-49b7-5d86-a859-5c899ed35afc_expert_report_file_3fb740ea-e925-4813-a782-838a67d1c62c.pdf HTTP/1.1" 201 0
2026-03-28 22:05:11 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8f7d66be-49b7-5d86-a859-5c899ed35afc
2026-03-28 22:05:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f7d66be-49b7-5d86-a859-5c899ed35afc, skipping ID generation
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f7d66be-49b7-5d86-a859-5c899ed35afc
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DND05TWY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ND05TWY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547448c50>
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb674af7-fcd3-5648-bd02-bf57f2b6d8c9/cb674af7-fcd3-5648-bd02-bf57f2b6d8c9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGP19AEE%252F699073223%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP19AEE/699073223/600 saved to cache
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb674af7-fcd3-5648-bd02-bf57f2b6d8c9
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54744bbd0>
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_423a16e7-0aa7-505e-9fca-30afcd20041f/423a16e7-0aa7-505e-9fca-30afcd20041f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX68ZHP%252F699011335%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX68ZHP/699011335/600 saved to cache
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 423a16e7-0aa7-505e-9fca-30afcd20041f
2026-03-28 22:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG66TXM/42810151?sv=2020-08-04&st=2026-03-28T22%3A05%3A05Z&se=2026-03-28T22%3A30%3A05Z&sr=b&sp=r&sig=C1vsp95R4gOA7T0iHNFs%2BZs12NdBkOHyJYbnRQXqRtM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB15DHF/698970533/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SB15DHF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699332681%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699332681 not downloaded yet
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970590%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970590 not downloaded yet
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994531%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994531 not downloaded yet
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285703%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285703 not downloaded yet
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698971729%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971729 not downloaded yet
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699330938%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330938 not downloaded yet
2026-03-28 22:05:11 [bca.uk] INFO: Found listing with ID: KM68%20WZP
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM68%2520WZP%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [bca.uk] INFO: Scrape type for KM68%20WZP: 1
2026-03-28 22:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d54b4bf4-6a42-5bbf-9d35-a64946d22272 with identifier: KM68%20WZP
2026-03-28 22:05:11 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d54b4bf4-6a42-5bbf-9d35-a64946d22272
2026-03-28 22:05:11 [bca.uk] INFO: Found listing with ID: LN09%20WAJ
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN09%2520WAJ%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [bca.uk] INFO: Scrape type for LN09%20WAJ: 1
2026-03-28 22:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6de2403-2697-5487-84b5-a97e5182e1b7 with identifier: LN09%20WAJ
2026-03-28 22:05:11 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f6de2403-2697-5487-84b5-a97e5182e1b7
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699269132%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699269132 not downloaded yet
2026-03-28 22:05:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ67HWW/698994495/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994495>
2026-03-28 22:05:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD17FAM/699285632/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FD17FAM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF67XMD/699332667/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699332667>
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699332686%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699332686 not downloaded yet
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970605%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970605 not downloaded yet
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994546%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994546 not downloaded yet
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285714%27 HTTP/1.1" 200 None
2026-03-28 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285714 not downloaded yet
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698971744%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971744 not downloaded yet
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699330943%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330943 not downloaded yet
2026-03-28 22:05:12 [bca.uk] INFO: Found listing with ID: EF22%20THK
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF22%2520THK%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [bca.uk] INFO: Scrape type for EF22%20THK: 0
2026-03-28 22:05:12 [bca.uk] INFO: Found listing with ID: DU68%20LVG
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU68%2520LVG%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [bca.uk] INFO: Scrape type for DU68%20LVG: 1
2026-03-28 22:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc with identifier: DU68%20LVG
2026-03-28 22:05:12 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc
2026-03-28 22:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994547/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK20LVZ/42810609?sv=2020-08-04&st=2026-03-28T22%3A04%3A54Z&se=2026-03-28T22%3A29%3A54Z&sr=b&sp=r&sig=1rlMrLgnScXfscprI2w%2F9uGrt4kZZOWiG68r4kKHBnY%3D)
2026-03-28 22:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX68ZHP/699011324/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX68ZHP/42810694?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=si7ibII3zklzEd48I6uQdL1wWUDROLg4nnXu4hDS6%2Bg%3D)
2026-03-28 22:05:12 [bca.uk] INFO: Found listing with ID: BG67%20KMM
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG67%2520KMM%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [bca.uk] INFO: Scrape type for BG67%20KMM: 1
2026-03-28 22:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74260dc8-62a0-531b-ba8b-8bfc34fc2e08 with identifier: BG67%20KMM
2026-03-28 22:05:12 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 74260dc8-62a0-531b-ba8b-8bfc34fc2e08
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699269141%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699269141 not downloaded yet
2026-03-28 22:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YX16OWF/42810933?sv=2020-08-04&st=2026-03-28T22%3A05%3A09Z&se=2026-03-28T22%3A30%3A09Z&sr=b&sp=r&sig=3EOZGDetp00%2FdUCWDR68oq2Rwg5gxQSyaFaneq5tB70%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB15DHF/698970547/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970547>
2026-03-28 22:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX68ZHP/699011309/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX68ZHP/42810694?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=si7ibII3zklzEd48I6uQdL1wWUDROLg4nnXu4hDS6%2Bg%3D)
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699332691%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699332691 not downloaded yet
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970627%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970627 not downloaded yet
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994569%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994569 not downloaded yet
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285726%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285726 not downloaded yet
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698971760%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971760 not downloaded yet
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699330945%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330945 not downloaded yet
2026-03-28 22:05:12 [bca.uk] INFO: Found listing with ID: AO65%20VXH
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO65%2520VXH%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [bca.uk] INFO: Scrape type for AO65%20VXH: 1
2026-03-28 22:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ced2c5eb-991e-54e7-b6dd-6b7667db3844 with identifier: AO65%20VXH
2026-03-28 22:05:12 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ced2c5eb-991e-54e7-b6dd-6b7667db3844
2026-03-28 22:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54744b650>
2026-03-28 22:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48ea9338-f3dd-5ad7-81bd-c3333cd89421/48ea9338-f3dd-5ad7-81bd-c3333cd89421_expert_report_file_53d2c5cc-e179-4306-88bb-e8ae308b587b.pdf HTTP/1.1" 201 0
2026-03-28 22:05:12 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 48ea9338-f3dd-5ad7-81bd-c3333cd89421
2026-03-28 22:05:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 48ea9338-f3dd-5ad7-81bd-c3333cd89421, skipping ID generation
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 48ea9338-f3dd-5ad7-81bd-c3333cd89421
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBG66TXM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BG66TXM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:12 [bca.uk] INFO: Found listing with ID: LX14%20XNH
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX14%2520XNH%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [bca.uk] INFO: Scrape type for LX14%20XNH: 1
2026-03-28 22:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d59c8c01-c6be-586f-86c9-6eb3a7686cc2 with identifier: LX14%20XNH
2026-03-28 22:05:12 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d59c8c01-c6be-586f-86c9-6eb3a7686cc2
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699269147%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699269147 not downloaded yet
2026-03-28 22:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP19AEE/699073198/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GP19AEE/42811089?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=m2GwNhLE1oLLg2uEAdtJl2qVGUgskjehRSLF0UCk37I%3D)
2026-03-28 22:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF67XMD/699332665/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF67XMD/42810564?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=DCaGeHL1U5FPXugPOzoPJN1lnR3ggJ%2BFYs5kRo3pbmM%3D)
2026-03-28 22:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ67HWW/698994475/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ67HWW/42810839?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=bCH4BiUF13obmrAOV4AiGB4NLH07S%2Bo99SNbSt0wxEM%3D)
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699332698%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699332698 not downloaded yet
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970643%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970643 not downloaded yet
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994593%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994593 not downloaded yet
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285742%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285742 not downloaded yet
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698971774%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971774 not downloaded yet
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699330948%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330948 not downloaded yet
2026-03-28 22:05:12 [bca.uk] INFO: Found listing with ID: PFZ%208482
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PFZ%25208482%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [bca.uk] INFO: Scrape type for PFZ%208482: 1
2026-03-28 22:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9700af5-622f-5b72-9af3-28e1d8f91693 with identifier: PFZ%208482
2026-03-28 22:05:12 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b9700af5-622f-5b72-9af3-28e1d8f91693
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699333391%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699333391 not downloaded yet
2026-03-28 22:05:12 [bca.uk] INFO: Found listing with ID: LL18%20NDU
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL18%2520NDU%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [bca.uk] INFO: Scrape type for LL18%20NDU: 1
2026-03-28 22:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e575391d-6903-5001-a072-5ddc281ffe3b with identifier: LL18%20NDU
2026-03-28 22:05:12 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e575391d-6903-5001-a072-5ddc281ffe3b
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699269154%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699269154 not downloaded yet
2026-03-28 22:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB15DHF/698970533/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB15DHF/42810688?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=z80RjqPqkscTGhJimgx1YcejekegApPhOp4js7HWGmI%3D)
2026-03-28 22:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073194/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT69LRX/42811057?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=xSu1S1pUAV%2FKH7UFrNhtZx2jiqToKptH3cOErKy0wVg%3D)
2026-03-28 22:05:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269119/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ND05TWY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX68ZHP/699011303/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX68ZHP/42810694?sv=2020-08-04&st=2026-03-28T22%3A04%3A55Z&se=2026-03-28T22%3A29%3A55Z&sr=b&sp=r&sig=si7ibII3zklzEd48I6uQdL1wWUDROLg4nnXu4hDS6%2Bg%3D)
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699332708%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699332708 not downloaded yet
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970664%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970664 not downloaded yet
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994619%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994619 not downloaded yet
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285771%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285771 not downloaded yet
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698971789%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971789 not downloaded yet
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699330951%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330951 not downloaded yet
2026-03-28 22:05:12 [bca.uk] INFO: Found listing with ID: SB11%20OWR
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB11%2520OWR%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [bca.uk] INFO: Scrape type for SB11%20OWR: 1
2026-03-28 22:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ff2a82d-f7ab-592a-a781-86aaae91d694 with identifier: SB11%20OWR
2026-03-28 22:05:12 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6ff2a82d-f7ab-592a-a781-86aaae91d694
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699333393%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699333393 not downloaded yet
2026-03-28 22:05:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554318a10>
2026-03-28 22:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672f5a9d-28c4-530d-bba8-ceb046fc83e2/672f5a9d-28c4-530d-bba8-ceb046fc83e2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK20LVZ%252F698994547%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994547/600 saved to cache
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 672f5a9d-28c4-530d-bba8-ceb046fc83e2
2026-03-28 22:05:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a22c50>
2026-03-28 22:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_423a16e7-0aa7-505e-9fca-30afcd20041f/423a16e7-0aa7-505e-9fca-30afcd20041f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX68ZHP%252F699011324%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX68ZHP/699011324/600 saved to cache
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 423a16e7-0aa7-505e-9fca-30afcd20041f
2026-03-28 22:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a53cd0>
2026-03-28 22:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12dd3ce3-5de5-5fe4-88d0-7054e427658d/12dd3ce3-5de5-5fe4-88d0-7054e427658d_expert_report_file_11563098-af30-4ba6-ad32-451d802b82c9.pdf HTTP/1.1" 201 0
2026-03-28 22:05:12 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 12dd3ce3-5de5-5fe4-88d0-7054e427658d
2026-03-28 22:05:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12dd3ce3-5de5-5fe4-88d0-7054e427658d, skipping ID generation
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 12dd3ce3-5de5-5fe4-88d0-7054e427658d
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYX16OWF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YX16OWF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a51690>
2026-03-28 22:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_423a16e7-0aa7-505e-9fca-30afcd20041f/423a16e7-0aa7-505e-9fca-30afcd20041f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX68ZHP%252F699011309%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX68ZHP/699011309/600 saved to cache
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 423a16e7-0aa7-505e-9fca-30afcd20041f
2026-03-28 22:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994523/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK20LVZ/42810609?sv=2020-08-04&st=2026-03-28T22%3A04%3A54Z&se=2026-03-28T22%3A29%3A54Z&sr=b&sp=r&sig=1rlMrLgnScXfscprI2w%2F9uGrt4kZZOWiG68r4kKHBnY%3D)
2026-03-28 22:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ67HWW/698994495/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ67HWW/42810839?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=bCH4BiUF13obmrAOV4AiGB4NLH07S%2Bo99SNbSt0wxEM%3D)
2026-03-28 22:05:12 [bca.uk] INFO: Found listing with ID: KS67%20XUM
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS67%2520XUM%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [bca.uk] INFO: Scrape type for KS67%20XUM: 1
2026-03-28 22:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae3858f1-1a30-58b6-b115-1b6051bc84a2 with identifier: KS67%20XUM
2026-03-28 22:05:12 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ae3858f1-1a30-58b6-b115-1b6051bc84a2
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699269162%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699269162 not downloaded yet
2026-03-28 22:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD17FAM/699285632/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD17FAM/42810230?sv=2020-08-04&st=2026-03-28T22%3A05%3A03Z&se=2026-03-28T22%3A30%3A03Z&sr=b&sp=r&sig=%2FfBqToERqV4%2B1yskCr4WrQIIYBY5obdbLLah9TxlYo4%3D)
2026-03-28 22:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF67XMD/699332667/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF67XMD/42810564?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=DCaGeHL1U5FPXugPOzoPJN1lnR3ggJ%2BFYs5kRo3pbmM%3D)
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970677%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970677 not downloaded yet
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994737%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994737 not downloaded yet
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285792%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285792 not downloaded yet
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698971810%27 HTTP/1.1" 200 None
2026-03-28 22:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971810 not downloaded yet
2026-03-28 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699330958%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330958 not downloaded yet
2026-03-28 22:05:13 [bca.uk] INFO: Found listing with ID: YD14%20AUA
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD14%2520AUA%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [bca.uk] INFO: Scrape type for YD14%20AUA: 1
2026-03-28 22:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44030eb3-dbb1-5194-a010-c4fe60817cb4 with identifier: YD14%20AUA
2026-03-28 22:05:13 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 44030eb3-dbb1-5194-a010-c4fe60817cb4
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699333396%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699333396 not downloaded yet
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024876%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024876 not downloaded yet
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a2a810>
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb674af7-fcd3-5648-bd02-bf57f2b6d8c9/cb674af7-fcd3-5648-bd02-bf57f2b6d8c9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGP19AEE%252F699073198%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP19AEE/699073198/600 saved to cache
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb674af7-fcd3-5648-bd02-bf57f2b6d8c9
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547762690>
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73245291-7014-5e92-9739-b929afc3bb3a/73245291-7014-5e92-9739-b929afc3bb3a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF67XMD%252F699332665%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF67XMD/699332665/600 saved to cache
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73245291-7014-5e92-9739-b929afc3bb3a
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5476edd50>
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e220b51-e3aa-5dfc-97bc-648f804c494e/2e220b51-e3aa-5dfc-97bc-648f804c494e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ67HWW%252F698994475%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ67HWW/698994475/600 saved to cache
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e220b51-e3aa-5dfc-97bc-648f804c494e
2026-03-28 22:05:13 [bca.uk] INFO: Found listing with ID: LF18%20AUM
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF18%2520AUM%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [bca.uk] INFO: Scrape type for LF18%20AUM: 1
2026-03-28 22:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4585172c-c0e4-57f4-9c9a-ae29c1c09e8a with identifier: LF18%20AUM
2026-03-28 22:05:13 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4585172c-c0e4-57f4-9c9a-ae29c1c09e8a
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699269173%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699269173 not downloaded yet
2026-03-28 22:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB15DHF/698970547/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB15DHF/42810688?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=z80RjqPqkscTGhJimgx1YcejekegApPhOp4js7HWGmI%3D)
2026-03-28 22:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX15ZPR/699330943/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330943>
2026-03-28 22:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD18RFJ/698971744/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971744>
2026-03-28 22:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU68LVG/42800882?sv=2020-08-04&st=2026-03-28T22%3A05%3A12Z&se=2026-03-28T22%3A30%3A12Z&sr=b&sp=r&sig=NJDddzay8QfXZCkDpDoajXCukxQxXVptkxb3qmj1KmE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DU68%20LVG-GB>
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285808%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285808 not downloaded yet
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698971835%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971835 not downloaded yet
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699330962%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330962 not downloaded yet
2026-03-28 22:05:13 [bca.uk] INFO: Found listing with ID: YJ63%20VCM
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ63%2520VCM%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [bca.uk] INFO: Scrape type for YJ63%20VCM: 1
2026-03-28 22:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c202ec85-ff2c-5425-bb13-378c8faf73ed with identifier: YJ63%20VCM
2026-03-28 22:05:13 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c202ec85-ff2c-5425-bb13-378c8faf73ed
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699333398%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699333398 not downloaded yet
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024879%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024879 not downloaded yet
2026-03-28 22:05:13 [bca.uk] INFO: Found listing with ID: HK67%20LGN
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK67%2520LGN%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [bca.uk] INFO: Scrape type for HK67%20LGN: 1
2026-03-28 22:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4177a308-7aae-587d-bd3e-07268dbbb6a0 with identifier: HK67%20LGN
2026-03-28 22:05:13 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4177a308-7aae-587d-bd3e-07268dbbb6a0
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699269192%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699269192 not downloaded yet
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549d1a90>
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d/d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB15DHF%252F698970533%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB15DHF/698970533/600 saved to cache
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554ab1dd0>
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01670b58-a63c-5bbc-b764-269e297cd699/01670b58-a63c-5bbc-b764-269e297cd699_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT69LRX%252F699073194%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT69LRX/699073194/600 saved to cache
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 01670b58-a63c-5bbc-b764-269e297cd699
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554aacf90>
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_423a16e7-0aa7-505e-9fca-30afcd20041f/423a16e7-0aa7-505e-9fca-30afcd20041f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX68ZHP%252F699011303%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX68ZHP/699011303/600 saved to cache
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 423a16e7-0aa7-505e-9fca-30afcd20041f
2026-03-28 22:05:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554aa5250>
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672f5a9d-28c4-530d-bba8-ceb046fc83e2/672f5a9d-28c4-530d-bba8-ceb046fc83e2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK20LVZ%252F698994523%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK20LVZ/698994523/600 saved to cache
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 672f5a9d-28c4-530d-bba8-ceb046fc83e2
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544b42d0>
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e220b51-e3aa-5dfc-97bc-648f804c494e/2e220b51-e3aa-5dfc-97bc-648f804c494e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ67HWW%252F698994495%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ67HWW/698994495/600 saved to cache
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2e220b51-e3aa-5dfc-97bc-648f804c494e
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554aacf50>
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4494bc-d302-5d25-af44-49f73fc6f3e8/3b4494bc-d302-5d25-af44-49f73fc6f3e8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD17FAM%252F699285632%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD17FAM/699285632/600 saved to cache
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b4494bc-d302-5d25-af44-49f73fc6f3e8
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544b4350>
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73245291-7014-5e92-9739-b929afc3bb3a/73245291-7014-5e92-9739-b929afc3bb3a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF67XMD%252F699332667%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF67XMD/699332667/600 saved to cache
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73245291-7014-5e92-9739-b929afc3bb3a
2026-03-28 22:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD17FAM/699285714/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285714>
2026-03-28 22:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX15ZPR/699330945/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330945>
2026-03-28 22:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333386/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BG66TXM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO65VXH/42775624?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=slIW%2B3iwvDchqJURAJRdLEGkYLYSjXVM0OamBF34cz0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AO65%20VXH-GB>
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698971848%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971848 not downloaded yet
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699330969%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330969 not downloaded yet
2026-03-28 22:05:13 [bca.uk] INFO: Found listing with ID: CK70%20OSX
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK70%2520OSX%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [bca.uk] INFO: Scrape type for CK70%20OSX: 0
2026-03-28 22:05:13 [bca.uk] INFO: Found listing with ID: FE55%20ACX
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE55%2520ACX%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [bca.uk] INFO: Scrape type for FE55%20ACX: 1
2026-03-28 22:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfa39713-14e5-5c88-b2a8-4efb5721d2c2 with identifier: FE55%20ACX
2026-03-28 22:05:13 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item bfa39713-14e5-5c88-b2a8-4efb5721d2c2
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699333402%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699333402 not downloaded yet
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024882%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024882 not downloaded yet
2026-03-28 22:05:13 [bca.uk] INFO: Found listing with ID: CA06%20YTM
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA06%2520YTM%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [bca.uk] INFO: Scrape type for CA06%20YTM: 1
2026-03-28 22:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b735ecb-b987-5f51-9978-b14a854ed6a5 with identifier: CA06%20YTM
2026-03-28 22:05:13 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6b735ecb-b987-5f51-9978-b14a854ed6a5
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699269219%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699269219 not downloaded yet
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554400490>
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d/d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB15DHF%252F698970547%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB15DHF/698970547/600 saved to cache
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d
2026-03-28 22:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269119/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND05TWY/42810553?sv=2020-08-04&st=2026-03-28T22%3A05%3A04Z&se=2026-03-28T22%3A30%3A04Z&sr=b&sp=r&sig=BZ8%2B%2FUFxkJjjZzPfJFab4MBTncPmbBPd%2BnKXlbO2wps%3D)
2026-03-28 22:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX15ZPR/699330948/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330948>
2026-03-28 22:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333391/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699333391>
2026-03-28 22:05:13 [bca.uk] INFO: Found listing with ID: RF22%20LPJ
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF22%2520LPJ%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [bca.uk] INFO: Scrape type for RF22%20LPJ: 0
2026-03-28 22:05:13 [bca.uk] INFO: Found listing with ID: MW21%20AXB
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW21%2520AXB%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [bca.uk] INFO: Scrape type for MW21%20AXB: 1
2026-03-28 22:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec532b91-2d62-5ebd-830b-087067e8ed90 with identifier: MW21%20AXB
2026-03-28 22:05:13 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ec532b91-2d62-5ebd-830b-087067e8ed90
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699333407%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699333407 not downloaded yet
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024887%27 HTTP/1.1" 200 None
2026-03-28 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024887 not downloaded yet
2026-03-28 22:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PFZ8482/42809655?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=TH37lPUKNzlJ9cPYi1xKA9ls4RZTQzngvd4d8Rd6Xgc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PFZ%208482-GB>
2026-03-28 22:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX15ZPR/699330951/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330951>
2026-03-28 22:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333393/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699333393>
2026-03-28 22:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB11OWR/42809523?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=%2BXPbFoBXFln5oK0NHPy9dGoxYCx5FDGBaSdCO93wM50%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SB11%20OWR-GB>
2026-03-28 22:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024871/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YX16OWF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:13 [bca.uk] INFO: Found listing with ID: RE14%20ZSJ
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE14%2520ZSJ%27 HTTP/1.1" 200 None
2026-03-28 22:05:14 [bca.uk] INFO: Scrape type for RE14%20ZSJ: 2
2026-03-28 22:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d7fbb4f-e807-5edd-b967-66c41e581d8c with identifier: RE14%20ZSJ
2026-03-28 22:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d7fbb4f-e807-5edd-b967-66c41e581d8c with scrape type 2
2026-03-28 22:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d7fbb4f-e807-5edd-b967-66c41e581d8c with scrape type 2
2026-03-28 22:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9d7fbb4f-e807-5edd-b967-66c41e581d8c, identifier: RE14%20ZSJ
2026-03-28 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699269246%27 HTTP/1.1" 200 None
2026-03-28 22:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699269246 not downloaded yet
2026-03-28 22:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9d7fbb4f-e807-5edd-b967-66c41e581d8c with identifier: RE14%20ZSJ
2026-03-28 22:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9d7fbb4f-e807-5edd-b967-66c41e581d8c with identifier: RE14%20ZSJ
2026-03-28 22:05:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9d7fbb4f-e807-5edd-b967-66c41e581d8c with identifier: RE14%20ZSJ to the API
2026-03-28 22:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RE14%20ZSJ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9d7fbb4f-e807-5edd-b967-66c41e581d8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RE14 ZSJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RE14%20ZSJ&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 56761,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.2 82 ZETEC Hatchback',
'transmission': 'manual',
'trim': '82 ZETEC',
'vin': 'WF0DXXGAKDEU10324',
'year': 2014}
2026-03-28 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE14%2520ZSJ%27 HTTP/1.1" 200 None
2026-03-28 22:05:14 [bca.uk] INFO: Saving data for RE14%20ZSJ: {'auction_closing_time': 1774778400.0, 'created_time': 1774621629.478667, 'last_price_update_time': 1774735514.840895}
2026-03-28 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RE14%2520ZSJ') HTTP/1.1" 204 0
2026-03-28 22:05:14 [bca.uk] INFO: Found listing with ID: VK65%20LPO
2026-03-28 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK65%2520LPO%27 HTTP/1.1" 200 None
2026-03-28 22:05:14 [bca.uk] INFO: Scrape type for VK65%20LPO: 1
2026-03-28 22:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a373065-9147-5214-8a56-d55636e4875e with identifier: VK65%20LPO
2026-03-28 22:05:14 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7a373065-9147-5214-8a56-d55636e4875e
2026-03-28 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699333412%27 HTTP/1.1" 200 None
2026-03-28 22:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699333412 not downloaded yet
2026-03-28 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024888%27 HTTP/1.1" 200 None
2026-03-28 22:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024888 not downloaded yet
2026-03-28 22:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX15ZPR/699330943/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX15ZPR/42810594?sv=2020-08-04&st=2026-03-28T22%3A05%3A03Z&se=2026-03-28T22%3A30%3A03Z&sr=b&sp=r&sig=4Xkg21iEljq20iTBfMl%2BtSswF985h8gnTDKxLA91BF8%3D)
2026-03-28 22:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD18RFJ/698971744/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD18RFJ/42810641?sv=2020-08-04&st=2026-03-28T22%3A05%3A04Z&se=2026-03-28T22%3A30%3A04Z&sr=b&sp=r&sig=OeX5io3h9yL0VeL9tAHDCwF2HomNIHfIARYDa4NdS30%3D)
2026-03-28 22:05:15 [bca.uk] INFO: Found listing with ID: VE65%20FMD
2026-03-28 22:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE65%2520FMD%27 HTTP/1.1" 200 None
2026-03-28 22:05:15 [bca.uk] INFO: Scrape type for VE65%20FMD: 2
2026-03-28 22:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bbc5b77-c2ff-5a3a-8705-3ae0453a147d with identifier: VE65%20FMD
2026-03-28 22:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bbc5b77-c2ff-5a3a-8705-3ae0453a147d with scrape type 2
2026-03-28 22:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bbc5b77-c2ff-5a3a-8705-3ae0453a147d with scrape type 2
2026-03-28 22:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2bbc5b77-c2ff-5a3a-8705-3ae0453a147d, identifier: VE65%20FMD
2026-03-28 22:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX15ZPR/699330945/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX15ZPR/42810594?sv=2020-08-04&st=2026-03-28T22%3A05%3A03Z&se=2026-03-28T22%3A30%3A03Z&sr=b&sp=r&sig=4Xkg21iEljq20iTBfMl%2BtSswF985h8gnTDKxLA91BF8%3D)
2026-03-28 22:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD17FAM/699285714/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD17FAM/42810230?sv=2020-08-04&st=2026-03-28T22%3A05%3A03Z&se=2026-03-28T22%3A30%3A03Z&sr=b&sp=r&sig=%2FfBqToERqV4%2B1yskCr4WrQIIYBY5obdbLLah9TxlYo4%3D)
2026-03-28 22:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333386/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG66TXM/42810151?sv=2020-08-04&st=2026-03-28T22%3A05%3A05Z&se=2026-03-28T22%3A30%3A05Z&sr=b&sp=r&sig=C1vsp95R4gOA7T0iHNFs%2BZs12NdBkOHyJYbnRQXqRtM%3D)
2026-03-28 22:05:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269173/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699269173>
2026-03-28 22:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2bbc5b77-c2ff-5a3a-8705-3ae0453a147d with identifier: VE65%20FMD
2026-03-28 22:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2bbc5b77-c2ff-5a3a-8705-3ae0453a147d with identifier: VE65%20FMD
2026-03-28 22:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2bbc5b77-c2ff-5a3a-8705-3ae0453a147d with identifier: VE65%20FMD to the API
2026-03-28 22:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VE65%20FMD-GB',
'category': 'Car',
'color': 'yellow',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2bbc5b77-c2ff-5a3a-8705-3ae0453a147d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VE65 FMD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VE65%20FMD&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 89634,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.2 DIG-T 113 N-CONNECTA Hatchback',
'transmission': 'manual',
'trim': 'DIG-T 113 N-CONNECTA',
'vin': 'SJNFEAF15U7173137',
'year': 2015}
2026-03-28 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE65%2520FMD%27 HTTP/1.1" 200 None
2026-03-28 22:05:16 [bca.uk] INFO: Saving data for VE65%20FMD: {'auction_closing_time': 1774778400.0, 'created_time': 1774621621.691147, 'last_price_update_time': 1774735516.289807}
2026-03-28 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VE65%2520FMD') HTTP/1.1" 204 0
2026-03-28 22:05:16 [bca.uk] INFO: Found listing with ID: YH22%20TPO
2026-03-28 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH22%2520TPO%27 HTTP/1.1" 200 None
2026-03-28 22:05:16 [bca.uk] INFO: Scrape type for YH22%20TPO: 0
2026-03-28 22:05:16 [bca.uk] INFO: Found listing with ID: WJ68%20YNB
2026-03-28 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ68%2520YNB%27 HTTP/1.1" 200 None
2026-03-28 22:05:16 [bca.uk] INFO: Scrape type for WJ68%20YNB: 2
2026-03-28 22:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d4b83d0-dda6-586e-86d4-d76ca4177117 with identifier: WJ68%20YNB
2026-03-28 22:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d4b83d0-dda6-586e-86d4-d76ca4177117 with scrape type 2
2026-03-28 22:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d4b83d0-dda6-586e-86d4-d76ca4177117 with scrape type 2
2026-03-28 22:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0d4b83d0-dda6-586e-86d4-d76ca4177117, identifier: WJ68%20YNB
2026-03-28 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699333420%27 HTTP/1.1" 200 None
2026-03-28 22:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699333420 not downloaded yet
2026-03-28 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024891%27 HTTP/1.1" 200 None
2026-03-28 22:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024891 not downloaded yet
2026-03-28 22:05:16 [bca.uk] INFO: Found listing with ID: CU17%20XCT
2026-03-28 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU17%2520XCT%27 HTTP/1.1" 200 None
2026-03-28 22:05:16 [bca.uk] INFO: Scrape type for CU17%20XCT: 2
2026-03-28 22:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90cb73d3-f4e0-5b6d-b6f5-aa59d68ee7d2 with identifier: CU17%20XCT
2026-03-28 22:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90cb73d3-f4e0-5b6d-b6f5-aa59d68ee7d2 with scrape type 2
2026-03-28 22:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90cb73d3-f4e0-5b6d-b6f5-aa59d68ee7d2 with scrape type 2
2026-03-28 22:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 90cb73d3-f4e0-5b6d-b6f5-aa59d68ee7d2, identifier: CU17%20XCT
2026-03-28 22:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0d4b83d0-dda6-586e-86d4-d76ca4177117 with identifier: WJ68%20YNB
2026-03-28 22:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0d4b83d0-dda6-586e-86d4-d76ca4177117 with identifier: WJ68%20YNB
2026-03-28 22:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0d4b83d0-dda6-586e-86d4-d76ca4177117 with identifier: WJ68%20YNB to the API
2026-03-28 22:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 152,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ68%20YNB-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0d4b83d0-dda6-586e-86d4-d76ca4177117',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ68 YNB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ68%20YNB&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 54542,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.6 112 TEKNA Hatchback',
'transmission': 'automatic',
'trim': '112 TEKNA',
'vin': 'SJNFBAF15U8033478',
'year': 2018}
2026-03-28 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ68%2520YNB%27 HTTP/1.1" 200 None
2026-03-28 22:05:17 [bca.uk] INFO: Saving data for WJ68%20YNB: {'auction_closing_time': 1774778400.0, 'created_time': 1774610858.566656, 'last_price_update_time': 1774735517.010558}
2026-03-28 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ68%2520YNB') HTTP/1.1" 204 0
2026-03-28 22:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473104d0>
2026-03-28 22:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7d66be-49b7-5d86-a859-5c899ed35afc/8f7d66be-49b7-5d86-a859-5c899ed35afc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND05TWY%252F699269119%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269119/600 saved to cache
2026-03-28 22:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f7d66be-49b7-5d86-a859-5c899ed35afc
2026-03-28 22:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU68LVG/42800882?sv=2020-08-04&st=2026-03-28T22%3A05%3A12Z&se=2026-03-28T22%3A30%3A12Z&sr=b&sp=r&sig=NJDddzay8QfXZCkDpDoajXCukxQxXVptkxb3qmj1KmE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO65VXH/42775624?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=slIW%2B3iwvDchqJURAJRdLEGkYLYSjXVM0OamBF34cz0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX15ZPR/699330948/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX15ZPR/42810594?sv=2020-08-04&st=2026-03-28T22%3A05%3A03Z&se=2026-03-28T22%3A30%3A03Z&sr=b&sp=r&sig=4Xkg21iEljq20iTBfMl%2BtSswF985h8gnTDKxLA91BF8%3D)
2026-03-28 22:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333391/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG66TXM/42810151?sv=2020-08-04&st=2026-03-28T22%3A05%3A05Z&se=2026-03-28T22%3A30%3A05Z&sr=b&sp=r&sig=C1vsp95R4gOA7T0iHNFs%2BZs12NdBkOHyJYbnRQXqRtM%3D)
2026-03-28 22:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 90cb73d3-f4e0-5b6d-b6f5-aa59d68ee7d2 with identifier: CU17%20XCT
2026-03-28 22:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 90cb73d3-f4e0-5b6d-b6f5-aa59d68ee7d2 with identifier: CU17%20XCT
2026-03-28 22:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 90cb73d3-f4e0-5b6d-b6f5-aa59d68ee7d2 with identifier: CU17%20XCT to the API
2026-03-28 22:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CU17%20XCT-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '90cb73d3-f4e0-5b6d-b6f5-aa59d68ee7d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CU17 XCT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CU17%20XCT&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 68943,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.3 VVT-I DESIGN Hatchback',
'transmission': 'manual',
'trim': 'VVT-I DESIGN',
'vin': 'VNKKJ3D370A399910',
'year': 2017}
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU17%2520XCT%27 HTTP/1.1" 200 None
2026-03-28 22:05:18 [bca.uk] INFO: Saving data for CU17%20XCT: {'auction_closing_time': 1774778400.0, 'created_time': 1774621631.230789, 'last_price_update_time': 1774735518.305786}
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CU17%2520XCT') HTTP/1.1" 204 0
2026-03-28 22:05:18 [bca.uk] INFO: Found listing with ID: WR74%20UNV
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR74%2520UNV%27 HTTP/1.1" 200 None
2026-03-28 22:05:18 [bca.uk] INFO: Scrape type for WR74%20UNV: 0
2026-03-28 22:05:18 [bca.uk] INFO: Found listing with ID: LR09%20VJO
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR09%2520VJO%27 HTTP/1.1" 200 None
2026-03-28 22:05:18 [bca.uk] INFO: Scrape type for LR09%20VJO: 1
2026-03-28 22:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb9c86d4-3652-5684-9f6c-db4bea055518 with identifier: LR09%20VJO
2026-03-28 22:05:18 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cb9c86d4-3652-5684-9f6c-db4bea055518
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699333428%27 HTTP/1.1" 200 None
2026-03-28 22:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699333428 not downloaded yet
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024894%27 HTTP/1.1" 200 None
2026-03-28 22:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024894 not downloaded yet
2026-03-28 22:05:18 [bca.uk] INFO: Found listing with ID: FN66%20XKP
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN66%2520XKP%27 HTTP/1.1" 200 None
2026-03-28 22:05:18 [bca.uk] INFO: Scrape type for FN66%20XKP: 0
2026-03-28 22:05:18 [bca.uk] INFO: Found listing with ID: JL07%20FAY
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JL07%2520FAY%27 HTTP/1.1" 200 None
2026-03-28 22:05:18 [bca.uk] INFO: Scrape type for JL07%20FAY: 0
2026-03-28 22:05:18 [bca.uk] INFO: Found listing with ID: LF64%20MJE
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF64%2520MJE%27 HTTP/1.1" 200 None
2026-03-28 22:05:18 [bca.uk] INFO: Scrape type for LF64%20MJE: 2
2026-03-28 22:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc9b8be7-796e-5ceb-986b-3ad36843a162 with identifier: LF64%20MJE
2026-03-28 22:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc9b8be7-796e-5ceb-986b-3ad36843a162 with scrape type 2
2026-03-28 22:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc9b8be7-796e-5ceb-986b-3ad36843a162 with scrape type 2
2026-03-28 22:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bc9b8be7-796e-5ceb-986b-3ad36843a162, identifier: LF64%20MJE
2026-03-28 22:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333393/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG66TXM/42810151?sv=2020-08-04&st=2026-03-28T22%3A05%3A05Z&se=2026-03-28T22%3A30%3A05Z&sr=b&sp=r&sig=C1vsp95R4gOA7T0iHNFs%2BZs12NdBkOHyJYbnRQXqRtM%3D)
2026-03-28 22:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024871/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YX16OWF/42810933?sv=2020-08-04&st=2026-03-28T22%3A05%3A09Z&se=2026-03-28T22%3A30%3A09Z&sr=b&sp=r&sig=3EOZGDetp00%2FdUCWDR68oq2Rwg5gxQSyaFaneq5tB70%3D)
2026-03-28 22:05:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024882/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024882>
2026-03-28 22:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bc9b8be7-796e-5ceb-986b-3ad36843a162 with identifier: LF64%20MJE
2026-03-28 22:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bc9b8be7-796e-5ceb-986b-3ad36843a162 with identifier: LF64%20MJE
2026-03-28 22:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bc9b8be7-796e-5ceb-986b-3ad36843a162 with identifier: LF64%20MJE to the API
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 101,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LF64%20MJE-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'bc9b8be7-796e-5ceb-986b-3ad36843a162',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LF64 MJE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LF64%20MJE&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'SUZUKI',
'model': 'SWIFT',
'odometer': 53674,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'SUZUKI SWIFT 1.3 DDIS SZ4 Hatchback',
'transmission': 'manual',
'trim': 'DDIS SZ4',
'vin': 'TSMNZC92S00433281',
'year': 2014}
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF64%2520MJE%27 HTTP/1.1" 200 None
2026-03-28 22:05:18 [bca.uk] INFO: Saving data for LF64%20MJE: {'auction_closing_time': 1774778400.0, 'created_time': 1774621636.286774, 'last_price_update_time': 1774735518.887678}
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LF64%2520MJE') HTTP/1.1" 204 0
2026-03-28 22:05:18 [bca.uk] INFO: Found listing with ID: AJ10%20XBR
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ10%2520XBR%27 HTTP/1.1" 200 None
2026-03-28 22:05:18 [bca.uk] INFO: Scrape type for AJ10%20XBR: 1
2026-03-28 22:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 976f1540-41c9-5853-a520-2191352412f3 with identifier: AJ10%20XBR
2026-03-28 22:05:18 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 976f1540-41c9-5853-a520-2191352412f3
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024897%27 HTTP/1.1" 200 None
2026-03-28 22:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024897 not downloaded yet
2026-03-28 22:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547c7f90>
2026-03-28 22:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_867b722d-9875-5e9c-b6b5-4614e36a0cad/867b722d-9875-5e9c-b6b5-4614e36a0cad_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPX15ZPR%252F699330943%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX15ZPR/699330943/600 saved to cache
2026-03-28 22:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 867b722d-9875-5e9c-b6b5-4614e36a0cad
2026-03-28 22:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543170d0>
2026-03-28 22:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ba24d3-8587-5eee-9f39-5a8e165a6cdc/f0ba24d3-8587-5eee-9f39-5a8e165a6cdc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD18RFJ%252F698971744%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD18RFJ/698971744/600 saved to cache
2026-03-28 22:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f0ba24d3-8587-5eee-9f39-5a8e165a6cdc
2026-03-28 22:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fbfb90>
2026-03-28 22:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_867b722d-9875-5e9c-b6b5-4614e36a0cad/867b722d-9875-5e9c-b6b5-4614e36a0cad_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPX15ZPR%252F699330945%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX15ZPR/699330945/600 saved to cache
2026-03-28 22:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 867b722d-9875-5e9c-b6b5-4614e36a0cad
2026-03-28 22:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b3a310>
2026-03-28 22:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4494bc-d302-5d25-af44-49f73fc6f3e8/3b4494bc-d302-5d25-af44-49f73fc6f3e8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD17FAM%252F699285714%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD17FAM/699285714/600 saved to cache
2026-03-28 22:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b4494bc-d302-5d25-af44-49f73fc6f3e8
2026-03-28 22:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554422710>
2026-03-28 22:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48ea9338-f3dd-5ad7-81bd-c3333cd89421/48ea9338-f3dd-5ad7-81bd-c3333cd89421_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG66TXM%252F699333386%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333386/600 saved to cache
2026-03-28 22:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 48ea9338-f3dd-5ad7-81bd-c3333cd89421
2026-03-28 22:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX15ZPR/699330951/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX15ZPR/42810594?sv=2020-08-04&st=2026-03-28T22%3A05%3A03Z&se=2026-03-28T22%3A30%3A03Z&sr=b&sp=r&sig=4Xkg21iEljq20iTBfMl%2BtSswF985h8gnTDKxLA91BF8%3D)
2026-03-28 22:05:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269246/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699269246>
2026-03-28 22:05:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024887/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024887>
2026-03-28 22:05:19 [bca.uk] INFO: Found listing with ID: WV68%20XXZ
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV68%2520XXZ%27 HTTP/1.1" 200 None
2026-03-28 22:05:19 [bca.uk] INFO: Scrape type for WV68%20XXZ: 2
2026-03-28 22:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2247d790-33ba-519d-b128-c1d430b2f0e9 with identifier: WV68%20XXZ
2026-03-28 22:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2247d790-33ba-519d-b128-c1d430b2f0e9 with scrape type 2
2026-03-28 22:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2247d790-33ba-519d-b128-c1d430b2f0e9 with scrape type 2
2026-03-28 22:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2247d790-33ba-519d-b128-c1d430b2f0e9, identifier: WV68%20XXZ
2026-03-28 22:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB11OWR/42809523?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=%2BXPbFoBXFln5oK0NHPy9dGoxYCx5FDGBaSdCO93wM50%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2247d790-33ba-519d-b128-c1d430b2f0e9 with identifier: WV68%20XXZ
2026-03-28 22:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2247d790-33ba-519d-b128-c1d430b2f0e9 with identifier: WV68%20XXZ
2026-03-28 22:05:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2247d790-33ba-519d-b128-c1d430b2f0e9 with identifier: WV68%20XXZ to the API
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WV68%20XXZ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2247d790-33ba-519d-b128-c1d430b2f0e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WV68 XXZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WV68%20XXZ&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'VAUXHALL',
'model': 'ASTRA TOURER',
'odometer': 96792,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA TOURER 1.6 CDTI 110 ECOTEC TECH LINE S/S Estate',
'transmission': 'manual',
'trim': 'CDTI 110 ECOTEC TECH LINE S/S',
'vin': 'W0VBD8EN5K8000473',
'year': 2018}
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV68%2520XXZ%27 HTTP/1.1" 200 None
2026-03-28 22:05:19 [bca.uk] INFO: Saving data for WV68%20XXZ: {'auction_closing_time': 1774778400.0, 'created_time': 1774437760.299646, 'last_price_update_time': 1774735519.770669}
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WV68%2520XXZ') HTTP/1.1" 204 0
2026-03-28 22:05:19 [bca.uk] INFO: Found listing with ID: FP60%20LBZ
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP60%2520LBZ%27 HTTP/1.1" 200 None
2026-03-28 22:05:19 [bca.uk] INFO: Scrape type for FP60%20LBZ: 1
2026-03-28 22:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0379ad37-0288-50b0-bf91-fbe98128e386 with identifier: FP60%20LBZ
2026-03-28 22:05:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0379ad37-0288-50b0-bf91-fbe98128e386
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024901%27 HTTP/1.1" 200 None
2026-03-28 22:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024901 not downloaded yet
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f82290>
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73e9fcad-8a90-5e2f-8b8b-a9df139e02bc/73e9fcad-8a90-5e2f-8b8b-a9df139e02bc_expert_report_file_519467fd-5c77-488f-8001-200974c829e4.pdf HTTP/1.1" 201 0
2026-03-28 22:05:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc
2026-03-28 22:05:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc, skipping ID generation
2026-03-28 22:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDU68LVG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DU68LVG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547131b50>
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced2c5eb-991e-54e7-b6dd-6b7667db3844/ced2c5eb-991e-54e7-b6dd-6b7667db3844_expert_report_file_b2ef3e4a-97e8-4226-bb35-5c67aa056807.pdf HTTP/1.1" 201 0
2026-03-28 22:05:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ced2c5eb-991e-54e7-b6dd-6b7667db3844
2026-03-28 22:05:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ced2c5eb-991e-54e7-b6dd-6b7667db3844, skipping ID generation
2026-03-28 22:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ced2c5eb-991e-54e7-b6dd-6b7667db3844
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAO65VXH-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AO65VXH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b83c90>
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_867b722d-9875-5e9c-b6b5-4614e36a0cad/867b722d-9875-5e9c-b6b5-4614e36a0cad_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPX15ZPR%252F699330948%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX15ZPR/699330948/600 saved to cache
2026-03-28 22:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 867b722d-9875-5e9c-b6b5-4614e36a0cad
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547732010>
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48ea9338-f3dd-5ad7-81bd-c3333cd89421/48ea9338-f3dd-5ad7-81bd-c3333cd89421_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG66TXM%252F699333391%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333391/600 saved to cache
2026-03-28 22:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 48ea9338-f3dd-5ad7-81bd-c3333cd89421
2026-03-28 22:05:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333412/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699333412>
2026-03-28 22:05:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024888/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024888>
2026-03-28 22:05:20 [bca.uk] INFO: Found listing with ID: HY65%20BWJ
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY65%2520BWJ%27 HTTP/1.1" 200 None
2026-03-28 22:05:20 [bca.uk] INFO: Scrape type for HY65%20BWJ: 0
2026-03-28 22:05:20 [bca.uk] INFO: Found listing with ID: NV15%20TXJ
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV15%2520TXJ%27 HTTP/1.1" 200 None
2026-03-28 22:05:20 [bca.uk] INFO: Scrape type for NV15%20TXJ: 2
2026-03-28 22:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e082772-b031-51f8-975a-dc4b6e33af74 with identifier: NV15%20TXJ
2026-03-28 22:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e082772-b031-51f8-975a-dc4b6e33af74 with scrape type 2
2026-03-28 22:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e082772-b031-51f8-975a-dc4b6e33af74 with scrape type 2
2026-03-28 22:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5e082772-b031-51f8-975a-dc4b6e33af74, identifier: NV15%20TXJ
2026-03-28 22:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PFZ8482/42809655?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=TH37lPUKNzlJ9cPYi1xKA9ls4RZTQzngvd4d8Rd6Xgc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269173/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND05TWY/42810553?sv=2020-08-04&st=2026-03-28T22%3A05%3A04Z&se=2026-03-28T22%3A30%3A04Z&sr=b&sp=r&sig=BZ8%2B%2FUFxkJjjZzPfJFab4MBTncPmbBPd%2BnKXlbO2wps%3D)
2026-03-28 22:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5e082772-b031-51f8-975a-dc4b6e33af74 with identifier: NV15%20TXJ
2026-03-28 22:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5e082772-b031-51f8-975a-dc4b6e33af74 with identifier: NV15%20TXJ
2026-03-28 22:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5e082772-b031-51f8-975a-dc4b6e33af74 with identifier: NV15%20TXJ to the API
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 97,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NV15%20TXJ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5e082772-b031-51f8-975a-dc4b6e33af74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NV15 TXJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NV15%20TXJ&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'SMART',
'model': 'FORFOUR',
'odometer': 66811,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'SMART FORFOUR 1.0 71 EDITION #1 Hatchback',
'transmission': 'manual',
'trim': '71 EDITION #1',
'vin': 'WME4530422Y020999',
'year': 2015}
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV15%2520TXJ%27 HTTP/1.1" 200 None
2026-03-28 22:05:20 [bca.uk] INFO: Saving data for NV15%20TXJ: {'auction_closing_time': 1774778400.0, 'created_time': 1774621602.83893, 'last_price_update_time': 1774735520.689331}
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NV15%2520TXJ') HTTP/1.1" 204 0
2026-03-28 22:05:20 [bca.uk] INFO: Found listing with ID: KE04%20ECL
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE04%2520ECL%27 HTTP/1.1" 200 None
2026-03-28 22:05:20 [bca.uk] INFO: Scrape type for KE04%20ECL: 1
2026-03-28 22:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ba9a5f3-be93-54af-9867-b958cb5e410e with identifier: KE04%20ECL
2026-03-28 22:05:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7ba9a5f3-be93-54af-9867-b958cb5e410e
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208327%27 HTTP/1.1" 200 None
2026-03-28 22:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208327 not downloaded yet
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234598%27 HTTP/1.1" 200 None
2026-03-28 22:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234598 not downloaded yet
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554965a10>
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48ea9338-f3dd-5ad7-81bd-c3333cd89421/48ea9338-f3dd-5ad7-81bd-c3333cd89421_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG66TXM%252F699333393%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333393/600 saved to cache
2026-03-28 22:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 48ea9338-f3dd-5ad7-81bd-c3333cd89421
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472b0bd0>
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12dd3ce3-5de5-5fe4-88d0-7054e427658d/12dd3ce3-5de5-5fe4-88d0-7054e427658d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYX16OWF%252F699024871%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024871/600 saved to cache
2026-03-28 22:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12dd3ce3-5de5-5fe4-88d0-7054e427658d
2026-03-28 22:05:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472e6610>
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_867b722d-9875-5e9c-b6b5-4614e36a0cad/867b722d-9875-5e9c-b6b5-4614e36a0cad_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPX15ZPR%252F699330951%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX15ZPR/699330951/600 saved to cache
2026-03-28 22:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 867b722d-9875-5e9c-b6b5-4614e36a0cad
2026-03-28 22:05:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024891/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024891>
2026-03-28 22:05:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333420/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699333420>
2026-03-28 22:05:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333407/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699333407>
2026-03-28 22:05:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK65LPO/42809710?sv=2020-08-04&st=2026-03-28T22%3A05%3A20Z&se=2026-03-28T22%3A30%3A20Z&sr=b&sp=r&sig=oYxianEWP158PMpIdI%2Bc0WAWDjGi9DwdgesR7rPTi%2Bg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VK65%20LPO-GB>
2026-03-28 22:05:20 [bca.uk] INFO: Found listing with ID: WP16%20DFL
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP16%2520DFL%27 HTTP/1.1" 200 None
2026-03-28 22:05:20 [bca.uk] INFO: Scrape type for WP16%20DFL: 0
2026-03-28 22:05:20 [bca.uk] INFO: Found listing with ID: WV67%20NMF
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV67%2520NMF%27 HTTP/1.1" 200 None
2026-03-28 22:05:20 [bca.uk] INFO: Scrape type for WV67%20NMF: 1
2026-03-28 22:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 172158fc-c6ba-569f-b467-7d56f3769264 with identifier: WV67%20NMF
2026-03-28 22:05:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 172158fc-c6ba-569f-b467-7d56f3769264
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b3aa90>
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff2a82d-f7ab-592a-a781-86aaae91d694/6ff2a82d-f7ab-592a-a781-86aaae91d694_expert_report_file_d15e875c-c444-4b93-8d8a-31e5287e9ece.pdf HTTP/1.1" 201 0
2026-03-28 22:05:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6ff2a82d-f7ab-592a-a781-86aaae91d694
2026-03-28 22:05:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ff2a82d-f7ab-592a-a781-86aaae91d694, skipping ID generation
2026-03-28 22:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6ff2a82d-f7ab-592a-a781-86aaae91d694
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSB11OWR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SB11OWR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024882/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YX16OWF/42810933?sv=2020-08-04&st=2026-03-28T22%3A05%3A09Z&se=2026-03-28T22%3A30%3A09Z&sr=b&sp=r&sig=3EOZGDetp00%2FdUCWDR68oq2Rwg5gxQSyaFaneq5tB70%3D)
2026-03-28 22:05:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MW21AXB/42810470?sv=2020-08-04&st=2026-03-28T22%3A05%3A20Z&se=2026-03-28T22%3A30%3A20Z&sr=b&sp=r&sig=%2BrUdlzqIxAeDMjwos9mDVGiRE12qe2ahKjkgj9P6mZg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MW21%20AXB-GB>
2026-03-28 22:05:20 [bca.uk] INFO: Found listing with ID: KP05%20UXR
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP05%2520UXR%27 HTTP/1.1" 200 None
2026-03-28 22:05:20 [bca.uk] INFO: Scrape type for KP05%20UXR: 1
2026-03-28 22:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 992fca31-db18-5535-9b9a-21d4a1d64a72 with identifier: KP05%20UXR
2026-03-28 22:05:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 992fca31-db18-5535-9b9a-21d4a1d64a72
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208335%27 HTTP/1.1" 200 None
2026-03-28 22:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208335 not downloaded yet
2026-03-28 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234606%27 HTTP/1.1" 200 None
2026-03-28 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234606 not downloaded yet
2026-03-28 22:05:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024894/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024894>
2026-03-28 22:05:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333428/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699333428>
2026-03-28 22:05:21 [bca.uk] INFO: Found listing with ID: LK66%20WKL
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK66%2520WKL%27 HTTP/1.1" 200 None
2026-03-28 22:05:21 [bca.uk] INFO: Scrape type for LK66%20WKL: 1
2026-03-28 22:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48020b9d-f1ca-5049-9c7b-c8f63a357c9e with identifier: LK66%20WKL
2026-03-28 22:05:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 48020b9d-f1ca-5049-9c7b-c8f63a357c9e
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699246057%27 HTTP/1.1" 200 None
2026-03-28 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246057 not downloaded yet
2026-03-28 22:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474f1d50>
2026-03-28 22:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9700af5-622f-5b72-9af3-28e1d8f91693/b9700af5-622f-5b72-9af3-28e1d8f91693_expert_report_file_2e6f5fb5-dee2-4bce-959b-52730a9585a8.pdf HTTP/1.1" 201 0
2026-03-28 22:05:21 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b9700af5-622f-5b72-9af3-28e1d8f91693
2026-03-28 22:05:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9700af5-622f-5b72-9af3-28e1d8f91693, skipping ID generation
2026-03-28 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b9700af5-622f-5b72-9af3-28e1d8f91693
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPFZ8482-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PFZ8482-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55491e290>
2026-03-28 22:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7d66be-49b7-5d86-a859-5c899ed35afc/8f7d66be-49b7-5d86-a859-5c899ed35afc_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND05TWY%252F699269173%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269173/600 saved to cache
2026-03-28 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f7d66be-49b7-5d86-a859-5c899ed35afc
2026-03-28 22:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024887/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YX16OWF/42810933?sv=2020-08-04&st=2026-03-28T22%3A05%3A09Z&se=2026-03-28T22%3A30%3A09Z&sr=b&sp=r&sig=3EOZGDetp00%2FdUCWDR68oq2Rwg5gxQSyaFaneq5tB70%3D)
2026-03-28 22:05:21 [bca.uk] INFO: Found listing with ID: KX06%20XUD
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX06%2520XUD%27 HTTP/1.1" 200 None
2026-03-28 22:05:21 [bca.uk] INFO: Scrape type for KX06%20XUD: 1
2026-03-28 22:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ea9ccc5-341e-59d0-9330-b505b5ad8888 with identifier: KX06%20XUD
2026-03-28 22:05:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6ea9ccc5-341e-59d0-9330-b505b5ad8888
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208347%27 HTTP/1.1" 200 None
2026-03-28 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208347 not downloaded yet
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234618%27 HTTP/1.1" 200 None
2026-03-28 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234618 not downloaded yet
2026-03-28 22:05:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024897/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024897>
2026-03-28 22:05:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ10XBR/42810460?sv=2020-08-04&st=2026-03-28T22%3A05%3A21Z&se=2026-03-28T22%3A30%3A21Z&sr=b&sp=r&sig=Omxs4vBf8IL8wES3JqTd9z%2FqnN52Fjw%2BOfzPET2vDTk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AJ10%20XBR-GB>
2026-03-28 22:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269246/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND05TWY/42810553?sv=2020-08-04&st=2026-03-28T22%3A05%3A04Z&se=2026-03-28T22%3A30%3A04Z&sr=b&sp=r&sig=BZ8%2B%2FUFxkJjjZzPfJFab4MBTncPmbBPd%2BnKXlbO2wps%3D)
2026-03-28 22:05:21 [bca.uk] INFO: Found listing with ID: NL68%20LBO
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL68%2520LBO%27 HTTP/1.1" 200 None
2026-03-28 22:05:21 [bca.uk] INFO: Scrape type for NL68%20LBO: 0
2026-03-28 22:05:21 [bca.uk] INFO: Found listing with ID: YK19%20NOH
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK19%2520NOH%27 HTTP/1.1" 200 None
2026-03-28 22:05:21 [bca.uk] INFO: Scrape type for YK19%20NOH: 1
2026-03-28 22:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e320279-d073-5e8e-aee4-113575c202cf with identifier: YK19%20NOH
2026-03-28 22:05:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3e320279-d073-5e8e-aee4-113575c202cf
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699246063%27 HTTP/1.1" 200 None
2026-03-28 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246063 not downloaded yet
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252815%27 HTTP/1.1" 200 None
2026-03-28 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252815 not downloaded yet
2026-03-28 22:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024888/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YX16OWF/42810933?sv=2020-08-04&st=2026-03-28T22%3A05%3A09Z&se=2026-03-28T22%3A30%3A09Z&sr=b&sp=r&sig=3EOZGDetp00%2FdUCWDR68oq2Rwg5gxQSyaFaneq5tB70%3D)
2026-03-28 22:05:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234588/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AO65VXH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208315/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DU68LVG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:21 [bca.uk] INFO: Found listing with ID: LK59%20LFU
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK59%2520LFU%27 HTTP/1.1" 200 None
2026-03-28 22:05:21 [bca.uk] INFO: Scrape type for LK59%20LFU: 1
2026-03-28 22:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a83e0fd1-5b31-5398-90ed-f3506792a1a5 with identifier: LK59%20LFU
2026-03-28 22:05:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a83e0fd1-5b31-5398-90ed-f3506792a1a5
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208354%27 HTTP/1.1" 200 None
2026-03-28 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208354 not downloaded yet
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234629%27 HTTP/1.1" 200 None
2026-03-28 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234629 not downloaded yet
2026-03-28 22:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549ba310>
2026-03-28 22:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12dd3ce3-5de5-5fe4-88d0-7054e427658d/12dd3ce3-5de5-5fe4-88d0-7054e427658d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYX16OWF%252F699024882%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024882/600 saved to cache
2026-03-28 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 12dd3ce3-5de5-5fe4-88d0-7054e427658d
2026-03-28 22:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333412/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG66TXM/42810151?sv=2020-08-04&st=2026-03-28T22%3A05%3A05Z&se=2026-03-28T22%3A30%3A05Z&sr=b&sp=r&sig=C1vsp95R4gOA7T0iHNFs%2BZs12NdBkOHyJYbnRQXqRtM%3D)
2026-03-28 22:05:21 [bca.uk] INFO: Found listing with ID: LO62%20FPD
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO62%2520FPD%27 HTTP/1.1" 200 None
2026-03-28 22:05:21 [bca.uk] INFO: Scrape type for LO62%20FPD: 1
2026-03-28 22:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33f95c1b-3436-504d-8243-b3c29aca56a3 with identifier: LO62%20FPD
2026-03-28 22:05:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 33f95c1b-3436-504d-8243-b3c29aca56a3
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699246073%27 HTTP/1.1" 200 None
2026-03-28 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246073 not downloaded yet
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252823%27 HTTP/1.1" 200 None
2026-03-28 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252823 not downloaded yet
2026-03-28 22:05:21 [bca.uk] INFO: Found listing with ID: HV15%20WJD
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV15%2520WJD%27 HTTP/1.1" 200 None
2026-03-28 22:05:21 [bca.uk] INFO: Scrape type for HV15%20WJD: 0
2026-03-28 22:05:21 [bca.uk] INFO: Found listing with ID: KY65%20CJZ
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY65%2520CJZ%27 HTTP/1.1" 200 None
2026-03-28 22:05:21 [bca.uk] INFO: Scrape type for KY65%20CJZ: 0
2026-03-28 22:05:21 [bca.uk] INFO: Found listing with ID: LK66%20RLX
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK66%2520RLX%27 HTTP/1.1" 200 None
2026-03-28 22:05:21 [bca.uk] INFO: Scrape type for LK66%20RLX: 2
2026-03-28 22:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2941f3b-ec29-50d8-afbd-e8c8587ed823 with identifier: LK66%20RLX
2026-03-28 22:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2941f3b-ec29-50d8-afbd-e8c8587ed823 with scrape type 2
2026-03-28 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2941f3b-ec29-50d8-afbd-e8c8587ed823 with scrape type 2
2026-03-28 22:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e2941f3b-ec29-50d8-afbd-e8c8587ed823, identifier: LK66%20RLX
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208364%27 HTTP/1.1" 200 None
2026-03-28 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208364 not downloaded yet
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234639%27 HTTP/1.1" 200 None
2026-03-28 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234639 not downloaded yet
2026-03-28 22:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK65LPO/42809710?sv=2020-08-04&st=2026-03-28T22%3A05%3A20Z&se=2026-03-28T22%3A30%3A20Z&sr=b&sp=r&sig=oYxianEWP158PMpIdI%2Bc0WAWDjGi9DwdgesR7rPTi%2Bg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:21 [bca.uk] INFO: Found listing with ID: YA65%20UKW
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA65%2520UKW%27 HTTP/1.1" 200 None
2026-03-28 22:05:21 [bca.uk] INFO: Scrape type for YA65%20UKW: 0
2026-03-28 22:05:21 [bca.uk] INFO: Found listing with ID: YC66%20FJX
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC66%2520FJX%27 HTTP/1.1" 200 None
2026-03-28 22:05:21 [bca.uk] INFO: Scrape type for YC66%20FJX: 2
2026-03-28 22:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee5b7b69-19d4-51f0-ac42-6e3a01f3b696 with identifier: YC66%20FJX
2026-03-28 22:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee5b7b69-19d4-51f0-ac42-6e3a01f3b696 with scrape type 2
2026-03-28 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee5b7b69-19d4-51f0-ac42-6e3a01f3b696 with scrape type 2
2026-03-28 22:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ee5b7b69-19d4-51f0-ac42-6e3a01f3b696, identifier: YC66%20FJX
2026-03-28 22:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e2941f3b-ec29-50d8-afbd-e8c8587ed823 with identifier: LK66%20RLX
2026-03-28 22:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e2941f3b-ec29-50d8-afbd-e8c8587ed823 with identifier: LK66%20RLX
2026-03-28 22:05:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e2941f3b-ec29-50d8-afbd-e8c8587ed823 with identifier: LK66%20RLX to the API
2026-03-28 22:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 145,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LK66%20RLX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e2941f3b-ec29-50d8-afbd-e8c8587ed823',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LK66 RLX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LK66%20RLX&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'VAUXHALL',
'model': 'MOKKA',
'odometer': 102427,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VAUXHALL MOKKA 1.4 T 140 EXCLUSIV 2WD S/S StationWagon',
'transmission': 'manual',
'trim': 'T 140 EXCLUSIV 2WD S/S',
'vin': 'W0LJC7E84GB728209',
'year': 2016}
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK66%2520RLX%27 HTTP/1.1" 200 None
2026-03-28 22:05:22 [bca.uk] INFO: Saving data for LK66%20RLX: {'auction_closing_time': 1774778400.0, 'created_time': 1774622055.031987, 'last_price_update_time': 1774735522.276925}
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LK66%2520RLX') HTTP/1.1" 204 0
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699246081%27 HTTP/1.1" 200 None
2026-03-28 22:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246081 not downloaded yet
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252835%27 HTTP/1.1" 200 None
2026-03-28 22:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252835 not downloaded yet
2026-03-28 22:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549bbed0>
2026-03-28 22:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12dd3ce3-5de5-5fe4-88d0-7054e427658d/12dd3ce3-5de5-5fe4-88d0-7054e427658d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYX16OWF%252F699024887%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024887/600 saved to cache
2026-03-28 22:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 12dd3ce3-5de5-5fe4-88d0-7054e427658d
2026-03-28 22:05:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547169690>
2026-03-28 22:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7d66be-49b7-5d86-a859-5c899ed35afc/8f7d66be-49b7-5d86-a859-5c899ed35afc_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND05TWY%252F699269246%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269246/600 saved to cache
2026-03-28 22:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8f7d66be-49b7-5d86-a859-5c899ed35afc
2026-03-28 22:05:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246049/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SB11OWR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024891/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YX16OWF/42810933?sv=2020-08-04&st=2026-03-28T22%3A05%3A09Z&se=2026-03-28T22%3A30%3A09Z&sr=b&sp=r&sig=3EOZGDetp00%2FdUCWDR68oq2Rwg5gxQSyaFaneq5tB70%3D)
2026-03-28 22:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333420/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG66TXM/42810151?sv=2020-08-04&st=2026-03-28T22%3A05%3A05Z&se=2026-03-28T22%3A30%3A05Z&sr=b&sp=r&sig=C1vsp95R4gOA7T0iHNFs%2BZs12NdBkOHyJYbnRQXqRtM%3D)
2026-03-28 22:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333407/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG66TXM/42810151?sv=2020-08-04&st=2026-03-28T22%3A05%3A05Z&se=2026-03-28T22%3A30%3A05Z&sr=b&sp=r&sig=C1vsp95R4gOA7T0iHNFs%2BZs12NdBkOHyJYbnRQXqRtM%3D)
2026-03-28 22:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333428/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG66TXM/42810151?sv=2020-08-04&st=2026-03-28T22%3A05%3A05Z&se=2026-03-28T22%3A30%3A05Z&sr=b&sp=r&sig=C1vsp95R4gOA7T0iHNFs%2BZs12NdBkOHyJYbnRQXqRtM%3D)
2026-03-28 22:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024894/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YX16OWF/42810933?sv=2020-08-04&st=2026-03-28T22%3A05%3A09Z&se=2026-03-28T22%3A30%3A09Z&sr=b&sp=r&sig=3EOZGDetp00%2FdUCWDR68oq2Rwg5gxQSyaFaneq5tB70%3D)
2026-03-28 22:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MW21AXB/42810470?sv=2020-08-04&st=2026-03-28T22%3A05%3A20Z&se=2026-03-28T22%3A30%3A20Z&sr=b&sp=r&sig=%2BrUdlzqIxAeDMjwos9mDVGiRE12qe2ahKjkgj9P6mZg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ee5b7b69-19d4-51f0-ac42-6e3a01f3b696 with identifier: YC66%20FJX
2026-03-28 22:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ee5b7b69-19d4-51f0-ac42-6e3a01f3b696 with identifier: YC66%20FJX
2026-03-28 22:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ee5b7b69-19d4-51f0-ac42-6e3a01f3b696 with identifier: YC66%20FJX to the API
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YC66%20FJX-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ee5b7b69-19d4-51f0-ac42-6e3a01f3b696',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YC66 FJX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YC66%20FJX&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 90211,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI 1.2 DIG-T N-CONNECTA Hatchback',
'transmission': 'manual',
'trim': 'DIG-T N-CONNECTA',
'vin': 'SJNFEAJ11U1817546',
'year': 2016}
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC66%2520FJX%27 HTTP/1.1" 200 None
2026-03-28 22:05:22 [bca.uk] INFO: Saving data for YC66%20FJX: {'auction_closing_time': 1774778400.0, 'created_time': 1774622486.414545, 'last_price_update_time': 1774735522.884388}
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YC66%2520FJX') HTTP/1.1" 204 0
2026-03-28 22:05:22 [bca.uk] INFO: Found listing with ID: LR66%20GXC
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR66%2520GXC%27 HTTP/1.1" 200 None
2026-03-28 22:05:22 [bca.uk] INFO: Scrape type for LR66%20GXC: 0
2026-03-28 22:05:22 [bca.uk] INFO: Found listing with ID: MD66%20XKL
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD66%2520XKL%27 HTTP/1.1" 200 None
2026-03-28 22:05:22 [bca.uk] INFO: Scrape type for MD66%20XKL: 0
2026-03-28 22:05:22 [bca.uk] INFO: Found listing with ID: MJ65%20XFP
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ65%2520XFP%27 HTTP/1.1" 200 None
2026-03-28 22:05:22 [bca.uk] INFO: Scrape type for MJ65%20XFP: 0
2026-03-28 22:05:22 [bca.uk] INFO: Found listing with ID: OU66%20YVP
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU66%2520YVP%27 HTTP/1.1" 200 None
2026-03-28 22:05:22 [bca.uk] INFO: Scrape type for OU66%20YVP: 0
2026-03-28 22:05:22 [bca.uk] INFO: Found listing with ID: BV18%20MMU
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV18%2520MMU%27 HTTP/1.1" 200 None
2026-03-28 22:05:22 [bca.uk] INFO: Scrape type for BV18%20MMU: 1
2026-03-28 22:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bab00141-98d7-507d-a35a-585edf20fde4 with identifier: BV18%20MMU
2026-03-28 22:05:22 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item bab00141-98d7-507d-a35a-585edf20fde4
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208381%27 HTTP/1.1" 200 None
2026-03-28 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208381 not downloaded yet
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234652%27 HTTP/1.1" 200 None
2026-03-28 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234652 not downloaded yet
2026-03-28 22:05:23 [bca.uk] INFO: Found listing with ID: BL14%20HCA
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL14%2520HCA%27 HTTP/1.1" 200 None
2026-03-28 22:05:23 [bca.uk] INFO: Scrape type for BL14%20HCA: 2
2026-03-28 22:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc87a103-61cf-5611-abda-a758b3ec48c0 with identifier: BL14%20HCA
2026-03-28 22:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc87a103-61cf-5611-abda-a758b3ec48c0 with scrape type 2
2026-03-28 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc87a103-61cf-5611-abda-a758b3ec48c0 with scrape type 2
2026-03-28 22:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bc87a103-61cf-5611-abda-a758b3ec48c0, identifier: BL14%20HCA
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699246085%27 HTTP/1.1" 200 None
2026-03-28 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246085 not downloaded yet
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252840%27 HTTP/1.1" 200 None
2026-03-28 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252840 not downloaded yet
2026-03-28 22:05:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234606/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234606>
2026-03-28 22:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bc87a103-61cf-5611-abda-a758b3ec48c0 with identifier: BL14%20HCA
2026-03-28 22:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bc87a103-61cf-5611-abda-a758b3ec48c0 with identifier: BL14%20HCA
2026-03-28 22:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bc87a103-61cf-5611-abda-a758b3ec48c0 with identifier: BL14%20HCA to the API
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 103,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BL14%20HCA-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'bc87a103-61cf-5611-abda-a758b3ec48c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BL14 HCA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BL14%20HCA&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'PEUGEOT',
'model': '2008',
'odometer': 104297,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'PEUGEOT 2008 1.6 E-HDI ACTIVE MPV',
'transmission': 'manual',
'trim': 'E-HDI ACTIVE',
'vin': 'VF3CU9HP0EY068311',
'year': 2014}
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL14%2520HCA%27 HTTP/1.1" 200 None
2026-03-28 22:05:23 [bca.uk] INFO: Saving data for BL14%20HCA: {'auction_closing_time': 1774778400.0, 'created_time': 1774610851.026324, 'last_price_update_time': 1774735523.603123}
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BL14%2520HCA') HTTP/1.1" 204 0
2026-03-28 22:05:23 [bca.uk] INFO: Found listing with ID: EJ72%20YOX
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ72%2520YOX%27 HTTP/1.1" 200 None
2026-03-28 22:05:23 [bca.uk] INFO: Scrape type for EJ72%20YOX: 0
2026-03-28 22:05:23 [bca.uk] INFO: Found listing with ID: GX69%20OHK
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX69%2520OHK%27 HTTP/1.1" 200 None
2026-03-28 22:05:23 [bca.uk] INFO: Scrape type for GX69%20OHK: 1
2026-03-28 22:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd277234-4dc4-5636-a402-27f6b3385c96 with identifier: GX69%20OHK
2026-03-28 22:05:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cd277234-4dc4-5636-a402-27f6b3385c96
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208400%27 HTTP/1.1" 200 None
2026-03-28 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208400 not downloaded yet
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234673%27 HTTP/1.1" 200 None
2026-03-28 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234673 not downloaded yet
2026-03-28 22:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474f5750>
2026-03-28 22:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12dd3ce3-5de5-5fe4-88d0-7054e427658d/12dd3ce3-5de5-5fe4-88d0-7054e427658d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYX16OWF%252F699024888%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024888/600 saved to cache
2026-03-28 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 12dd3ce3-5de5-5fe4-88d0-7054e427658d
2026-03-28 22:05:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554475810>
2026-03-28 22:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48ea9338-f3dd-5ad7-81bd-c3333cd89421/48ea9338-f3dd-5ad7-81bd-c3333cd89421_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG66TXM%252F699333412%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333412/600 saved to cache
2026-03-28 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 48ea9338-f3dd-5ad7-81bd-c3333cd89421
2026-03-28 22:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b72110>
2026-03-28 22:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a373065-9147-5214-8a56-d55636e4875e/7a373065-9147-5214-8a56-d55636e4875e_expert_report_file_08d68f89-8bc7-4ebc-9ebf-a0fee49e7cc6.pdf HTTP/1.1" 201 0
2026-03-28 22:05:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7a373065-9147-5214-8a56-d55636e4875e
2026-03-28 22:05:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a373065-9147-5214-8a56-d55636e4875e, skipping ID generation
2026-03-28 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7a373065-9147-5214-8a56-d55636e4875e
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DVK65LPO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VK65LPO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208315/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU68LVG/42800882?sv=2020-08-04&st=2026-03-28T22%3A05%3A12Z&se=2026-03-28T22%3A30%3A12Z&sr=b&sp=r&sig=NJDddzay8QfXZCkDpDoajXCukxQxXVptkxb3qmj1KmE%3D)
2026-03-28 22:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234588/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO65VXH/42775624?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=slIW%2B3iwvDchqJURAJRdLEGkYLYSjXVM0OamBF34cz0%3D)
2026-03-28 22:05:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208347/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208347>
2026-03-28 22:05:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252815/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252815>
2026-03-28 22:05:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234618/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234618>
2026-03-28 22:05:23 [bca.uk] INFO: Found listing with ID: V888%20KPD
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V888%2520KPD%27 HTTP/1.1" 200 None
2026-03-28 22:05:23 [bca.uk] INFO: Scrape type for V888%20KPD: 2
2026-03-28 22:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f0e6b6b-64d3-51f8-9b48-f141f5c7fead with identifier: V888%20KPD
2026-03-28 22:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f0e6b6b-64d3-51f8-9b48-f141f5c7fead with scrape type 2
2026-03-28 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f0e6b6b-64d3-51f8-9b48-f141f5c7fead with scrape type 2
2026-03-28 22:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0f0e6b6b-64d3-51f8-9b48-f141f5c7fead, identifier: V888%20KPD
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699246097%27 HTTP/1.1" 200 None
2026-03-28 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246097 not downloaded yet
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252855%27 HTTP/1.1" 200 None
2026-03-28 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252855 not downloaded yet
2026-03-28 22:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024897/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YX16OWF/42810933?sv=2020-08-04&st=2026-03-28T22%3A05%3A09Z&se=2026-03-28T22%3A30%3A09Z&sr=b&sp=r&sig=3EOZGDetp00%2FdUCWDR68oq2Rwg5gxQSyaFaneq5tB70%3D)
2026-03-28 22:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0f0e6b6b-64d3-51f8-9b48-f141f5c7fead with identifier: V888%20KPD
2026-03-28 22:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0f0e6b6b-64d3-51f8-9b48-f141f5c7fead with identifier: V888%20KPD
2026-03-28 22:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0f0e6b6b-64d3-51f8-9b48-f141f5c7fead with identifier: V888%20KPD to the API
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 191,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=V888%20KPD-GB',
'category': 'Car',
'color': 'yellow',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0f0e6b6b-64d3-51f8-9b48-f141f5c7fead',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'V888 KPD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=V888%20KPD&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'MERCEDES-BENZ',
'model': 'CLA35 AMG S/B',
'odometer': 51076,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLA35 AMG S/B 2.0 4MATIC PREMIUM PLUS DCT Estate',
'transmission': 'automatic',
'trim': '4MATIC PREMIUM PLUS DCT',
'vin': 'W1K1186512N159881',
'year': 2020}
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V888%2520KPD%27 HTTP/1.1" 200 None
2026-03-28 22:05:24 [bca.uk] INFO: Saving data for V888%20KPD: {'auction_closing_time': 1774778400.0, 'created_time': 1774622397.617395, 'last_price_update_time': 1774735524.303808}
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='V888%2520KPD') HTTP/1.1" 204 0
2026-03-28 22:05:24 [bca.uk] INFO: Found listing with ID: LD20%20VFR
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD20%2520VFR%27 HTTP/1.1" 200 None
2026-03-28 22:05:24 [bca.uk] INFO: Scrape type for LD20%20VFR: 1
2026-03-28 22:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2e42f65-62fc-5369-aa50-0828074023cd with identifier: LD20%20VFR
2026-03-28 22:05:24 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e2e42f65-62fc-5369-aa50-0828074023cd
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208420%27 HTTP/1.1" 200 None
2026-03-28 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208420 not downloaded yet
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234697%27 HTTP/1.1" 200 None
2026-03-28 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234697 not downloaded yet
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253423%27 HTTP/1.1" 200 None
2026-03-28 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253423 not downloaded yet
2026-03-28 22:05:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252823/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252823>
2026-03-28 22:05:24 [bca.uk] INFO: Found listing with ID: GU09%20ZBO
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU09%2520ZBO%27 HTTP/1.1" 200 None
2026-03-28 22:05:24 [bca.uk] INFO: Scrape type for GU09%20ZBO: 1
2026-03-28 22:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d01a147-3afb-5ecc-8676-b197cf6baca3 with identifier: GU09%20ZBO
2026-03-28 22:05:24 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1d01a147-3afb-5ecc-8676-b197cf6baca3
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699246109%27 HTTP/1.1" 200 None
2026-03-28 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246109 not downloaded yet
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252867%27 HTTP/1.1" 200 None
2026-03-28 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252867 not downloaded yet
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542308d0>
2026-03-28 22:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12dd3ce3-5de5-5fe4-88d0-7054e427658d/12dd3ce3-5de5-5fe4-88d0-7054e427658d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYX16OWF%252F699024891%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024891/600 saved to cache
2026-03-28 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 12dd3ce3-5de5-5fe4-88d0-7054e427658d
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542d2b50>
2026-03-28 22:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48ea9338-f3dd-5ad7-81bd-c3333cd89421/48ea9338-f3dd-5ad7-81bd-c3333cd89421_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG66TXM%252F699333420%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333420/600 saved to cache
2026-03-28 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 48ea9338-f3dd-5ad7-81bd-c3333cd89421
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477d3810>
2026-03-28 22:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48ea9338-f3dd-5ad7-81bd-c3333cd89421/48ea9338-f3dd-5ad7-81bd-c3333cd89421_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG66TXM%252F699333407%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333407/600 saved to cache
2026-03-28 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 48ea9338-f3dd-5ad7-81bd-c3333cd89421
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54714b4d0>
2026-03-28 22:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48ea9338-f3dd-5ad7-81bd-c3333cd89421/48ea9338-f3dd-5ad7-81bd-c3333cd89421_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG66TXM%252F699333428%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333428/600 saved to cache
2026-03-28 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 48ea9338-f3dd-5ad7-81bd-c3333cd89421
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55435e350>
2026-03-28 22:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12dd3ce3-5de5-5fe4-88d0-7054e427658d/12dd3ce3-5de5-5fe4-88d0-7054e427658d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYX16OWF%252F699024894%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024894/600 saved to cache
2026-03-28 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 12dd3ce3-5de5-5fe4-88d0-7054e427658d
2026-03-28 22:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55441d450>
2026-03-28 22:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec532b91-2d62-5ebd-830b-087067e8ed90/ec532b91-2d62-5ebd-830b-087067e8ed90_expert_report_file_3a32d7f8-d987-474e-8c78-789d317d6b7a.pdf HTTP/1.1" 201 0
2026-03-28 22:05:24 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ec532b91-2d62-5ebd-830b-087067e8ed90
2026-03-28 22:05:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec532b91-2d62-5ebd-830b-087067e8ed90, skipping ID generation
2026-03-28 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ec532b91-2d62-5ebd-830b-087067e8ed90
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMW21AXB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MW21AXB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ10XBR/42810460?sv=2020-08-04&st=2026-03-28T22%3A05%3A21Z&se=2026-03-28T22%3A30%3A21Z&sr=b&sp=r&sig=Omxs4vBf8IL8wES3JqTd9z%2FqnN52Fjw%2BOfzPET2vDTk%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246049/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB11OWR/42809523?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=%2BXPbFoBXFln5oK0NHPy9dGoxYCx5FDGBaSdCO93wM50%3D)
2026-03-28 22:05:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234639/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234639>
2026-03-28 22:05:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208364/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208364>
2026-03-28 22:05:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO62FPD/42810887?sv=2020-08-04&st=2026-03-28T22%3A05%3A24Z&se=2026-03-28T22%3A30%3A24Z&sr=b&sp=r&sig=P8NCpVvkz1uu7oEXsd9E3ohiNsPp4GVfqPmDLbXubx8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LO62%20FPD-GB>
2026-03-28 22:05:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246073/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246073>
2026-03-28 22:05:24 [bca.uk] INFO: Found listing with ID: WK69%20XPD
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK69%2520XPD%27 HTTP/1.1" 200 None
2026-03-28 22:05:24 [bca.uk] INFO: Scrape type for WK69%20XPD: 2
2026-03-28 22:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5ea448e-ce7a-5663-b1ff-9cff4b82d356 with identifier: WK69%20XPD
2026-03-28 22:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5ea448e-ce7a-5663-b1ff-9cff4b82d356 with scrape type 2
2026-03-28 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5ea448e-ce7a-5663-b1ff-9cff4b82d356 with scrape type 2
2026-03-28 22:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e5ea448e-ce7a-5663-b1ff-9cff4b82d356, identifier: WK69%20XPD
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208440%27 HTTP/1.1" 200 None
2026-03-28 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208440 not downloaded yet
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234724%27 HTTP/1.1" 200 None
2026-03-28 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234724 not downloaded yet
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253427%27 HTTP/1.1" 200 None
2026-03-28 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253427 not downloaded yet
2026-03-28 22:05:24 [bca.uk] INFO: Found listing with ID: YD13%20TWN
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD13%2520TWN%27 HTTP/1.1" 200 None
2026-03-28 22:05:24 [bca.uk] INFO: Scrape type for YD13%20TWN: 1
2026-03-28 22:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08149aa9-acd8-5621-afc9-de796506b5b4 with identifier: YD13%20TWN
2026-03-28 22:05:24 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 08149aa9-acd8-5621-afc9-de796506b5b4
2026-03-28 22:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e5ea448e-ce7a-5663-b1ff-9cff4b82d356 with identifier: WK69%20XPD
2026-03-28 22:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e5ea448e-ce7a-5663-b1ff-9cff4b82d356 with identifier: WK69%20XPD
2026-03-28 22:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e5ea448e-ce7a-5663-b1ff-9cff4b82d356 with identifier: WK69%20XPD to the API
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 126,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WK69%20XPD-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e5ea448e-ce7a-5663-b1ff-9cff4b82d356',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WK69 XPD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WK69%20XPD&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'DACIA',
'model': 'DUSTER',
'odometer': 4538,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'DACIA DUSTER 1.0 TCE 100 ESSENTIAL StationWagon',
'transmission': 'manual',
'trim': 'TCE 100 ESSENTIAL',
'vin': 'VF1HJD20364254290',
'year': 2019}
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK69%2520XPD%27 HTTP/1.1" 200 None
2026-03-28 22:05:25 [bca.uk] INFO: Saving data for WK69%20XPD: {'auction_closing_time': 1774864800.0, 'created_time': 1774621259.948892, 'last_price_update_time': 1774735525.279749}
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WK69%2520XPD') HTTP/1.1" 204 0
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699246123%27 HTTP/1.1" 200 None
2026-03-28 22:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246123 not downloaded yet
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252883%27 HTTP/1.1" 200 None
2026-03-28 22:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252883 not downloaded yet
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976068%27 HTTP/1.1" 200 None
2026-03-28 22:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976068 not downloaded yet
2026-03-28 22:05:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234629/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234629>
2026-03-28 22:05:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208354/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208354>
2026-03-28 22:05:25 [bca.uk] INFO: Found listing with ID: BG72%20YNH
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG72%2520YNH%27 HTTP/1.1" 200 None
2026-03-28 22:05:25 [bca.uk] INFO: Scrape type for BG72%20YNH: 0
2026-03-28 22:05:25 [bca.uk] INFO: Found listing with ID: DP69%20ZFO
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP69%2520ZFO%27 HTTP/1.1" 200 None
2026-03-28 22:05:25 [bca.uk] INFO: Scrape type for DP69%20ZFO: 1
2026-03-28 22:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ae84d00-f082-5222-b51d-cfbb89091e57 with identifier: DP69%20ZFO
2026-03-28 22:05:25 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8ae84d00-f082-5222-b51d-cfbb89091e57
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253434%27 HTTP/1.1" 200 None
2026-03-28 22:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253434 not downloaded yet
2026-03-28 22:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474a9650>
2026-03-28 22:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73e9fcad-8a90-5e2f-8b8b-a9df139e02bc/73e9fcad-8a90-5e2f-8b8b-a9df139e02bc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU68LVG%252F699208315%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208315/600 saved to cache
2026-03-28 22:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc
2026-03-28 22:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554406490>
2026-03-28 22:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced2c5eb-991e-54e7-b6dd-6b7667db3844/ced2c5eb-991e-54e7-b6dd-6b7667db3844_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO65VXH%252F699234588%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234588/600 saved to cache
2026-03-28 22:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ced2c5eb-991e-54e7-b6dd-6b7667db3844
2026-03-28 22:05:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54714dc10>
2026-03-28 22:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12dd3ce3-5de5-5fe4-88d0-7054e427658d/12dd3ce3-5de5-5fe4-88d0-7054e427658d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYX16OWF%252F699024897%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024897/600 saved to cache
2026-03-28 22:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 12dd3ce3-5de5-5fe4-88d0-7054e427658d
2026-03-28 22:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234606/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO65VXH/42775624?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=slIW%2B3iwvDchqJURAJRdLEGkYLYSjXVM0OamBF34cz0%3D)
2026-03-28 22:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234618/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO65VXH/42775624?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=slIW%2B3iwvDchqJURAJRdLEGkYLYSjXVM0OamBF34cz0%3D)
2026-03-28 22:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252815/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PFZ8482/42809655?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=TH37lPUKNzlJ9cPYi1xKA9ls4RZTQzngvd4d8Rd6Xgc%3D)
2026-03-28 22:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208347/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU68LVG/42800882?sv=2020-08-04&st=2026-03-28T22%3A05%3A12Z&se=2026-03-28T22%3A30%3A12Z&sr=b&sp=r&sig=NJDddzay8QfXZCkDpDoajXCukxQxXVptkxb3qmj1KmE%3D)
2026-03-28 22:05:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252840/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252840>
2026-03-28 22:05:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246085/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246085>
2026-03-28 22:05:25 [bca.uk] INFO: Found listing with ID: KP58%20SRV
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP58%2520SRV%27 HTTP/1.1" 200 None
2026-03-28 22:05:25 [bca.uk] INFO: Scrape type for KP58%20SRV: 1
2026-03-28 22:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dae85f49-83c1-5309-bd8a-55acf0d1d837 with identifier: KP58%20SRV
2026-03-28 22:05:25 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item dae85f49-83c1-5309-bd8a-55acf0d1d837
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699246138%27 HTTP/1.1" 200 None
2026-03-28 22:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246138 not downloaded yet
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252904%27 HTTP/1.1" 200 None
2026-03-28 22:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252904 not downloaded yet
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976086%27 HTTP/1.1" 200 None
2026-03-28 22:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976086 not downloaded yet
2026-03-28 22:05:25 [bca.uk] INFO: Found listing with ID: BJ20%20SFO
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ20%2520SFO%27 HTTP/1.1" 200 None
2026-03-28 22:05:25 [bca.uk] INFO: Scrape type for BJ20%20SFO: 2
2026-03-28 22:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0586b55a-6c26-5bef-804d-4b64e9ef9872 with identifier: BJ20%20SFO
2026-03-28 22:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0586b55a-6c26-5bef-804d-4b64e9ef9872 with scrape type 2
2026-03-28 22:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0586b55a-6c26-5bef-804d-4b64e9ef9872 with scrape type 2
2026-03-28 22:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0586b55a-6c26-5bef-804d-4b64e9ef9872, identifier: BJ20%20SFO
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253438%27 HTTP/1.1" 200 None
2026-03-28 22:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253438 not downloaded yet
2026-03-28 22:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252823/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PFZ8482/42809655?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=TH37lPUKNzlJ9cPYi1xKA9ls4RZTQzngvd4d8Rd6Xgc%3D)
2026-03-28 22:05:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252855/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252855>
2026-03-28 22:05:25 [bca.uk] INFO: Found listing with ID: LT05%20ONJ
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT05%2520ONJ%27 HTTP/1.1" 200 None
2026-03-28 22:05:25 [bca.uk] INFO: Scrape type for LT05%20ONJ: 1
2026-03-28 22:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08b948d7-14c0-5cfd-b5ed-455492122930 with identifier: LT05%20ONJ
2026-03-28 22:05:25 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 08b948d7-14c0-5cfd-b5ed-455492122930
2026-03-28 22:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0586b55a-6c26-5bef-804d-4b64e9ef9872 with identifier: BJ20%20SFO
2026-03-28 22:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0586b55a-6c26-5bef-804d-4b64e9ef9872 with identifier: BJ20%20SFO
2026-03-28 22:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0586b55a-6c26-5bef-804d-4b64e9ef9872 with identifier: BJ20%20SFO to the API
2026-03-28 22:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ20%20SFO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0586b55a-6c26-5bef-804d-4b64e9ef9872',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BJ20 SFO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BJ20%20SFO&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'AUDI',
'model': 'Q3 SPORTBACK',
'odometer': 84581,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'AUDI Q3 SPORTBACK 1.5 35 TFSI S LINE S-T Coupe',
'transmission': 'automatic',
'trim': '35 TFSI S LINE S-T',
'vin': 'WAUZZZF31L1058696',
'year': 2020}
2026-03-28 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ20%2520SFO%27 HTTP/1.1" 200 None
2026-03-28 22:05:26 [bca.uk] INFO: Saving data for BJ20%20SFO: {'auction_closing_time': 1774864800.0, 'created_time': 1774621241.562599, 'last_price_update_time': 1774735526.917183}
2026-03-28 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BJ20%2520SFO') HTTP/1.1" 204 0
2026-03-28 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252925%27 HTTP/1.1" 200 None
2026-03-28 22:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252925 not downloaded yet
2026-03-28 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976103%27 HTTP/1.1" 200 None
2026-03-28 22:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976103 not downloaded yet
2026-03-28 22:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a32d90>
2026-03-28 22:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_976f1540-41c9-5853-a520-2191352412f3/976f1540-41c9-5853-a520-2191352412f3_expert_report_file_4d15f4e4-e58b-4bc2-b660-fa8acac376e3.pdf HTTP/1.1" 201 0
2026-03-28 22:05:26 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 976f1540-41c9-5853-a520-2191352412f3
2026-03-28 22:05:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 976f1540-41c9-5853-a520-2191352412f3, skipping ID generation
2026-03-28 22:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 976f1540-41c9-5853-a520-2191352412f3
2026-03-28 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAJ10XBR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AJ10XBR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547fea50>
2026-03-28 22:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff2a82d-f7ab-592a-a781-86aaae91d694/6ff2a82d-f7ab-592a-a781-86aaae91d694_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB11OWR%252F699246049%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246049/600 saved to cache
2026-03-28 22:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ff2a82d-f7ab-592a-a781-86aaae91d694
2026-03-28 22:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208364/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU68LVG/42800882?sv=2020-08-04&st=2026-03-28T22%3A05%3A12Z&se=2026-03-28T22%3A30%3A12Z&sr=b&sp=r&sig=NJDddzay8QfXZCkDpDoajXCukxQxXVptkxb3qmj1KmE%3D)
2026-03-28 22:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246073/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB11OWR/42809523?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=%2BXPbFoBXFln5oK0NHPy9dGoxYCx5FDGBaSdCO93wM50%3D)
2026-03-28 22:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234639/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO65VXH/42775624?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=slIW%2B3iwvDchqJURAJRdLEGkYLYSjXVM0OamBF34cz0%3D)
2026-03-28 22:05:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253423/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253423>
2026-03-28 22:05:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234697/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234697>
2026-03-28 22:05:27 [bca.uk] INFO: Found listing with ID: LX70%20UWW
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX70%2520UWW%27 HTTP/1.1" 200 None
2026-03-28 22:05:27 [bca.uk] INFO: Scrape type for LX70%20UWW: 0
2026-03-28 22:05:27 [bca.uk] INFO: Found listing with ID: ML18%20JZP
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML18%2520JZP%27 HTTP/1.1" 200 None
2026-03-28 22:05:27 [bca.uk] INFO: Scrape type for ML18%20JZP: 0
2026-03-28 22:05:27 [bca.uk] INFO: Found listing with ID: AO18%20YDT
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO18%2520YDT%27 HTTP/1.1" 200 None
2026-03-28 22:05:27 [bca.uk] INFO: Scrape type for AO18%20YDT: 0
2026-03-28 22:05:27 [bca.uk] INFO: Found listing with ID: DX68%20LYY
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX68%2520LYY%27 HTTP/1.1" 200 None
2026-03-28 22:05:27 [bca.uk] INFO: Scrape type for DX68%20LYY: 0
2026-03-28 22:05:27 [bca.uk] INFO: Found listing with ID: M8%20GTB
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M8%2520GTB%27 HTTP/1.1" 200 None
2026-03-28 22:05:27 [bca.uk] INFO: Scrape type for M8%20GTB: 0
2026-03-28 22:05:27 [bca.uk] INFO: Found listing with ID: MW24%20ESU
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW24%2520ESU%27 HTTP/1.1" 200 None
2026-03-28 22:05:27 [bca.uk] INFO: Scrape type for MW24%20ESU: 0
2026-03-28 22:05:27 [bca.uk] INFO: Found listing with ID: MA22%20GUC
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA22%2520GUC%27 HTTP/1.1" 200 None
2026-03-28 22:05:27 [bca.uk] INFO: Scrape type for MA22%20GUC: 0
2026-03-28 22:05:27 [bca.uk] INFO: Found listing with ID: PX69%20SXW
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX69%2520SXW%27 HTTP/1.1" 200 None
2026-03-28 22:05:27 [bca.uk] INFO: Scrape type for PX69%20SXW: 2
2026-03-28 22:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc9a40ba-b58e-5c29-8228-ff9841f99834 with identifier: PX69%20SXW
2026-03-28 22:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc9a40ba-b58e-5c29-8228-ff9841f99834 with scrape type 2
2026-03-28 22:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc9a40ba-b58e-5c29-8228-ff9841f99834 with scrape type 2
2026-03-28 22:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dc9a40ba-b58e-5c29-8228-ff9841f99834, identifier: PX69%20SXW
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253445%27 HTTP/1.1" 200 None
2026-03-28 22:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253445 not downloaded yet
2026-03-28 22:05:27 [bca.uk] INFO: Found listing with ID: ML09%20TVX
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML09%2520TVX%27 HTTP/1.1" 200 None
2026-03-28 22:05:27 [bca.uk] INFO: Scrape type for ML09%20TVX: 1
2026-03-28 22:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79d1bd1b-e75f-5786-8613-977c6a06c247 with identifier: ML09%20TVX
2026-03-28 22:05:27 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 79d1bd1b-e75f-5786-8613-977c6a06c247
2026-03-28 22:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dc9a40ba-b58e-5c29-8228-ff9841f99834 with identifier: PX69%20SXW
2026-03-28 22:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dc9a40ba-b58e-5c29-8228-ff9841f99834 with identifier: PX69%20SXW
2026-03-28 22:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dc9a40ba-b58e-5c29-8228-ff9841f99834 with identifier: PX69%20SXW to the API
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PX69%20SXW-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'dc9a40ba-b58e-5c29-8228-ff9841f99834',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PX69 SXW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PX69%20SXW&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'KIA',
'model': 'PICANTO',
'odometer': 35331,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'KIA PICANTO 1.0 WAVE Hatchback',
'transmission': 'manual',
'trim': 'WAVE',
'vin': 'KNAB3511LKT517517',
'year': 2019}
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX69%2520SXW%27 HTTP/1.1" 200 None
2026-03-28 22:05:27 [bca.uk] INFO: Saving data for PX69%20SXW: {'auction_closing_time': 1774864800.0, 'created_time': 1774438144.854568, 'last_price_update_time': 1774735527.676738}
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PX69%2520SXW') HTTP/1.1" 204 0
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976128%27 HTTP/1.1" 200 None
2026-03-28 22:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976128 not downloaded yet
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010742%27 HTTP/1.1" 200 None
2026-03-28 22:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010742 not downloaded yet
2026-03-28 22:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234629/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO65VXH/42775624?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=slIW%2B3iwvDchqJURAJRdLEGkYLYSjXVM0OamBF34cz0%3D)
2026-03-28 22:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208354/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU68LVG/42800882?sv=2020-08-04&st=2026-03-28T22%3A05%3A12Z&se=2026-03-28T22%3A30%3A12Z&sr=b&sp=r&sig=NJDddzay8QfXZCkDpDoajXCukxQxXVptkxb3qmj1KmE%3D)
2026-03-28 22:05:27 [bca.uk] INFO: Found listing with ID: DSZ%206849
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DSZ%25206849%27 HTTP/1.1" 200 None
2026-03-28 22:05:27 [bca.uk] INFO: Scrape type for DSZ%206849: 0
2026-03-28 22:05:27 [bca.uk] INFO: Found listing with ID: MF20%20LKN
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF20%2520LKN%27 HTTP/1.1" 200 None
2026-03-28 22:05:27 [bca.uk] INFO: Scrape type for MF20%20LKN: 0
2026-03-28 22:05:27 [bca.uk] INFO: Found listing with ID: OE70%20CVW
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE70%2520CVW%27 HTTP/1.1" 200 None
2026-03-28 22:05:27 [bca.uk] INFO: Scrape type for OE70%20CVW: 0
2026-03-28 22:05:27 [bca.uk] INFO: Found listing with ID: WG22%20UOD
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG22%2520UOD%27 HTTP/1.1" 200 None
2026-03-28 22:05:27 [bca.uk] INFO: Scrape type for WG22%20UOD: 0
2026-03-28 22:05:27 [bca.uk] INFO: Found listing with ID: WV70%20FXU
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV70%2520FXU%27 HTTP/1.1" 200 None
2026-03-28 22:05:27 [bca.uk] INFO: Scrape type for WV70%20FXU: 1
2026-03-28 22:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c91238b-60eb-5c43-b2e1-23b211f67d90 with identifier: WV70%20FXU
2026-03-28 22:05:27 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1c91238b-60eb-5c43-b2e1-23b211f67d90
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253456%27 HTTP/1.1" 200 None
2026-03-28 22:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253456 not downloaded yet
2026-03-28 22:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548b6a10>
2026-03-28 22:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced2c5eb-991e-54e7-b6dd-6b7667db3844/ced2c5eb-991e-54e7-b6dd-6b7667db3844_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO65VXH%252F699234606%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234606/600 saved to cache
2026-03-28 22:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ced2c5eb-991e-54e7-b6dd-6b7667db3844
2026-03-28 22:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547749610>
2026-03-28 22:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced2c5eb-991e-54e7-b6dd-6b7667db3844/ced2c5eb-991e-54e7-b6dd-6b7667db3844_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO65VXH%252F699234618%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234618/600 saved to cache
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ced2c5eb-991e-54e7-b6dd-6b7667db3844
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548c1090>
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9700af5-622f-5b72-9af3-28e1d8f91693/b9700af5-622f-5b72-9af3-28e1d8f91693_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPFZ8482%252F699252815%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252815/600 saved to cache
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b9700af5-622f-5b72-9af3-28e1d8f91693
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554935a50>
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73e9fcad-8a90-5e2f-8b8b-a9df139e02bc/73e9fcad-8a90-5e2f-8b8b-a9df139e02bc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU68LVG%252F699208347%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208347/600 saved to cache
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548c0850>
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9700af5-622f-5b72-9af3-28e1d8f91693/b9700af5-622f-5b72-9af3-28e1d8f91693_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPFZ8482%252F699252823%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252823/600 saved to cache
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b9700af5-622f-5b72-9af3-28e1d8f91693
2026-03-28 22:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO62FPD/42810887?sv=2020-08-04&st=2026-03-28T22%3A05%3A24Z&se=2026-03-28T22%3A30%3A24Z&sr=b&sp=r&sig=P8NCpVvkz1uu7oEXsd9E3ohiNsPp4GVfqPmDLbXubx8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246085/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB11OWR/42809523?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=%2BXPbFoBXFln5oK0NHPy9dGoxYCx5FDGBaSdCO93wM50%3D)
2026-03-28 22:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252840/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PFZ8482/42809655?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=TH37lPUKNzlJ9cPYi1xKA9ls4RZTQzngvd4d8Rd6Xgc%3D)
2026-03-28 22:05:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252883/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252883>
2026-03-28 22:05:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246123/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246123>
2026-03-28 22:05:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976068/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976068>
2026-03-28 22:05:28 [bca.uk] INFO: Found listing with ID: AF68%20HMX
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF68%2520HMX%27 HTTP/1.1" 200 None
2026-03-28 22:05:28 [bca.uk] INFO: Scrape type for AF68%20HMX: 1
2026-03-28 22:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c669890-4fd5-5f63-8a29-4ca91e40fe4b with identifier: AF68%20HMX
2026-03-28 22:05:28 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9c669890-4fd5-5f63-8a29-4ca91e40fe4b
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976154%27 HTTP/1.1" 200 None
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976154 not downloaded yet
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010762%27 HTTP/1.1" 200 None
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010762 not downloaded yet
2026-03-28 22:05:28 [bca.uk] INFO: Found listing with ID: YS70%20CXD
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS70%2520CXD%27 HTTP/1.1" 200 None
2026-03-28 22:05:28 [bca.uk] INFO: Scrape type for YS70%20CXD: 0
2026-03-28 22:05:28 [bca.uk] INFO: Found listing with ID: GJ71%20WSN
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ71%2520WSN%27 HTTP/1.1" 200 None
2026-03-28 22:05:28 [bca.uk] INFO: Scrape type for GJ71%20WSN: 1
2026-03-28 22:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce69b670-8852-55c2-be68-a54396142524 with identifier: GJ71%20WSN
2026-03-28 22:05:28 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ce69b670-8852-55c2-be68-a54396142524
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253466%27 HTTP/1.1" 200 None
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253466 not downloaded yet
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547478610>
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73e9fcad-8a90-5e2f-8b8b-a9df139e02bc/73e9fcad-8a90-5e2f-8b8b-a9df139e02bc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU68LVG%252F699208364%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208364/600 saved to cache
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542d2510>
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff2a82d-f7ab-592a-a781-86aaae91d694/6ff2a82d-f7ab-592a-a781-86aaae91d694_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB11OWR%252F699246073%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246073/600 saved to cache
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ff2a82d-f7ab-592a-a781-86aaae91d694
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54748ec10>
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced2c5eb-991e-54e7-b6dd-6b7667db3844/ced2c5eb-991e-54e7-b6dd-6b7667db3844_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO65VXH%252F699234639%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234639/600 saved to cache
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ced2c5eb-991e-54e7-b6dd-6b7667db3844
2026-03-28 22:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252855/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PFZ8482/42809655?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=TH37lPUKNzlJ9cPYi1xKA9ls4RZTQzngvd4d8Rd6Xgc%3D)
2026-03-28 22:05:28 [bca.uk] INFO: Found listing with ID: FL68%20CTV
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL68%2520CTV%27 HTTP/1.1" 200 None
2026-03-28 22:05:28 [bca.uk] INFO: Scrape type for FL68%20CTV: 0
2026-03-28 22:05:28 [bca.uk] INFO: Found listing with ID: KN18%20OGS
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN18%2520OGS%27 HTTP/1.1" 200 None
2026-03-28 22:05:28 [bca.uk] INFO: Scrape type for KN18%20OGS: 1
2026-03-28 22:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34529131-3f38-544f-80da-657c8bd2604d with identifier: KN18%20OGS
2026-03-28 22:05:28 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 34529131-3f38-544f-80da-657c8bd2604d
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976177%27 HTTP/1.1" 200 None
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976177 not downloaded yet
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010783%27 HTTP/1.1" 200 None
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010783 not downloaded yet
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474517d0>
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced2c5eb-991e-54e7-b6dd-6b7667db3844/ced2c5eb-991e-54e7-b6dd-6b7667db3844_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO65VXH%252F699234629%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234629/600 saved to cache
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ced2c5eb-991e-54e7-b6dd-6b7667db3844
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54728fb10>
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73e9fcad-8a90-5e2f-8b8b-a9df139e02bc/73e9fcad-8a90-5e2f-8b8b-a9df139e02bc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU68LVG%252F699208354%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208354/600 saved to cache
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc
2026-03-28 22:05:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD13TWN/42806211?sv=2020-08-04&st=2026-03-28T22%3A05%3A28Z&se=2026-03-28T22%3A30%3A28Z&sr=b&sp=r&sig=wRfwJDLlJXXhiZvL3VXojvZD0PIHcruLftI3SeGjEFo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD13%20TWN-GB>
2026-03-28 22:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253423/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK65LPO/42809710?sv=2020-08-04&st=2026-03-28T22%3A05%3A20Z&se=2026-03-28T22%3A30%3A20Z&sr=b&sp=r&sig=oYxianEWP158PMpIdI%2Bc0WAWDjGi9DwdgesR7rPTi%2Bg%3D)
2026-03-28 22:05:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246138/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246138>
2026-03-28 22:05:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253438/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253438>
2026-03-28 22:05:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252904/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252904>
2026-03-28 22:05:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976086/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976086>
2026-03-28 22:05:28 [bca.uk] INFO: Found listing with ID: HT70%20DMF
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT70%2520DMF%27 HTTP/1.1" 200 None
2026-03-28 22:05:28 [bca.uk] INFO: Scrape type for HT70%20DMF: 1
2026-03-28 22:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16 with identifier: HT70%20DMF
2026-03-28 22:05:28 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253476%27 HTTP/1.1" 200 None
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253476 not downloaded yet
2026-03-28 22:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234697/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO65VXH/42775624?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=slIW%2B3iwvDchqJURAJRdLEGkYLYSjXVM0OamBF34cz0%3D)
2026-03-28 22:05:28 [bca.uk] INFO: Found listing with ID: LB68%20AKX
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB68%2520AKX%27 HTTP/1.1" 200 None
2026-03-28 22:05:28 [bca.uk] INFO: Scrape type for LB68%20AKX: 0
2026-03-28 22:05:28 [bca.uk] INFO: Found listing with ID: LB68%20BWP
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB68%2520BWP%27 HTTP/1.1" 200 None
2026-03-28 22:05:28 [bca.uk] INFO: Scrape type for LB68%20BWP: 0
2026-03-28 22:05:28 [bca.uk] INFO: Found listing with ID: RA18%20XPV
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA18%2520XPV%27 HTTP/1.1" 200 None
2026-03-28 22:05:28 [bca.uk] INFO: Scrape type for RA18%20XPV: 1
2026-03-28 22:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc46c333-9727-5d8d-ab5c-b3d4cb03ad24 with identifier: RA18%20XPV
2026-03-28 22:05:28 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cc46c333-9727-5d8d-ab5c-b3d4cb03ad24
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976203%27 HTTP/1.1" 200 None
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976203 not downloaded yet
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010809%27 HTTP/1.1" 200 None
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010809 not downloaded yet
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54771b8d0>
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33f95c1b-3436-504d-8243-b3c29aca56a3/33f95c1b-3436-504d-8243-b3c29aca56a3_expert_report_file_c463be0a-6b1a-4e2d-9b73-2846f2771508.pdf HTTP/1.1" 201 0
2026-03-28 22:05:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 33f95c1b-3436-504d-8243-b3c29aca56a3
2026-03-28 22:05:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33f95c1b-3436-504d-8243-b3c29aca56a3, skipping ID generation
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 33f95c1b-3436-504d-8243-b3c29aca56a3
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLO62FPD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LO62FPD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471f4090>
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff2a82d-f7ab-592a-a781-86aaae91d694/6ff2a82d-f7ab-592a-a781-86aaae91d694_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB11OWR%252F699246085%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246085/600 saved to cache
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6ff2a82d-f7ab-592a-a781-86aaae91d694
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549ebf50>
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9700af5-622f-5b72-9af3-28e1d8f91693/b9700af5-622f-5b72-9af3-28e1d8f91693_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPFZ8482%252F699252840%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252840/600 saved to cache
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b9700af5-622f-5b72-9af3-28e1d8f91693
2026-03-28 22:05:28 [bca.uk] INFO: Found listing with ID: KM20%20TSZ
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM20%2520TSZ%27 HTTP/1.1" 200 None
2026-03-28 22:05:28 [bca.uk] INFO: Scrape type for KM20%20TSZ: 1
2026-03-28 22:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c73d75d1-bd0a-5743-8d24-444e4cdb7552 with identifier: KM20%20TSZ
2026-03-28 22:05:28 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c73d75d1-bd0a-5743-8d24-444e4cdb7552
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253486%27 HTTP/1.1" 200 None
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253486 not downloaded yet
2026-03-28 22:05:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253445/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253445>
2026-03-28 22:05:28 [bca.uk] INFO: Found listing with ID: HY06%20VPF
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY06%2520VPF%27 HTTP/1.1" 200 None
2026-03-28 22:05:28 [bca.uk] INFO: Scrape type for HY06%20VPF: 1
2026-03-28 22:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4d4397f-82ae-5f65-add6-f530f9d672f0 with identifier: HY06%20VPF
2026-03-28 22:05:28 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b4d4397f-82ae-5f65-add6-f530f9d672f0
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976233%27 HTTP/1.1" 200 None
2026-03-28 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976233 not downloaded yet
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010836%27 HTTP/1.1" 200 None
2026-03-28 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010836 not downloaded yet
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176153%27 HTTP/1.1" 200 None
2026-03-28 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176153 not downloaded yet
2026-03-28 22:05:29 [bca.uk] INFO: Found listing with ID: LV18%20FLW
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV18%2520FLW%27 HTTP/1.1" 200 None
2026-03-28 22:05:29 [bca.uk] INFO: Scrape type for LV18%20FLW: 1
2026-03-28 22:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b0f6191-0680-5ec4-9f99-776551675a24 with identifier: LV18%20FLW
2026-03-28 22:05:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3b0f6191-0680-5ec4-9f99-776551675a24
2026-03-28 22:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547e1010>
2026-03-28 22:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9700af5-622f-5b72-9af3-28e1d8f91693/b9700af5-622f-5b72-9af3-28e1d8f91693_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPFZ8482%252F699252855%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252855/600 saved to cache
2026-03-28 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b9700af5-622f-5b72-9af3-28e1d8f91693
2026-03-28 22:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5541f7810>
2026-03-28 22:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a373065-9147-5214-8a56-d55636e4875e/7a373065-9147-5214-8a56-d55636e4875e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK65LPO%252F699253423%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253423/600 saved to cache
2026-03-28 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7a373065-9147-5214-8a56-d55636e4875e
2026-03-28 22:05:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f96350>
2026-03-28 22:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced2c5eb-991e-54e7-b6dd-6b7667db3844/ced2c5eb-991e-54e7-b6dd-6b7667db3844_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO65VXH%252F699234697%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234697/600 saved to cache
2026-03-28 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ced2c5eb-991e-54e7-b6dd-6b7667db3844
2026-03-28 22:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976068/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MW21AXB/42810470?sv=2020-08-04&st=2026-03-28T22%3A05%3A20Z&se=2026-03-28T22%3A30%3A20Z&sr=b&sp=r&sig=%2BrUdlzqIxAeDMjwos9mDVGiRE12qe2ahKjkgj9P6mZg%3D)
2026-03-28 22:05:29 [bca.uk] INFO: Found listing with ID: OV60%20BVR
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV60%2520BVR%27 HTTP/1.1" 200 None
2026-03-28 22:05:29 [bca.uk] INFO: Scrape type for OV60%20BVR: 1
2026-03-28 22:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4d23d94-cc98-52e5-b2e4-244cf1ddd01e with identifier: OV60%20BVR
2026-03-28 22:05:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f4d23d94-cc98-52e5-b2e4-244cf1ddd01e
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976273%27 HTTP/1.1" 200 None
2026-03-28 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976273 not downloaded yet
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010873%27 HTTP/1.1" 200 None
2026-03-28 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010873 not downloaded yet
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176163%27 HTTP/1.1" 200 None
2026-03-28 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176163 not downloaded yet
2026-03-28 22:05:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976128/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976128>
2026-03-28 22:05:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010723/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AJ10XBR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML09TVX/42810920?sv=2020-08-04&st=2026-03-28T22%3A05%3A29Z&se=2026-03-28T22%3A30%3A29Z&sr=b&sp=r&sig=3CS5OP6y37ZBf1km95kjXxQgZGTyyd1Q098%2Fto%2FWbZ0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ML09%20TVX-GB>
2026-03-28 22:05:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010742/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010742>
2026-03-28 22:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252883/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PFZ8482/42809655?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=TH37lPUKNzlJ9cPYi1xKA9ls4RZTQzngvd4d8Rd6Xgc%3D)
2026-03-28 22:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246123/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB11OWR/42809523?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=%2BXPbFoBXFln5oK0NHPy9dGoxYCx5FDGBaSdCO93wM50%3D)
2026-03-28 22:05:29 [bca.uk] INFO: Found listing with ID: AV20%20JJK
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV20%2520JJK%27 HTTP/1.1" 200 None
2026-03-28 22:05:29 [bca.uk] INFO: Scrape type for AV20%20JJK: 0
2026-03-28 22:05:29 [bca.uk] INFO: Found listing with ID: GJ20%20UMA
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ20%2520UMA%27 HTTP/1.1" 200 None
2026-03-28 22:05:29 [bca.uk] INFO: Scrape type for GJ20%20UMA: 1
2026-03-28 22:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 182b028b-defa-51b3-b97c-bb87ff17eb7b with identifier: GJ20%20UMA
2026-03-28 22:05:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 182b028b-defa-51b3-b97c-bb87ff17eb7b
2026-03-28 22:05:29 [bca.uk] INFO: Found listing with ID: PE05%20WVK
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE05%2520WVK%27 HTTP/1.1" 200 None
2026-03-28 22:05:29 [bca.uk] INFO: Scrape type for PE05%20WVK: 1
2026-03-28 22:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 468e3ba1-3197-5e32-97b6-5380ba714d59 with identifier: PE05%20WVK
2026-03-28 22:05:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 468e3ba1-3197-5e32-97b6-5380ba714d59
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010907%27 HTTP/1.1" 200 None
2026-03-28 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010907 not downloaded yet
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176173%27 HTTP/1.1" 200 None
2026-03-28 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176173 not downloaded yet
2026-03-28 22:05:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010762/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010762>
2026-03-28 22:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976086/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MW21AXB/42810470?sv=2020-08-04&st=2026-03-28T22%3A05%3A20Z&se=2026-03-28T22%3A30%3A20Z&sr=b&sp=r&sig=%2BrUdlzqIxAeDMjwos9mDVGiRE12qe2ahKjkgj9P6mZg%3D)
2026-03-28 22:05:29 [bca.uk] INFO: Found listing with ID: V800%20ARR
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V800%2520ARR%27 HTTP/1.1" 200 None
2026-03-28 22:05:29 [bca.uk] INFO: Scrape type for V800%20ARR: 0
2026-03-28 22:05:29 [bca.uk] INFO: Found listing with ID: BV19%20UHK
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV19%2520UHK%27 HTTP/1.1" 200 None
2026-03-28 22:05:29 [bca.uk] INFO: Scrape type for BV19%20UHK: 2
2026-03-28 22:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1a66a79-c853-5081-90ec-1947830cb5c2 with identifier: BV19%20UHK
2026-03-28 22:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1a66a79-c853-5081-90ec-1947830cb5c2 with scrape type 2
2026-03-28 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1a66a79-c853-5081-90ec-1947830cb5c2 with scrape type 2
2026-03-28 22:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e1a66a79-c853-5081-90ec-1947830cb5c2, identifier: BV19%20UHK
2026-03-28 22:05:29 [bca.uk] INFO: Found listing with ID: YA08%20JSV
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA08%2520JSV%27 HTTP/1.1" 200 None
2026-03-28 22:05:29 [bca.uk] INFO: Scrape type for YA08%20JSV: 1
2026-03-28 22:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f257efe2-daf9-5bd3-a5cb-758b3c74ea0d with identifier: YA08%20JSV
2026-03-28 22:05:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f257efe2-daf9-5bd3-a5cb-758b3c74ea0d
2026-03-28 22:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e1a66a79-c853-5081-90ec-1947830cb5c2 with identifier: BV19%20UHK
2026-03-28 22:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e1a66a79-c853-5081-90ec-1947830cb5c2 with identifier: BV19%20UHK
2026-03-28 22:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e1a66a79-c853-5081-90ec-1947830cb5c2 with identifier: BV19%20UHK to the API
2026-03-28 22:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BV19%20UHK-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e1a66a79-c853-5081-90ec-1947830cb5c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BV19 UHK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BV19%20UHK&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'AUDI',
'model': 'A6',
'odometer': 35544,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'AUDI A6 2.0 40 TDI S LINE S-T Saloon',
'transmission': 'automatic',
'trim': '40 TDI S LINE S-T',
'vin': 'WAUZZZF2XKN077066',
'year': 2019}
2026-03-28 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV19%2520UHK%27 HTTP/1.1" 200 None
2026-03-28 22:05:30 [bca.uk] INFO: Saving data for BV19%20UHK: {'auction_closing_time': 1774864800.0, 'created_time': 1774438096.584433, 'last_price_update_time': 1774735530.861717}
2026-03-28 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BV19%2520UHK') HTTP/1.1" 204 0
2026-03-28 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010930%27 HTTP/1.1" 200 None
2026-03-28 22:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010930 not downloaded yet
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176185%27 HTTP/1.1" 200 None
2026-03-28 22:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176185 not downloaded yet
2026-03-28 22:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253438/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK65LPO/42809710?sv=2020-08-04&st=2026-03-28T22%3A05%3A20Z&se=2026-03-28T22%3A30%3A20Z&sr=b&sp=r&sig=oYxianEWP158PMpIdI%2Bc0WAWDjGi9DwdgesR7rPTi%2Bg%3D)
2026-03-28 22:05:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976177/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976177>
2026-03-28 22:05:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010783/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010783>
2026-03-28 22:05:31 [bca.uk] INFO: Found listing with ID: DY68%20UWN
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY68%2520UWN%27 HTTP/1.1" 200 None
2026-03-28 22:05:31 [bca.uk] INFO: Scrape type for DY68%20UWN: 0
2026-03-28 22:05:31 [bca.uk] INFO: Found listing with ID: FL71%20EGE
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL71%2520EGE%27 HTTP/1.1" 200 None
2026-03-28 22:05:31 [bca.uk] INFO: Scrape type for FL71%20EGE: 1
2026-03-28 22:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31b35f19-803b-5916-9d73-8fe099e2d84a with identifier: FL71%20EGE
2026-03-28 22:05:31 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 31b35f19-803b-5916-9d73-8fe099e2d84a
2026-03-28 22:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555c50350>
2026-03-28 22:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec532b91-2d62-5ebd-830b-087067e8ed90/ec532b91-2d62-5ebd-830b-087067e8ed90_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMW21AXB%252F698976068%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976068/600 saved to cache
2026-03-28 22:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec532b91-2d62-5ebd-830b-087067e8ed90
2026-03-28 22:05:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a05a90>
2026-03-28 22:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9700af5-622f-5b72-9af3-28e1d8f91693/b9700af5-622f-5b72-9af3-28e1d8f91693_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPFZ8482%252F699252883%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252883/600 saved to cache
2026-03-28 22:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b9700af5-622f-5b72-9af3-28e1d8f91693
2026-03-28 22:05:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547757bd0>
2026-03-28 22:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff2a82d-f7ab-592a-a781-86aaae91d694/6ff2a82d-f7ab-592a-a781-86aaae91d694_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB11OWR%252F699246123%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246123/600 saved to cache
2026-03-28 22:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6ff2a82d-f7ab-592a-a781-86aaae91d694
2026-03-28 22:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253445/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK65LPO/42809710?sv=2020-08-04&st=2026-03-28T22%3A05%3A20Z&se=2026-03-28T22%3A30%3A20Z&sr=b&sp=r&sig=oYxianEWP158PMpIdI%2Bc0WAWDjGi9DwdgesR7rPTi%2Bg%3D)
2026-03-28 22:05:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176153/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176153>
2026-03-28 22:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246138/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB11OWR/42809523?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=%2BXPbFoBXFln5oK0NHPy9dGoxYCx5FDGBaSdCO93wM50%3D)
2026-03-28 22:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252904/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PFZ8482/42809655?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=TH37lPUKNzlJ9cPYi1xKA9ls4RZTQzngvd4d8Rd6Xgc%3D)
2026-03-28 22:05:31 [bca.uk] INFO: Found listing with ID: YD65%20RKK
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD65%2520RKK%27 HTTP/1.1" 200 None
2026-03-28 22:05:31 [bca.uk] INFO: Scrape type for YD65%20RKK: 0
2026-03-28 22:05:31 [bca.uk] INFO: Found listing with ID: YH16%20GZR
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH16%2520GZR%27 HTTP/1.1" 200 None
2026-03-28 22:05:31 [bca.uk] INFO: Scrape type for YH16%20GZR: 2
2026-03-28 22:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d85a6414-5103-5661-bc06-74b4d1dde1f2 with identifier: YH16%20GZR
2026-03-28 22:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d85a6414-5103-5661-bc06-74b4d1dde1f2 with scrape type 2
2026-03-28 22:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d85a6414-5103-5661-bc06-74b4d1dde1f2 with scrape type 2
2026-03-28 22:05:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d85a6414-5103-5661-bc06-74b4d1dde1f2, identifier: YH16%20GZR
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010958%27 HTTP/1.1" 200 None
2026-03-28 22:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010958 not downloaded yet
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176199%27 HTTP/1.1" 200 None
2026-03-28 22:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176199 not downloaded yet
2026-03-28 22:05:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d85a6414-5103-5661-bc06-74b4d1dde1f2 with identifier: YH16%20GZR
2026-03-28 22:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d85a6414-5103-5661-bc06-74b4d1dde1f2 with identifier: YH16%20GZR
2026-03-28 22:05:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d85a6414-5103-5661-bc06-74b4d1dde1f2 with identifier: YH16%20GZR to the API
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YH16%20GZR-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd85a6414-5103-5661-bc06-74b4d1dde1f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YH16 GZR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YH16%20GZR&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VOLKSWAGEN',
'model': 'TIGUAN',
'odometer': 87723,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN 2.0 TDI 150 BMT 2WD MATCH ED. StationWagon',
'transmission': 'manual',
'trim': 'TDI 150 BMT 2WD MATCH ED.',
'vin': 'WVGZZZ5NZGW087577',
'year': 2016}
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH16%2520GZR%27 HTTP/1.1" 200 None
2026-03-28 22:05:32 [bca.uk] INFO: Saving data for YH16%20GZR: {'auction_closing_time': 1774778400.0, 'created_time': 1774622426.626863, 'last_price_update_time': 1774735532.064272}
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YH16%2520GZR') HTTP/1.1" 204 0
2026-03-28 22:05:32 [bca.uk] INFO: Found listing with ID: ND70%20FWR
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND70%2520FWR%27 HTTP/1.1" 200 None
2026-03-28 22:05:32 [bca.uk] INFO: Scrape type for ND70%20FWR: 0
2026-03-28 22:05:32 [bca.uk] INFO: Found listing with ID: MJ69%20NDN
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ69%2520NDN%27 HTTP/1.1" 200 None
2026-03-28 22:05:32 [bca.uk] INFO: Scrape type for MJ69%20NDN: 0
2026-03-28 22:05:32 [bca.uk] INFO: Found listing with ID: KJ19%20OPY
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ19%2520OPY%27 HTTP/1.1" 200 None
2026-03-28 22:05:32 [bca.uk] INFO: Scrape type for KJ19%20OPY: 0
2026-03-28 22:05:32 [bca.uk] INFO: Found listing with ID: RE68%20BSO
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE68%2520BSO%27 HTTP/1.1" 200 None
2026-03-28 22:05:32 [bca.uk] INFO: Scrape type for RE68%20BSO: 0
2026-03-28 22:05:32 [bca.uk] INFO: Found listing with ID: DV70%20UAG
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV70%2520UAG%27 HTTP/1.1" 200 None
2026-03-28 22:05:32 [bca.uk] INFO: Scrape type for DV70%20UAG: 0
2026-03-28 22:05:32 [bca.uk] INFO: Found listing with ID: FL21%20VOF
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL21%2520VOF%27 HTTP/1.1" 200 None
2026-03-28 22:05:32 [bca.uk] INFO: Scrape type for FL21%20VOF: 0
2026-03-28 22:05:32 [bca.uk] INFO: Found listing with ID: PF68%20PYB
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF68%2520PYB%27 HTTP/1.1" 200 None
2026-03-28 22:05:32 [bca.uk] INFO: Scrape type for PF68%20PYB: 1
2026-03-28 22:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1941c029-e601-57db-8da4-77ae3b1b387e with identifier: PF68%20PYB
2026-03-28 22:05:32 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1941c029-e601-57db-8da4-77ae3b1b387e
2026-03-28 22:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD13TWN/42806211?sv=2020-08-04&st=2026-03-28T22%3A05%3A28Z&se=2026-03-28T22%3A30%3A28Z&sr=b&sp=r&sig=wRfwJDLlJXXhiZvL3VXojvZD0PIHcruLftI3SeGjEFo%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010742/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ10XBR/42810460?sv=2020-08-04&st=2026-03-28T22%3A05%3A21Z&se=2026-03-28T22%3A30%3A21Z&sr=b&sp=r&sig=Omxs4vBf8IL8wES3JqTd9z%2FqnN52Fjw%2BOfzPET2vDTk%3D)
2026-03-28 22:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010723/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ10XBR/42810460?sv=2020-08-04&st=2026-03-28T22%3A05%3A21Z&se=2026-03-28T22%3A30%3A21Z&sr=b&sp=r&sig=Omxs4vBf8IL8wES3JqTd9z%2FqnN52Fjw%2BOfzPET2vDTk%3D)
2026-03-28 22:05:32 [bca.uk] INFO: Found listing with ID: YJ70%20JVF
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ70%2520JVF%27 HTTP/1.1" 200 None
2026-03-28 22:05:32 [bca.uk] INFO: Scrape type for YJ70%20JVF: 0
2026-03-28 22:05:32 [bca.uk] INFO: Found listing with ID: DY65%20GUU
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY65%2520GUU%27 HTTP/1.1" 200 None
2026-03-28 22:05:32 [bca.uk] INFO: Scrape type for DY65%20GUU: 2
2026-03-28 22:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 643d3b2e-5250-5805-9bd0-f3bd636bc3b6 with identifier: DY65%20GUU
2026-03-28 22:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 643d3b2e-5250-5805-9bd0-f3bd636bc3b6 with scrape type 2
2026-03-28 22:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 643d3b2e-5250-5805-9bd0-f3bd636bc3b6 with scrape type 2
2026-03-28 22:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 643d3b2e-5250-5805-9bd0-f3bd636bc3b6, identifier: DY65%20GUU
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176216%27 HTTP/1.1" 200 None
2026-03-28 22:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176216 not downloaded yet
2026-03-28 22:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a96950>
2026-03-28 22:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec532b91-2d62-5ebd-830b-087067e8ed90/ec532b91-2d62-5ebd-830b-087067e8ed90_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMW21AXB%252F698976086%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976086/600 saved to cache
2026-03-28 22:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec532b91-2d62-5ebd-830b-087067e8ed90
2026-03-28 22:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547137990>
2026-03-28 22:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a373065-9147-5214-8a56-d55636e4875e/7a373065-9147-5214-8a56-d55636e4875e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK65LPO%252F699253438%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253438/600 saved to cache
2026-03-28 22:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7a373065-9147-5214-8a56-d55636e4875e
2026-03-28 22:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010762/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ10XBR/42810460?sv=2020-08-04&st=2026-03-28T22%3A05%3A21Z&se=2026-03-28T22%3A30%3A21Z&sr=b&sp=r&sig=Omxs4vBf8IL8wES3JqTd9z%2FqnN52Fjw%2BOfzPET2vDTk%3D)
2026-03-28 22:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976128/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MW21AXB/42810470?sv=2020-08-04&st=2026-03-28T22%3A05%3A20Z&se=2026-03-28T22%3A30%3A20Z&sr=b&sp=r&sig=%2BrUdlzqIxAeDMjwos9mDVGiRE12qe2ahKjkgj9P6mZg%3D)
2026-03-28 22:05:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010873/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010873>
2026-03-28 22:05:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176163/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176163>
2026-03-28 22:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 643d3b2e-5250-5805-9bd0-f3bd636bc3b6 with identifier: DY65%20GUU
2026-03-28 22:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 643d3b2e-5250-5805-9bd0-f3bd636bc3b6 with identifier: DY65%20GUU
2026-03-28 22:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 643d3b2e-5250-5805-9bd0-f3bd636bc3b6 with identifier: DY65%20GUU to the API
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 98,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DY65%20GUU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '643d3b2e-5250-5805-9bd0-f3bd636bc3b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DY65 GUU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DY65%20GUU&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VAUXHALL',
'model': 'INSIGNIA',
'odometer': 103532,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VAUXHALL INSIGNIA 2.0 CDTI E/F 140 SRI Hatchback',
'transmission': 'manual',
'trim': 'CDTI E/F 140 SRI',
'vin': 'W0LGS6ES1F1024413',
'year': 2015}
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY65%2520GUU%27 HTTP/1.1" 200 None
2026-03-28 22:05:32 [bca.uk] INFO: Saving data for DY65%20GUU: {'auction_closing_time': 1774778400.0, 'created_time': 1774621987.869895, 'last_price_update_time': 1774735532.83203}
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DY65%2520GUU') HTTP/1.1" 204 0
2026-03-28 22:05:32 [bca.uk] INFO: Found listing with ID: SK20%20UEP
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK20%2520UEP%27 HTTP/1.1" 200 None
2026-03-28 22:05:32 [bca.uk] INFO: Scrape type for SK20%20UEP: 0
2026-03-28 22:05:32 [bca.uk] INFO: Found listing with ID: RE70%20JXR
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE70%2520JXR%27 HTTP/1.1" 200 None
2026-03-28 22:05:32 [bca.uk] INFO: Scrape type for RE70%20JXR: 0
2026-03-28 22:05:32 [bca.uk] INFO: Found listing with ID: GF20%20LKE
2026-03-28 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF20%2520LKE%27 HTTP/1.1" 200 None
2026-03-28 22:05:33 [bca.uk] INFO: Scrape type for GF20%20LKE: 0
2026-03-28 22:05:33 [bca.uk] INFO: Found listing with ID: SE68%20SDU
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE68%2520SDU%27 HTTP/1.1" 200 None
2026-03-28 22:05:33 [bca.uk] INFO: Scrape type for SE68%20SDU: 2
2026-03-28 22:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3efef238-e51a-526d-ba10-e8f193e1fbc2 with identifier: SE68%20SDU
2026-03-28 22:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3efef238-e51a-526d-ba10-e8f193e1fbc2 with scrape type 2
2026-03-28 22:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3efef238-e51a-526d-ba10-e8f193e1fbc2 with scrape type 2
2026-03-28 22:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3efef238-e51a-526d-ba10-e8f193e1fbc2, identifier: SE68%20SDU
2026-03-28 22:05:33 [bca.uk] INFO: Found listing with ID: GL16%20YMC
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL16%2520YMC%27 HTTP/1.1" 200 None
2026-03-28 22:05:33 [bca.uk] INFO: Scrape type for GL16%20YMC: 0
2026-03-28 22:05:33 [bca.uk] INFO: Found listing with ID: LA66%20BZK
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA66%2520BZK%27 HTTP/1.1" 200 None
2026-03-28 22:05:33 [bca.uk] INFO: Scrape type for LA66%20BZK: 2
2026-03-28 22:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02a70f53-7ea1-572c-a2f8-16066f0769d9 with identifier: LA66%20BZK
2026-03-28 22:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02a70f53-7ea1-572c-a2f8-16066f0769d9 with scrape type 2
2026-03-28 22:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02a70f53-7ea1-572c-a2f8-16066f0769d9 with scrape type 2
2026-03-28 22:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 02a70f53-7ea1-572c-a2f8-16066f0769d9, identifier: LA66%20BZK
2026-03-28 22:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3efef238-e51a-526d-ba10-e8f193e1fbc2 with identifier: SE68%20SDU
2026-03-28 22:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3efef238-e51a-526d-ba10-e8f193e1fbc2 with identifier: SE68%20SDU
2026-03-28 22:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3efef238-e51a-526d-ba10-e8f193e1fbc2 with identifier: SE68%20SDU to the API
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 96,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SE68%20SDU-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3efef238-e51a-526d-ba10-e8f193e1fbc2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SE68 SDU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SE68%20SDU&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'SEAT',
'model': 'MII',
'odometer': 61308,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'SEAT MII 1.0 DESIGN MII EZ Hatchback',
'transmission': 'manual',
'trim': 'DESIGN MII EZ',
'vin': 'VSSZZZAAZKD305737',
'year': 2019}
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE68%2520SDU%27 HTTP/1.1" 200 None
2026-03-28 22:05:33 [bca.uk] INFO: Saving data for SE68%20SDU: {'auction_closing_time': 1774864800.0, 'created_time': 1774437430.358563, 'last_price_update_time': 1774735533.549478}
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SE68%2520SDU') HTTP/1.1" 204 0
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176232%27 HTTP/1.1" 200 None
2026-03-28 22:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176232 not downloaded yet
2026-03-28 22:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010783/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ10XBR/42810460?sv=2020-08-04&st=2026-03-28T22%3A05%3A21Z&se=2026-03-28T22%3A30%3A21Z&sr=b&sp=r&sig=Omxs4vBf8IL8wES3JqTd9z%2FqnN52Fjw%2BOfzPET2vDTk%3D)
2026-03-28 22:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ20UMA/42810780?sv=2020-08-04&st=2026-03-28T22%3A05%3A32Z&se=2026-03-28T22%3A30%3A32Z&sr=b&sp=r&sig=bOMtVseDP5%2B4q3gO7UJt%2FRZXlewTKJ%2F8pF1iERt4wLA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ20%20UMA-GB>
2026-03-28 22:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 02a70f53-7ea1-572c-a2f8-16066f0769d9 with identifier: LA66%20BZK
2026-03-28 22:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 02a70f53-7ea1-572c-a2f8-16066f0769d9 with identifier: LA66%20BZK
2026-03-28 22:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 02a70f53-7ea1-572c-a2f8-16066f0769d9 with identifier: LA66%20BZK to the API
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LA66%20BZK-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '02a70f53-7ea1-572c-a2f8-16066f0769d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LA66 BZK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LA66%20BZK&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'KA+',
'odometer': 84771,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'FORD KA+ 1.2 85 ZETEC Hatchback',
'transmission': 'manual',
'trim': '85 ZETEC',
'vin': 'MAJUXXMTKUGS43834',
'year': 2017}
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA66%2520BZK%27 HTTP/1.1" 200 None
2026-03-28 22:05:33 [bca.uk] INFO: Saving data for LA66%20BZK: {'auction_closing_time': 1774778400.0, 'created_time': 1774622195.441888, 'last_price_update_time': 1774735533.918828}
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LA66%2520BZK') HTTP/1.1" 204 0
2026-03-28 22:05:33 [bca.uk] INFO: Found listing with ID: SJ72%20MDX
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ72%2520MDX%27 HTTP/1.1" 200 None
2026-03-28 22:05:33 [bca.uk] INFO: Scrape type for SJ72%20MDX: 0
2026-03-28 22:05:33 [bca.uk] INFO: Found listing with ID: DG69%20VJO
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG69%2520VJO%27 HTTP/1.1" 200 None
2026-03-28 22:05:33 [bca.uk] INFO: Scrape type for DG69%20VJO: 0
2026-03-28 22:05:33 [bca.uk] INFO: Found listing with ID: SC19%20XGB
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC19%2520XGB%27 HTTP/1.1" 200 None
2026-03-28 22:05:33 [bca.uk] INFO: Scrape type for SC19%20XGB: 0
2026-03-28 22:05:33 [bca.uk] INFO: Found listing with ID: CE19%20UGD
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE19%2520UGD%27 HTTP/1.1" 200 None
2026-03-28 22:05:34 [bca.uk] INFO: Scrape type for CE19%20UGD: 1
2026-03-28 22:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2785a6e-33af-5eba-b84f-311143aa78be with identifier: CE19%20UGD
2026-03-28 22:05:34 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e2785a6e-33af-5eba-b84f-311143aa78be
2026-03-28 22:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473e8c10>
2026-03-28 22:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a373065-9147-5214-8a56-d55636e4875e/7a373065-9147-5214-8a56-d55636e4875e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK65LPO%252F699253445%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253445/600 saved to cache
2026-03-28 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7a373065-9147-5214-8a56-d55636e4875e
2026-03-28 22:05:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477ecbd0>
2026-03-28 22:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff2a82d-f7ab-592a-a781-86aaae91d694/6ff2a82d-f7ab-592a-a781-86aaae91d694_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB11OWR%252F699246138%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246138/600 saved to cache
2026-03-28 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6ff2a82d-f7ab-592a-a781-86aaae91d694
2026-03-28 22:05:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471ac910>
2026-03-28 22:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9700af5-622f-5b72-9af3-28e1d8f91693/b9700af5-622f-5b72-9af3-28e1d8f91693_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPFZ8482%252F699252904%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252904/600 saved to cache
2026-03-28 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b9700af5-622f-5b72-9af3-28e1d8f91693
2026-03-28 22:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554494a90>
2026-03-28 22:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08149aa9-acd8-5621-afc9-de796506b5b4/08149aa9-acd8-5621-afc9-de796506b5b4_expert_report_file_cc4531de-4ddf-42af-85e8-0a538aa00418.pdf HTTP/1.1" 201 0
2026-03-28 22:05:34 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 08149aa9-acd8-5621-afc9-de796506b5b4
2026-03-28 22:05:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08149aa9-acd8-5621-afc9-de796506b5b4, skipping ID generation
2026-03-28 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 08149aa9-acd8-5621-afc9-de796506b5b4
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYD13TWN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YD13TWN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544b4bd0>
2026-03-28 22:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_976f1540-41c9-5853-a520-2191352412f3/976f1540-41c9-5853-a520-2191352412f3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ10XBR%252F699010742%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010742/600 saved to cache
2026-03-28 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 976f1540-41c9-5853-a520-2191352412f3
2026-03-28 22:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a04f50>
2026-03-28 22:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_976f1540-41c9-5853-a520-2191352412f3/976f1540-41c9-5853-a520-2191352412f3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ10XBR%252F699010723%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010723/600 saved to cache
2026-03-28 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 976f1540-41c9-5853-a520-2191352412f3
2026-03-28 22:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176153/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO62FPD/42810887?sv=2020-08-04&st=2026-03-28T22%3A05%3A24Z&se=2026-03-28T22%3A30%3A24Z&sr=b&sp=r&sig=P8NCpVvkz1uu7oEXsd9E3ohiNsPp4GVfqPmDLbXubx8%3D)
2026-03-28 22:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176185/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176185>
2026-03-28 22:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010930/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010930>
2026-03-28 22:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176173/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176173>
2026-03-28 22:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976177/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MW21AXB/42810470?sv=2020-08-04&st=2026-03-28T22%3A05%3A20Z&se=2026-03-28T22%3A30%3A20Z&sr=b&sp=r&sig=%2BrUdlzqIxAeDMjwos9mDVGiRE12qe2ahKjkgj9P6mZg%3D)
2026-03-28 22:05:34 [bca.uk] INFO: Found listing with ID: LO65%20WNU
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO65%2520WNU%27 HTTP/1.1" 200 None
2026-03-28 22:05:34 [bca.uk] INFO: Scrape type for LO65%20WNU: 0
2026-03-28 22:05:34 [bca.uk] INFO: Found listing with ID: ND16%20NYV
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND16%2520NYV%27 HTTP/1.1" 200 None
2026-03-28 22:05:34 [bca.uk] INFO: Scrape type for ND16%20NYV: 2
2026-03-28 22:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 010e0ec1-155a-58de-ad24-ddab40f4de30 with identifier: ND16%20NYV
2026-03-28 22:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 010e0ec1-155a-58de-ad24-ddab40f4de30 with scrape type 2
2026-03-28 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 010e0ec1-155a-58de-ad24-ddab40f4de30 with scrape type 2
2026-03-28 22:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 010e0ec1-155a-58de-ad24-ddab40f4de30, identifier: ND16%20NYV
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176252%27 HTTP/1.1" 200 None
2026-03-28 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176252 not downloaded yet
2026-03-28 22:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML09TVX/42810920?sv=2020-08-04&st=2026-03-28T22%3A05%3A29Z&se=2026-03-28T22%3A30%3A29Z&sr=b&sp=r&sig=3CS5OP6y37ZBf1km95kjXxQgZGTyyd1Q098%2Fto%2FWbZ0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 010e0ec1-155a-58de-ad24-ddab40f4de30 with identifier: ND16%20NYV
2026-03-28 22:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 010e0ec1-155a-58de-ad24-ddab40f4de30 with identifier: ND16%20NYV
2026-03-28 22:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 010e0ec1-155a-58de-ad24-ddab40f4de30 with identifier: ND16%20NYV to the API
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND16%20NYV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '010e0ec1-155a-58de-ad24-ddab40f4de30',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ND16 NYV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ND16%20NYV&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'PEUGEOT',
'model': '208',
'odometer': 87885,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'PEUGEOT 208 1.2 P/T 82 ACTIVE Hatchback',
'transmission': 'manual',
'trim': 'P/T 82 ACTIVE',
'vin': 'VF3CCHMZ6GT043501',
'year': 2016}
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND16%2520NYV%27 HTTP/1.1" 200 None
2026-03-28 22:05:34 [bca.uk] INFO: Saving data for ND16%20NYV: {'auction_closing_time': 1774778400.0, 'created_time': 1774437688.251434, 'last_price_update_time': 1774735534.905397}
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ND16%2520NYV') HTTP/1.1" 204 0
2026-03-28 22:05:35 [bca.uk] INFO: Found listing with ID: BG70%20GGP
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG70%2520GGP%27 HTTP/1.1" 200 None
2026-03-28 22:05:35 [bca.uk] INFO: Scrape type for BG70%20GGP: 0
2026-03-28 22:05:35 [bca.uk] INFO: Found listing with ID: SN21%20AHB
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN21%2520AHB%27 HTTP/1.1" 200 None
2026-03-28 22:05:35 [bca.uk] INFO: Scrape type for SN21%20AHB: 0
2026-03-28 22:05:35 [bca.uk] INFO: Found listing with ID: CN22%20SLU
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN22%2520SLU%27 HTTP/1.1" 200 None
2026-03-28 22:05:35 [bca.uk] INFO: Scrape type for CN22%20SLU: 1
2026-03-28 22:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b95ec648-e27a-5a47-b460-f09e07adbbeb with identifier: CN22%20SLU
2026-03-28 22:05:35 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b95ec648-e27a-5a47-b460-f09e07adbbeb
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176550%27 HTTP/1.1" 200 None
2026-03-28 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176550 not downloaded yet
2026-03-28 22:05:35 [bca.uk] INFO: Found listing with ID: OE14%20RHA
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE14%2520RHA%27 HTTP/1.1" 200 None
2026-03-28 22:05:35 [bca.uk] INFO: Scrape type for OE14%20RHA: 2
2026-03-28 22:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94034e61-94d1-5f50-a666-6c5578a09ca2 with identifier: OE14%20RHA
2026-03-28 22:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94034e61-94d1-5f50-a666-6c5578a09ca2 with scrape type 2
2026-03-28 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94034e61-94d1-5f50-a666-6c5578a09ca2 with scrape type 2
2026-03-28 22:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 94034e61-94d1-5f50-a666-6c5578a09ca2, identifier: OE14%20RHA
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176267%27 HTTP/1.1" 200 None
2026-03-28 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176267 not downloaded yet
2026-03-28 22:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543ddbd0>
2026-03-28 22:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_976f1540-41c9-5853-a520-2191352412f3/976f1540-41c9-5853-a520-2191352412f3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ10XBR%252F699010762%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010762/600 saved to cache
2026-03-28 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 976f1540-41c9-5853-a520-2191352412f3
2026-03-28 22:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55438e290>
2026-03-28 22:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec532b91-2d62-5ebd-830b-087067e8ed90/ec532b91-2d62-5ebd-830b-087067e8ed90_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMW21AXB%252F698976128%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976128/600 saved to cache
2026-03-28 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec532b91-2d62-5ebd-830b-087067e8ed90
2026-03-28 22:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473953d0>
2026-03-28 22:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_976f1540-41c9-5853-a520-2191352412f3/976f1540-41c9-5853-a520-2191352412f3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ10XBR%252F699010783%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010783/600 saved to cache
2026-03-28 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 976f1540-41c9-5853-a520-2191352412f3
2026-03-28 22:05:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176199/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176199>
2026-03-28 22:05:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA08JSV/42810825?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=U0wXwnmUHBvUuIYY%2ByLlbm%2FfPTDnQQS8jjz532gBcFY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YA08%20JSV-GB>
2026-03-28 22:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176163/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO62FPD/42810887?sv=2020-08-04&st=2026-03-28T22%3A05%3A24Z&se=2026-03-28T22%3A30%3A24Z&sr=b&sp=r&sig=P8NCpVvkz1uu7oEXsd9E3ohiNsPp4GVfqPmDLbXubx8%3D)
2026-03-28 22:05:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010958/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010958>
2026-03-28 22:05:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF68PYB/42810634?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=Qnbhc%2F3Nk5rBw4e6MkVvsnHTegd%2BbIJ4VYeule%2Bchng%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PF68%20PYB-GB>
2026-03-28 22:05:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL71EGE/42810664?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=9jRkf4Wr%2B%2FWN%2B1GfIm%2BRv9CJsfAX3NU6%2B1LwAsEPOgc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FL71%20EGE-GB>
2026-03-28 22:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 94034e61-94d1-5f50-a666-6c5578a09ca2 with identifier: OE14%20RHA
2026-03-28 22:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 94034e61-94d1-5f50-a666-6c5578a09ca2 with identifier: OE14%20RHA
2026-03-28 22:05:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 94034e61-94d1-5f50-a666-6c5578a09ca2 with identifier: OE14%20RHA to the API
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OE14%20RHA-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '94034e61-94d1-5f50-a666-6c5578a09ca2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OE14 RHA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OE14%20RHA&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'C-MAX',
'odometer': 70721,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD C-MAX 1.6 TDCI 115 ZETEC MPV',
'transmission': 'manual',
'trim': 'TDCI 115 ZETEC',
'vin': 'WF0JXXWPBJEU05953',
'year': 2014}
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE14%2520RHA%27 HTTP/1.1" 200 None
2026-03-28 22:05:35 [bca.uk] INFO: Saving data for OE14%20RHA: {'auction_closing_time': 1774778400.0, 'created_time': 1774622194.798451, 'last_price_update_time': 1774735535.705211}
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OE14%2520RHA') HTTP/1.1" 204 0
2026-03-28 22:05:35 [bca.uk] INFO: Found listing with ID: DP69%20NZK
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP69%2520NZK%27 HTTP/1.1" 200 None
2026-03-28 22:05:35 [bca.uk] INFO: Scrape type for DP69%20NZK: 0
2026-03-28 22:05:35 [bca.uk] INFO: Found listing with ID: HK73%20EWD
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK73%2520EWD%27 HTTP/1.1" 200 None
2026-03-28 22:05:35 [bca.uk] INFO: Scrape type for HK73%20EWD: 1
2026-03-28 22:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e39c955-50ed-58e2-b150-dec2ff78b99f with identifier: HK73%20EWD
2026-03-28 22:05:35 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8e39c955-50ed-58e2-b150-dec2ff78b99f
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176556%27 HTTP/1.1" 200 None
2026-03-28 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176556 not downloaded yet
2026-03-28 22:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010873/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ10XBR/42810460?sv=2020-08-04&st=2026-03-28T22%3A05%3A21Z&se=2026-03-28T22%3A30%3A21Z&sr=b&sp=r&sig=Omxs4vBf8IL8wES3JqTd9z%2FqnN52Fjw%2BOfzPET2vDTk%3D)
2026-03-28 22:05:35 [bca.uk] INFO: Found listing with ID: OV67%20VJU
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV67%2520VJU%27 HTTP/1.1" 200 None
2026-03-28 22:05:35 [bca.uk] INFO: Scrape type for OV67%20VJU: 1
2026-03-28 22:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68511f88-68fc-5ac1-befe-453b6775c3b3 with identifier: OV67%20VJU
2026-03-28 22:05:35 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 68511f88-68fc-5ac1-befe-453b6775c3b3
2026-03-28 22:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554395f90>
2026-03-28 22:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33f95c1b-3436-504d-8243-b3c29aca56a3/33f95c1b-3436-504d-8243-b3c29aca56a3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO62FPD%252F699176153%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176153/600 saved to cache
2026-03-28 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 33f95c1b-3436-504d-8243-b3c29aca56a3
2026-03-28 22:05:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554319a10>
2026-03-28 22:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec532b91-2d62-5ebd-830b-087067e8ed90/ec532b91-2d62-5ebd-830b-087067e8ed90_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMW21AXB%252F698976177%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976177/600 saved to cache
2026-03-28 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ec532b91-2d62-5ebd-830b-087067e8ed90
2026-03-28 22:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b5f10>
2026-03-28 22:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d1bd1b-e75f-5786-8613-977c6a06c247/79d1bd1b-e75f-5786-8613-977c6a06c247_expert_report_file_e4a87ddb-e28e-48f9-8f5b-8e8606f29ec7.pdf HTTP/1.1" 201 0
2026-03-28 22:05:35 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 79d1bd1b-e75f-5786-8613-977c6a06c247
2026-03-28 22:05:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79d1bd1b-e75f-5786-8613-977c6a06c247, skipping ID generation
2026-03-28 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79d1bd1b-e75f-5786-8613-977c6a06c247
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DML09TVX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ML09TVX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010907/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010907>
2026-03-28 22:05:35 [bca.uk] INFO: Found listing with ID: MJ20%20EEG
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ20%2520EEG%27 HTTP/1.1" 200 None
2026-03-28 22:05:36 [bca.uk] INFO: Scrape type for MJ20%20EEG: 0
2026-03-28 22:05:36 [bca.uk] INFO: Found listing with ID: WD72%20JHL
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD72%2520JHL%27 HTTP/1.1" 200 None
2026-03-28 22:05:36 [bca.uk] INFO: Scrape type for WD72%20JHL: 1
2026-03-28 22:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d06042a9-4183-5322-b0e5-834acfc52d31 with identifier: WD72%20JHL
2026-03-28 22:05:36 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d06042a9-4183-5322-b0e5-834acfc52d31
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176562%27 HTTP/1.1" 200 None
2026-03-28 22:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176562 not downloaded yet
2026-03-28 22:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176173/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO62FPD/42810887?sv=2020-08-04&st=2026-03-28T22%3A05%3A24Z&se=2026-03-28T22%3A30%3A24Z&sr=b&sp=r&sig=P8NCpVvkz1uu7oEXsd9E3ohiNsPp4GVfqPmDLbXubx8%3D)
2026-03-28 22:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176185/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO62FPD/42810887?sv=2020-08-04&st=2026-03-28T22%3A05%3A24Z&se=2026-03-28T22%3A30%3A24Z&sr=b&sp=r&sig=P8NCpVvkz1uu7oEXsd9E3ohiNsPp4GVfqPmDLbXubx8%3D)
2026-03-28 22:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176232/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176232>
2026-03-28 22:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176216/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176216>
2026-03-28 22:05:36 [bca.uk] INFO: Found listing with ID: RV64%20OCF
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV64%2520OCF%27 HTTP/1.1" 200 None
2026-03-28 22:05:36 [bca.uk] INFO: Scrape type for RV64%20OCF: 2
2026-03-28 22:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbfe66e3-f302-52a8-a856-8f2f75ea0987 with identifier: RV64%20OCF
2026-03-28 22:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbfe66e3-f302-52a8-a856-8f2f75ea0987 with scrape type 2
2026-03-28 22:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbfe66e3-f302-52a8-a856-8f2f75ea0987 with scrape type 2
2026-03-28 22:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bbfe66e3-f302-52a8-a856-8f2f75ea0987, identifier: RV64%20OCF
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145665%27 HTTP/1.1" 200 None
2026-03-28 22:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145665 not downloaded yet
2026-03-28 22:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010930/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ10XBR/42810460?sv=2020-08-04&st=2026-03-28T22%3A05%3A21Z&se=2026-03-28T22%3A30%3A21Z&sr=b&sp=r&sig=Omxs4vBf8IL8wES3JqTd9z%2FqnN52Fjw%2BOfzPET2vDTk%3D)
2026-03-28 22:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bbfe66e3-f302-52a8-a856-8f2f75ea0987 with identifier: RV64%20OCF
2026-03-28 22:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bbfe66e3-f302-52a8-a856-8f2f75ea0987 with identifier: RV64%20OCF
2026-03-28 22:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bbfe66e3-f302-52a8-a856-8f2f75ea0987 with identifier: RV64%20OCF to the API
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RV64%20OCF-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bbfe66e3-f302-52a8-a856-8f2f75ea0987',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RV64 OCF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RV64%20OCF&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 79486,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 125 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 ZETEC',
'vin': 'WF0KXXGCBKEM34743',
'year': 2014}
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV64%2520OCF%27 HTTP/1.1" 200 None
2026-03-28 22:05:36 [bca.uk] INFO: Saving data for RV64%20OCF: {'auction_closing_time': 1774778400.0, 'created_time': 1774622063.443004, 'last_price_update_time': 1774735536.561521}
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RV64%2520OCF') HTTP/1.1" 204 0
2026-03-28 22:05:36 [bca.uk] INFO: Found listing with ID: WP20%20GXG
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP20%2520GXG%27 HTTP/1.1" 200 None
2026-03-28 22:05:36 [bca.uk] INFO: Scrape type for WP20%20GXG: 2
2026-03-28 22:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f9db565-2af9-5a3f-b34f-bc261fd13a67 with identifier: WP20%20GXG
2026-03-28 22:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f9db565-2af9-5a3f-b34f-bc261fd13a67 with scrape type 2
2026-03-28 22:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f9db565-2af9-5a3f-b34f-bc261fd13a67 with scrape type 2
2026-03-28 22:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2f9db565-2af9-5a3f-b34f-bc261fd13a67, identifier: WP20%20GXG
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176568%27 HTTP/1.1" 200 None
2026-03-28 22:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176568 not downloaded yet
2026-03-28 22:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554495d10>
2026-03-28 22:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33f95c1b-3436-504d-8243-b3c29aca56a3/33f95c1b-3436-504d-8243-b3c29aca56a3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO62FPD%252F699176163%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176163/600 saved to cache
2026-03-28 22:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 33f95c1b-3436-504d-8243-b3c29aca56a3
2026-03-28 22:05:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554271c10>
2026-03-28 22:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_976f1540-41c9-5853-a520-2191352412f3/976f1540-41c9-5853-a520-2191352412f3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ10XBR%252F699010873%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010873/600 saved to cache
2026-03-28 22:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 976f1540-41c9-5853-a520-2191352412f3
2026-03-28 22:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE05WVK/42811009?sv=2020-08-04&st=2026-03-28T22%3A05%3A36Z&se=2026-03-28T22%3A30%3A36Z&sr=b&sp=r&sig=mupgw8rLb3y7HRkTTcsDAEi9vH9L04U4rd3rmNORr9c%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PE05%20WVK-GB>
2026-03-28 22:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176252/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176252>
2026-03-28 22:05:36 [bca.uk] INFO: Found listing with ID: ST64%20XKB
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST64%2520XKB%27 HTTP/1.1" 200 None
2026-03-28 22:05:36 [bca.uk] INFO: Scrape type for ST64%20XKB: 0
2026-03-28 22:05:36 [bca.uk] INFO: Found listing with ID: MJ18%20UDV
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ18%2520UDV%27 HTTP/1.1" 200 None
2026-03-28 22:05:36 [bca.uk] INFO: Scrape type for MJ18%20UDV: 1
2026-03-28 22:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e282d348-5eb7-5636-8bba-650d60f1c196 with identifier: MJ18%20UDV
2026-03-28 22:05:36 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e282d348-5eb7-5636-8bba-650d60f1c196
2026-03-28 22:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2f9db565-2af9-5a3f-b34f-bc261fd13a67 with identifier: WP20%20GXG
2026-03-28 22:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2f9db565-2af9-5a3f-b34f-bc261fd13a67 with identifier: WP20%20GXG
2026-03-28 22:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2f9db565-2af9-5a3f-b34f-bc261fd13a67 with identifier: WP20%20GXG to the API
2026-03-28 22:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 166,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WP20%20GXG-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2f9db565-2af9-5a3f-b34f-bc261fd13a67',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WP20 GXG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WP20%20GXG&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'VOLKSWAGEN',
'model': 'TIGUAN ALLSPACE',
'odometer': 62871,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN ALLSPACE 2.0 TDI SCR 150 2WD MATCH DSG '
'StationWagon',
'transmission': 'automatic',
'trim': 'TDI SCR 150 2WD MATCH DSG',
'vin': 'WVGZZZ5NZLM134919',
'year': 2020}
2026-03-28 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP20%2520GXG%27 HTTP/1.1" 200 None
2026-03-28 22:05:37 [bca.uk] INFO: Saving data for WP20%20GXG: {'auction_closing_time': 1774864800.0, 'created_time': 1774621736.438024, 'last_price_update_time': 1774735537.267357}
2026-03-28 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WP20%2520GXG') HTTP/1.1" 204 0
2026-03-28 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145671%27 HTTP/1.1" 200 None
2026-03-28 22:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145671 not downloaded yet
2026-03-28 22:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ20UMA/42810780?sv=2020-08-04&st=2026-03-28T22%3A05%3A32Z&se=2026-03-28T22%3A30%3A32Z&sr=b&sp=r&sig=bOMtVseDP5%2B4q3gO7UJt%2FRZXlewTKJ%2F8pF1iERt4wLA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:37 [bca.uk] INFO: Found listing with ID: MT69%20XJO
2026-03-28 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT69%2520XJO%27 HTTP/1.1" 200 None
2026-03-28 22:05:37 [bca.uk] INFO: Scrape type for MT69%20XJO: 2
2026-03-28 22:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 077175b3-5b3c-5809-a84a-d5bd71dee8fa with identifier: MT69%20XJO
2026-03-28 22:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 077175b3-5b3c-5809-a84a-d5bd71dee8fa with scrape type 2
2026-03-28 22:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 077175b3-5b3c-5809-a84a-d5bd71dee8fa with scrape type 2
2026-03-28 22:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 077175b3-5b3c-5809-a84a-d5bd71dee8fa, identifier: MT69%20XJO
2026-03-28 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176575%27 HTTP/1.1" 200 None
2026-03-28 22:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176575 not downloaded yet
2026-03-28 22:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176199/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO62FPD/42810887?sv=2020-08-04&st=2026-03-28T22%3A05%3A24Z&se=2026-03-28T22%3A30%3A24Z&sr=b&sp=r&sig=P8NCpVvkz1uu7oEXsd9E3ohiNsPp4GVfqPmDLbXubx8%3D)
2026-03-28 22:05:37 [bca.uk] INFO: Found listing with ID: GU70%20SXD
2026-03-28 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU70%2520SXD%27 HTTP/1.1" 200 None
2026-03-28 22:05:37 [bca.uk] INFO: Scrape type for GU70%20SXD: 1
2026-03-28 22:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9eb7897-258a-53be-b988-82acf7b5019f with identifier: GU70%20SXD
2026-03-28 22:05:37 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c9eb7897-258a-53be-b988-82acf7b5019f
2026-03-28 22:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 077175b3-5b3c-5809-a84a-d5bd71dee8fa with identifier: MT69%20XJO
2026-03-28 22:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 077175b3-5b3c-5809-a84a-d5bd71dee8fa with identifier: MT69%20XJO
2026-03-28 22:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 077175b3-5b3c-5809-a84a-d5bd71dee8fa with identifier: MT69%20XJO to the API
2026-03-28 22:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 103,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT69%20XJO-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '077175b3-5b3c-5809-a84a-d5bd71dee8fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT69 XJO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT69%20XJO&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 47413,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'NISSAN MICRA 1.0 IG-T 100 TEKNA Hatchback',
'transmission': 'manual',
'trim': 'IG-T 100 TEKNA',
'vin': 'VNVK1400863791120',
'year': 2019}
2026-03-28 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT69%2520XJO%27 HTTP/1.1" 200 None
2026-03-28 22:05:37 [bca.uk] INFO: Saving data for MT69%20XJO: {'auction_closing_time': 1774864800.0, 'created_time': 1774391385.61558, 'last_price_update_time': 1774735537.953561}
2026-03-28 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT69%2520XJO') HTTP/1.1" 204 0
2026-03-28 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145679%27 HTTP/1.1" 200 None
2026-03-28 22:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145679 not downloaded yet
2026-03-28 22:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5476d4b10>
2026-03-28 22:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33f95c1b-3436-504d-8243-b3c29aca56a3/33f95c1b-3436-504d-8243-b3c29aca56a3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO62FPD%252F699176173%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176173/600 saved to cache
2026-03-28 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 33f95c1b-3436-504d-8243-b3c29aca56a3
2026-03-28 22:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a8d890>
2026-03-28 22:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33f95c1b-3436-504d-8243-b3c29aca56a3/33f95c1b-3436-504d-8243-b3c29aca56a3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO62FPD%252F699176185%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176185/600 saved to cache
2026-03-28 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 33f95c1b-3436-504d-8243-b3c29aca56a3
2026-03-28 22:05:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55480bfd0>
2026-03-28 22:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_976f1540-41c9-5853-a520-2191352412f3/976f1540-41c9-5853-a520-2191352412f3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ10XBR%252F699010930%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010930/600 saved to cache
2026-03-28 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 976f1540-41c9-5853-a520-2191352412f3
2026-03-28 22:05:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176267/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176267>
2026-03-28 22:05:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176550/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176550>
2026-03-28 22:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010958/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ10XBR/42810460?sv=2020-08-04&st=2026-03-28T22%3A05%3A21Z&se=2026-03-28T22%3A30%3A21Z&sr=b&sp=r&sig=Omxs4vBf8IL8wES3JqTd9z%2FqnN52Fjw%2BOfzPET2vDTk%3D)
2026-03-28 22:05:38 [bca.uk] INFO: Found listing with ID: SW70%20EHR
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW70%2520EHR%27 HTTP/1.1" 200 None
2026-03-28 22:05:38 [bca.uk] INFO: Scrape type for SW70%20EHR: 0
2026-03-28 22:05:38 [bca.uk] INFO: Found listing with ID: PK70%20ULM
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK70%2520ULM%27 HTTP/1.1" 200 None
2026-03-28 22:05:38 [bca.uk] INFO: Scrape type for PK70%20ULM: 2
2026-03-28 22:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f00e19f0-99e9-5dc5-858f-2fe00b0b70a0 with identifier: PK70%20ULM
2026-03-28 22:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f00e19f0-99e9-5dc5-858f-2fe00b0b70a0 with scrape type 2
2026-03-28 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f00e19f0-99e9-5dc5-858f-2fe00b0b70a0 with scrape type 2
2026-03-28 22:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f00e19f0-99e9-5dc5-858f-2fe00b0b70a0, identifier: PK70%20ULM
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176584%27 HTTP/1.1" 200 None
2026-03-28 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176584 not downloaded yet
2026-03-28 22:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL71EGE/42810664?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=9jRkf4Wr%2B%2FWN%2B1GfIm%2BRv9CJsfAX3NU6%2B1LwAsEPOgc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF68PYB/42810634?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=Qnbhc%2F3Nk5rBw4e6MkVvsnHTegd%2BbIJ4VYeule%2Bchng%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:38 [bca.uk] INFO: Found listing with ID: L4%20VSX
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L4%2520VSX%27 HTTP/1.1" 200 None
2026-03-28 22:05:38 [bca.uk] INFO: Scrape type for L4%20VSX: 1
2026-03-28 22:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70ca5cba-185e-521d-a3da-10f6c18734b3 with identifier: L4%20VSX
2026-03-28 22:05:38 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 70ca5cba-185e-521d-a3da-10f6c18734b3
2026-03-28 22:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f00e19f0-99e9-5dc5-858f-2fe00b0b70a0 with identifier: PK70%20ULM
2026-03-28 22:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f00e19f0-99e9-5dc5-858f-2fe00b0b70a0 with identifier: PK70%20ULM
2026-03-28 22:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f00e19f0-99e9-5dc5-858f-2fe00b0b70a0 with identifier: PK70%20ULM to the API
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 127,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PK70%20ULM-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f00e19f0-99e9-5dc5-858f-2fe00b0b70a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PK70 ULM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PK70%20ULM&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'FORD',
'model': 'PUMA',
'odometer': 21867,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'FORD PUMA 1.0 E/B MHEV 125 ST-LINE X Hatchback',
'transmission': 'manual',
'trim': 'E/B MHEV 125 ST-LINE X',
'vin': 'WF02XXERK2LY04457',
'year': 2020}
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK70%2520ULM%27 HTTP/1.1" 200 None
2026-03-28 22:05:38 [bca.uk] INFO: Saving data for PK70%20ULM: {'auction_closing_time': 1774864800.0, 'created_time': 1774621735.691252, 'last_price_update_time': 1774735538.613486}
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PK70%2520ULM') HTTP/1.1" 204 0
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145686%27 HTTP/1.1" 200 None
2026-03-28 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145686 not downloaded yet
2026-03-28 22:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010907/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ10XBR/42810460?sv=2020-08-04&st=2026-03-28T22%3A05%3A21Z&se=2026-03-28T22%3A30%3A21Z&sr=b&sp=r&sig=Omxs4vBf8IL8wES3JqTd9z%2FqnN52Fjw%2BOfzPET2vDTk%3D)
2026-03-28 22:05:38 [bca.uk] INFO: Found listing with ID: YD20%20LRV
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD20%2520LRV%27 HTTP/1.1" 200 None
2026-03-28 22:05:38 [bca.uk] INFO: Scrape type for YD20%20LRV: 2
2026-03-28 22:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d5b8146-b8bd-5296-87ea-e6038cf022b0 with identifier: YD20%20LRV
2026-03-28 22:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d5b8146-b8bd-5296-87ea-e6038cf022b0 with scrape type 2
2026-03-28 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d5b8146-b8bd-5296-87ea-e6038cf022b0 with scrape type 2
2026-03-28 22:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7d5b8146-b8bd-5296-87ea-e6038cf022b0, identifier: YD20%20LRV
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176592%27 HTTP/1.1" 200 None
2026-03-28 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176592 not downloaded yet
2026-03-28 22:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477e7290>
2026-03-28 22:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_182b028b-defa-51b3-b97c-bb87ff17eb7b/182b028b-defa-51b3-b97c-bb87ff17eb7b_expert_report_file_94692ad0-8cdb-48c9-8539-672bdbbaee28.pdf HTTP/1.1" 201 0
2026-03-28 22:05:38 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 182b028b-defa-51b3-b97c-bb87ff17eb7b
2026-03-28 22:05:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 182b028b-defa-51b3-b97c-bb87ff17eb7b, skipping ID generation
2026-03-28 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 182b028b-defa-51b3-b97c-bb87ff17eb7b
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGJ20UMA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GJ20UMA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547719790>
2026-03-28 22:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33f95c1b-3436-504d-8243-b3c29aca56a3/33f95c1b-3436-504d-8243-b3c29aca56a3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO62FPD%252F699176199%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176199/600 saved to cache
2026-03-28 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 33f95c1b-3436-504d-8243-b3c29aca56a3
2026-03-28 22:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176232/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO62FPD/42810887?sv=2020-08-04&st=2026-03-28T22%3A05%3A24Z&se=2026-03-28T22%3A30%3A24Z&sr=b&sp=r&sig=P8NCpVvkz1uu7oEXsd9E3ohiNsPp4GVfqPmDLbXubx8%3D)
2026-03-28 22:05:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD72JHL/42807865?sv=2020-08-04&st=2026-03-28T22%3A05%3A38Z&se=2026-03-28T22%3A30%3A38Z&sr=b&sp=r&sig=wwsnAuuWBNQzl1pmQDzNNycU4Ea5d5vZNz1D45DsB2o%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WD72%20JHL-GB>
2026-03-28 22:05:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176562/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176562>
2026-03-28 22:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176216/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO62FPD/42810887?sv=2020-08-04&st=2026-03-28T22%3A05%3A24Z&se=2026-03-28T22%3A30%3A24Z&sr=b&sp=r&sig=P8NCpVvkz1uu7oEXsd9E3ohiNsPp4GVfqPmDLbXubx8%3D)
2026-03-28 22:05:38 [bca.uk] INFO: Found listing with ID: LR70%20AHN
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR70%2520AHN%27 HTTP/1.1" 200 None
2026-03-28 22:05:38 [bca.uk] INFO: Scrape type for LR70%20AHN: 0
2026-03-28 22:05:38 [bca.uk] INFO: Found listing with ID: GV69%20EKK
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV69%2520EKK%27 HTTP/1.1" 200 None
2026-03-28 22:05:38 [bca.uk] INFO: Scrape type for GV69%20EKK: 0
2026-03-28 22:05:38 [bca.uk] INFO: Found listing with ID: EJ14%20PYU
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ14%2520PYU%27 HTTP/1.1" 200 None
2026-03-28 22:05:38 [bca.uk] INFO: Scrape type for EJ14%20PYU: 1
2026-03-28 22:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2faac3c-f66f-5c6b-825e-332b835cca02 with identifier: EJ14%20PYU
2026-03-28 22:05:38 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c2faac3c-f66f-5c6b-825e-332b835cca02
2026-03-28 22:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7d5b8146-b8bd-5296-87ea-e6038cf022b0 with identifier: YD20%20LRV
2026-03-28 22:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7d5b8146-b8bd-5296-87ea-e6038cf022b0 with identifier: YD20%20LRV
2026-03-28 22:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7d5b8146-b8bd-5296-87ea-e6038cf022b0 with identifier: YD20%20LRV to the API
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD20%20LRV-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7d5b8146-b8bd-5296-87ea-e6038cf022b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YD20 LRV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YD20%20LRV&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 29676,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.0 DIG-T 115 TEKNA Hatchback',
'transmission': 'manual',
'trim': 'DIG-T 115 TEKNA',
'vin': 'SJNFAAF16U1031340',
'year': 2020}
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD20%2520LRV%27 HTTP/1.1" 200 None
2026-03-28 22:05:39 [bca.uk] INFO: Saving data for YD20%20LRV: {'auction_closing_time': 1774864800.0, 'created_time': 1774436747.279805, 'last_price_update_time': 1774735539.398084}
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YD20%2520LRV') HTTP/1.1" 204 0
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145694%27 HTTP/1.1" 200 None
2026-03-28 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145694 not downloaded yet
2026-03-28 22:05:39 [bca.uk] INFO: Found listing with ID: DN20%20ENC
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN20%2520ENC%27 HTTP/1.1" 200 None
2026-03-28 22:05:39 [bca.uk] INFO: Scrape type for DN20%20ENC: 1
2026-03-28 22:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85b056c6-c0d6-5d9f-8894-629a1e21efb8 with identifier: DN20%20ENC
2026-03-28 22:05:39 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 85b056c6-c0d6-5d9f-8894-629a1e21efb8
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176601%27 HTTP/1.1" 200 None
2026-03-28 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176601 not downloaded yet
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981059%27 HTTP/1.1" 200 None
2026-03-28 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981059 not downloaded yet
2026-03-28 22:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA08JSV/42810825?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=U0wXwnmUHBvUuIYY%2ByLlbm%2FfPTDnQQS8jjz532gBcFY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145660/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ML09TVX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:39 [bca.uk] INFO: Found listing with ID: FG68%20SFY
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG68%2520SFY%27 HTTP/1.1" 200 None
2026-03-28 22:05:39 [bca.uk] INFO: Scrape type for FG68%20SFY: 0
2026-03-28 22:05:39 [bca.uk] INFO: Found listing with ID: PJ68%20AYD
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ68%2520AYD%27 HTTP/1.1" 200 None
2026-03-28 22:05:39 [bca.uk] INFO: Scrape type for PJ68%20AYD: 1
2026-03-28 22:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d2cdd9b-103e-5d8d-ac18-3bf908918b6c with identifier: PJ68%20AYD
2026-03-28 22:05:39 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2d2cdd9b-103e-5d8d-ac18-3bf908918b6c
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145705%27 HTTP/1.1" 200 None
2026-03-28 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145705 not downloaded yet
2026-03-28 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54744a7d0>
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_976f1540-41c9-5853-a520-2191352412f3/976f1540-41c9-5853-a520-2191352412f3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ10XBR%252F699010958%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010958/600 saved to cache
2026-03-28 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 976f1540-41c9-5853-a520-2191352412f3
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554978590>
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b35f19-803b-5916-9d73-8fe099e2d84a/31b35f19-803b-5916-9d73-8fe099e2d84a_expert_report_file_029fe802-3827-4cd0-9f0e-5c85a9718c6a.pdf HTTP/1.1" 201 0
2026-03-28 22:05:39 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 31b35f19-803b-5916-9d73-8fe099e2d84a
2026-03-28 22:05:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31b35f19-803b-5916-9d73-8fe099e2d84a, skipping ID generation
2026-03-28 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 31b35f19-803b-5916-9d73-8fe099e2d84a
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFL71EGE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FL71EGE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54744d0d0>
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1941c029-e601-57db-8da4-77ae3b1b387e/1941c029-e601-57db-8da4-77ae3b1b387e_expert_report_file_a5399c45-2b5d-43fe-8b8b-c41c614c2fbf.pdf HTTP/1.1" 201 0
2026-03-28 22:05:39 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1941c029-e601-57db-8da4-77ae3b1b387e
2026-03-28 22:05:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1941c029-e601-57db-8da4-77ae3b1b387e, skipping ID generation
2026-03-28 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1941c029-e601-57db-8da4-77ae3b1b387e
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPF68PYB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PF68PYB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55443f010>
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_976f1540-41c9-5853-a520-2191352412f3/976f1540-41c9-5853-a520-2191352412f3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ10XBR%252F699010907%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010907/600 saved to cache
2026-03-28 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 976f1540-41c9-5853-a520-2191352412f3
2026-03-28 22:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176550/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD13TWN/42806211?sv=2020-08-04&st=2026-03-28T22%3A05%3A28Z&se=2026-03-28T22%3A30%3A28Z&sr=b&sp=r&sig=wRfwJDLlJXXhiZvL3VXojvZD0PIHcruLftI3SeGjEFo%3D)
2026-03-28 22:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176252/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO62FPD/42810887?sv=2020-08-04&st=2026-03-28T22%3A05%3A24Z&se=2026-03-28T22%3A30%3A24Z&sr=b&sp=r&sig=P8NCpVvkz1uu7oEXsd9E3ohiNsPp4GVfqPmDLbXubx8%3D)
2026-03-28 22:05:39 [bca.uk] INFO: Found listing with ID: EP68%20DWV
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EP68%2520DWV%27 HTTP/1.1" 200 None
2026-03-28 22:05:39 [bca.uk] INFO: Scrape type for EP68%20DWV: 1
2026-03-28 22:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0 with identifier: EP68%20DWV
2026-03-28 22:05:39 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176610%27 HTTP/1.1" 200 None
2026-03-28 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176610 not downloaded yet
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981081%27 HTTP/1.1" 200 None
2026-03-28 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981081 not downloaded yet
2026-03-28 22:05:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145671/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145671>
2026-03-28 22:05:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ18UDV/42810737?sv=2020-08-04&st=2026-03-28T22%3A05%3A39Z&se=2026-03-28T22%3A30%3A39Z&sr=b&sp=r&sig=xPZ7CxqtsgJvIvegCHBul0ES2CauNHQg2jhr9TcwBRs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MJ18%20UDV-GB>
2026-03-28 22:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176267/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO62FPD/42810887?sv=2020-08-04&st=2026-03-28T22%3A05%3A24Z&se=2026-03-28T22%3A30%3A24Z&sr=b&sp=r&sig=P8NCpVvkz1uu7oEXsd9E3ohiNsPp4GVfqPmDLbXubx8%3D)
2026-03-28 22:05:39 [bca.uk] INFO: Found listing with ID: EX71%20JPO
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX71%2520JPO%27 HTTP/1.1" 200 None
2026-03-28 22:05:39 [bca.uk] INFO: Scrape type for EX71%20JPO: 1
2026-03-28 22:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b97ea534-9544-5066-9940-a3af577b97fd with identifier: EX71%20JPO
2026-03-28 22:05:39 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b97ea534-9544-5066-9940-a3af577b97fd
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145719%27 HTTP/1.1" 200 None
2026-03-28 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145719 not downloaded yet
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698971732%27 HTTP/1.1" 200 None
2026-03-28 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971732 not downloaded yet
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698972598%27 HTTP/1.1" 200 None
2026-03-28 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698972598 not downloaded yet
2026-03-28 22:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE05WVK/42811009?sv=2020-08-04&st=2026-03-28T22%3A05%3A36Z&se=2026-03-28T22%3A30%3A36Z&sr=b&sp=r&sig=mupgw8rLb3y7HRkTTcsDAEi9vH9L04U4rd3rmNORr9c%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:39 [bca.uk] INFO: Found listing with ID: FE70%20UFX
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE70%2520UFX%27 HTTP/1.1" 200 None
2026-03-28 22:05:39 [bca.uk] INFO: Scrape type for FE70%20UFX: 1
2026-03-28 22:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b with identifier: FE70%20UFX
2026-03-28 22:05:39 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981100%27 HTTP/1.1" 200 None
2026-03-28 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981100 not downloaded yet
2026-03-28 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557130790>
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33f95c1b-3436-504d-8243-b3c29aca56a3/33f95c1b-3436-504d-8243-b3c29aca56a3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO62FPD%252F699176232%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176232/600 saved to cache
2026-03-28 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 33f95c1b-3436-504d-8243-b3c29aca56a3
2026-03-28 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54762ea50>
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33f95c1b-3436-504d-8243-b3c29aca56a3/33f95c1b-3436-504d-8243-b3c29aca56a3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO62FPD%252F699176216%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176216/600 saved to cache
2026-03-28 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 33f95c1b-3436-504d-8243-b3c29aca56a3
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554945cd0>
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f257efe2-daf9-5bd3-a5cb-758b3c74ea0d/f257efe2-daf9-5bd3-a5cb-758b3c74ea0d_expert_report_file_50da8abd-7551-48de-9b16-7ab606dcc45d.pdf HTTP/1.1" 201 0
2026-03-28 22:05:40 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f257efe2-daf9-5bd3-a5cb-758b3c74ea0d
2026-03-28 22:05:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f257efe2-daf9-5bd3-a5cb-758b3c74ea0d, skipping ID generation
2026-03-28 22:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item f257efe2-daf9-5bd3-a5cb-758b3c74ea0d
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYA08JSV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YA08JSV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176575/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176575>
2026-03-28 22:05:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176584/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176584>
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145730%27 HTTP/1.1" 200 None
2026-03-28 22:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145730 not downloaded yet
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698971746%27 HTTP/1.1" 200 None
2026-03-28 22:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971746 not downloaded yet
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698972605%27 HTTP/1.1" 200 None
2026-03-28 22:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698972605 not downloaded yet
2026-03-28 22:05:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145679/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145679>
2026-03-28 22:05:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU70SXD/42803394?sv=2020-08-04&st=2026-03-28T22%3A05%3A39Z&se=2026-03-28T22%3A30%3A39Z&sr=b&sp=r&sig=a3zG5kKyKp3Odn7LKH%2F%2FskO1ryy5RWm7DEi%2F2QHY28A%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU70%20SXD-GB>
2026-03-28 22:05:40 [bca.uk] INFO: Found listing with ID: HK21%20BWB
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK21%2520BWB%27 HTTP/1.1" 200 None
2026-03-28 22:05:40 [bca.uk] INFO: Scrape type for HK21%20BWB: 0
2026-03-28 22:05:40 [bca.uk] INFO: Found listing with ID: YA18%20UVB
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA18%2520UVB%27 HTTP/1.1" 200 None
2026-03-28 22:05:40 [bca.uk] INFO: Scrape type for YA18%20UVB: 0
2026-03-28 22:05:40 [bca.uk] INFO: Found listing with ID: GF23%20TXO
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF23%2520TXO%27 HTTP/1.1" 200 None
2026-03-28 22:05:40 [bca.uk] INFO: Scrape type for GF23%20TXO: 2
2026-03-28 22:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 109c3b58-7203-5f87-be6e-0298d47e2ce7 with identifier: GF23%20TXO
2026-03-28 22:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 109c3b58-7203-5f87-be6e-0298d47e2ce7 with scrape type 2
2026-03-28 22:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 109c3b58-7203-5f87-be6e-0298d47e2ce7 with scrape type 2
2026-03-28 22:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 109c3b58-7203-5f87-be6e-0298d47e2ce7, identifier: GF23%20TXO
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981128%27 HTTP/1.1" 200 None
2026-03-28 22:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981128 not downloaded yet
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993522%27 HTTP/1.1" 200 None
2026-03-28 22:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993522 not downloaded yet
2026-03-28 22:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176562/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD13TWN/42806211?sv=2020-08-04&st=2026-03-28T22%3A05%3A28Z&se=2026-03-28T22%3A30%3A28Z&sr=b&sp=r&sig=wRfwJDLlJXXhiZvL3VXojvZD0PIHcruLftI3SeGjEFo%3D)
2026-03-28 22:05:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145686/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145686>
2026-03-28 22:05:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L4VSX/42810494?sv=2020-08-04&st=2026-03-28T22%3A05%3A40Z&se=2026-03-28T22%3A30%3A40Z&sr=b&sp=r&sig=mE8nvjL4n0uJDp6MhHZh7AnsGKq4y8zOa73KiQps19o%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=L4%20VSX-GB>
2026-03-28 22:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 109c3b58-7203-5f87-be6e-0298d47e2ce7 with identifier: GF23%20TXO
2026-03-28 22:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 109c3b58-7203-5f87-be6e-0298d47e2ce7 with identifier: GF23%20TXO
2026-03-28 22:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 109c3b58-7203-5f87-be6e-0298d47e2ce7 with identifier: GF23%20TXO to the API
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF23%20TXO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '109c3b58-7203-5f87-be6e-0298d47e2ce7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GF23 TXO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GF23%20TXO&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 41315,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B MHEV 155 ST-LINE X Hatchback',
'transmission': 'manual',
'trim': 'E/B MHEV 155 ST-LINE X',
'vin': 'WF0NXXGCHNPK50935',
'year': 2023}
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF23%2520TXO%27 HTTP/1.1" 200 None
2026-03-28 22:05:40 [bca.uk] INFO: Saving data for GF23%20TXO: {'auction_closing_time': 1774864800.0, 'created_time': 1774048159.294143, 'last_price_update_time': 1774735540.982645}
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GF23%2520TXO') HTTP/1.1" 204 0
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145743%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145743 not downloaded yet
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698971763%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971763 not downloaded yet
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698972614%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698972614 not downloaded yet
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b42310>
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08149aa9-acd8-5621-afc9-de796506b5b4/08149aa9-acd8-5621-afc9-de796506b5b4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD13TWN%252F699176550%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176550/600 saved to cache
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08149aa9-acd8-5621-afc9-de796506b5b4
2026-03-28 22:05:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5476217d0>
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33f95c1b-3436-504d-8243-b3c29aca56a3/33f95c1b-3436-504d-8243-b3c29aca56a3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO62FPD%252F699176252%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176252/600 saved to cache
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 33f95c1b-3436-504d-8243-b3c29aca56a3
2026-03-28 22:05:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543eba10>
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33f95c1b-3436-504d-8243-b3c29aca56a3/33f95c1b-3436-504d-8243-b3c29aca56a3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO62FPD%252F699176267%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176267/600 saved to cache
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 33f95c1b-3436-504d-8243-b3c29aca56a3
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471ac450>
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_468e3ba1-3197-5e32-97b6-5380ba714d59/468e3ba1-3197-5e32-97b6-5380ba714d59_expert_report_file_cf954390-c323-4eb6-ada7-50bd31c4081e.pdf HTTP/1.1" 201 0
2026-03-28 22:05:41 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 468e3ba1-3197-5e32-97b6-5380ba714d59
2026-03-28 22:05:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 468e3ba1-3197-5e32-97b6-5380ba714d59, skipping ID generation
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 468e3ba1-3197-5e32-97b6-5380ba714d59
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPE05WVK-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PE05WVK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145660/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML09TVX/42810920?sv=2020-08-04&st=2026-03-28T22%3A05%3A29Z&se=2026-03-28T22%3A30%3A29Z&sr=b&sp=r&sig=3CS5OP6y37ZBf1km95kjXxQgZGTyyd1Q098%2Fto%2FWbZ0%3D)
2026-03-28 22:05:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145694/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145694>
2026-03-28 22:05:41 [bca.uk] INFO: Found listing with ID: RE22%20ECV
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE22%2520ECV%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [bca.uk] INFO: Scrape type for RE22%20ECV: 0
2026-03-28 22:05:41 [bca.uk] INFO: Found listing with ID: AE69%20GWW
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE69%2520GWW%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [bca.uk] INFO: Scrape type for AE69%20GWW: 0
2026-03-28 22:05:41 [bca.uk] INFO: Found listing with ID: EJ69%20TFF
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ69%2520TFF%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [bca.uk] INFO: Scrape type for EJ69%20TFF: 1
2026-03-28 22:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0000ca0-cda2-564a-a588-b58706c95283 with identifier: EJ69%20TFF
2026-03-28 22:05:41 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a0000ca0-cda2-564a-a588-b58706c95283
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981144%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981144 not downloaded yet
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993528%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993528 not downloaded yet
2026-03-28 22:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD72JHL/42807865?sv=2020-08-04&st=2026-03-28T22%3A05%3A38Z&se=2026-03-28T22%3A30%3A38Z&sr=b&sp=r&sig=wwsnAuuWBNQzl1pmQDzNNycU4Ea5d5vZNz1D45DsB2o%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698971780%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971780 not downloaded yet
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698972622%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698972622 not downloaded yet
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015345%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015345 not downloaded yet
2026-03-28 22:05:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176601/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176601>
2026-03-28 22:05:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981059/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981059>
2026-03-28 22:05:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981081/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981081>
2026-03-28 22:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145671/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML09TVX/42810920?sv=2020-08-04&st=2026-03-28T22%3A05%3A29Z&se=2026-03-28T22%3A30%3A29Z&sr=b&sp=r&sig=3CS5OP6y37ZBf1km95kjXxQgZGTyyd1Q098%2Fto%2FWbZ0%3D)
2026-03-28 22:05:41 [bca.uk] INFO: Found listing with ID: CK18%20NWF
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK18%2520NWF%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [bca.uk] INFO: Scrape type for CK18%20NWF: 0
2026-03-28 22:05:41 [bca.uk] INFO: Found listing with ID: KS69%20HBC
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS69%2520HBC%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [bca.uk] INFO: Scrape type for KS69%20HBC: 1
2026-03-28 22:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 567b92e4-538d-5dfd-a509-01ee1c685e60 with identifier: KS69%20HBC
2026-03-28 22:05:41 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 567b92e4-538d-5dfd-a509-01ee1c685e60
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981176%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981176 not downloaded yet
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993539%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993539 not downloaded yet
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54738fb50>
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08149aa9-acd8-5621-afc9-de796506b5b4/08149aa9-acd8-5621-afc9-de796506b5b4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD13TWN%252F699176562%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176562/600 saved to cache
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08149aa9-acd8-5621-afc9-de796506b5b4
2026-03-28 22:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176584/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD13TWN/42806211?sv=2020-08-04&st=2026-03-28T22%3A05%3A28Z&se=2026-03-28T22%3A30%3A28Z&sr=b&sp=r&sig=wRfwJDLlJXXhiZvL3VXojvZD0PIHcruLftI3SeGjEFo%3D)
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698971788%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971788 not downloaded yet
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698972642%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698972642 not downloaded yet
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015355%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015355 not downloaded yet
2026-03-28 22:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ18UDV/42810737?sv=2020-08-04&st=2026-03-28T22%3A05%3A39Z&se=2026-03-28T22%3A30%3A39Z&sr=b&sp=r&sig=xPZ7CxqtsgJvIvegCHBul0ES2CauNHQg2jhr9TcwBRs%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176610/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176610>
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981209%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981209 not downloaded yet
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993546%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993546 not downloaded yet
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547201690>
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d1bd1b-e75f-5786-8613-977c6a06c247/79d1bd1b-e75f-5786-8613-977c6a06c247_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML09TVX%252F699145660%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145660/600 saved to cache
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79d1bd1b-e75f-5786-8613-977c6a06c247
2026-03-28 22:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145679/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML09TVX/42810920?sv=2020-08-04&st=2026-03-28T22%3A05%3A29Z&se=2026-03-28T22%3A30%3A29Z&sr=b&sp=r&sig=3CS5OP6y37ZBf1km95kjXxQgZGTyyd1Q098%2Fto%2FWbZ0%3D)
2026-03-28 22:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145686/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML09TVX/42810920?sv=2020-08-04&st=2026-03-28T22%3A05%3A29Z&se=2026-03-28T22%3A30%3A29Z&sr=b&sp=r&sig=3CS5OP6y37ZBf1km95kjXxQgZGTyyd1Q098%2Fto%2FWbZ0%3D)
2026-03-28 22:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176575/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD13TWN/42806211?sv=2020-08-04&st=2026-03-28T22%3A05%3A28Z&se=2026-03-28T22%3A30%3A28Z&sr=b&sp=r&sig=wRfwJDLlJXXhiZvL3VXojvZD0PIHcruLftI3SeGjEFo%3D)
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698971803%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971803 not downloaded yet
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698972661%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698972661 not downloaded yet
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015369%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015369 not downloaded yet
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fd7590>
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d06042a9-4183-5322-b0e5-834acfc52d31/d06042a9-4183-5322-b0e5-834acfc52d31_expert_report_file_05f4ab43-dde0-4d2a-b465-4d90c0cfe1b3.pdf HTTP/1.1" 201 0
2026-03-28 22:05:41 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d06042a9-4183-5322-b0e5-834acfc52d31
2026-03-28 22:05:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d06042a9-4183-5322-b0e5-834acfc52d31, skipping ID generation
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d06042a9-4183-5322-b0e5-834acfc52d31
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWD72JHL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WD72JHL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548c9850>
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d1bd1b-e75f-5786-8613-977c6a06c247/79d1bd1b-e75f-5786-8613-977c6a06c247_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML09TVX%252F699145671%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145671/600 saved to cache
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79d1bd1b-e75f-5786-8613-977c6a06c247
2026-03-28 22:05:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972605/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698972605>
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981252%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981252 not downloaded yet
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993555%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993555 not downloaded yet
2026-03-28 22:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145694/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML09TVX/42810920?sv=2020-08-04&st=2026-03-28T22%3A05%3A29Z&se=2026-03-28T22%3A30%3A29Z&sr=b&sp=r&sig=3CS5OP6y37ZBf1km95kjXxQgZGTyyd1Q098%2Fto%2FWbZ0%3D)
2026-03-28 22:05:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993522/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993522>
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698971819%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971819 not downloaded yet
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698972674%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698972674 not downloaded yet
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015388%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015388 not downloaded yet
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158925%27 HTTP/1.1" 200 None
2026-03-28 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158925 not downloaded yet
2026-03-28 22:05:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55430d310>
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08149aa9-acd8-5621-afc9-de796506b5b4/08149aa9-acd8-5621-afc9-de796506b5b4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD13TWN%252F699176584%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176584/600 saved to cache
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08149aa9-acd8-5621-afc9-de796506b5b4
2026-03-28 22:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU70SXD/42803394?sv=2020-08-04&st=2026-03-28T22%3A05%3A39Z&se=2026-03-28T22%3A30%3A39Z&sr=b&sp=r&sig=a3zG5kKyKp3Odn7LKH%2F%2FskO1ryy5RWm7DEi%2F2QHY28A%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981291%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981291 not downloaded yet
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993560%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993560 not downloaded yet
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55484ac90>
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e282d348-5eb7-5636-8bba-650d60f1c196/e282d348-5eb7-5636-8bba-650d60f1c196_expert_report_file_42a57d69-f69a-461c-b227-2124c6408022.pdf HTTP/1.1" 201 0
2026-03-28 22:05:42 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e282d348-5eb7-5636-8bba-650d60f1c196
2026-03-28 22:05:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e282d348-5eb7-5636-8bba-650d60f1c196, skipping ID generation
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e282d348-5eb7-5636-8bba-650d60f1c196
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMJ18UDV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MJ18UDV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543f57d0>
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d1bd1b-e75f-5786-8613-977c6a06c247/79d1bd1b-e75f-5786-8613-977c6a06c247_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML09TVX%252F699145679%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145679/600 saved to cache
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79d1bd1b-e75f-5786-8613-977c6a06c247
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547105750>
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d1bd1b-e75f-5786-8613-977c6a06c247/79d1bd1b-e75f-5786-8613-977c6a06c247_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML09TVX%252F699145686%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145686/600 saved to cache
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79d1bd1b-e75f-5786-8613-977c6a06c247
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474e1dd0>
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08149aa9-acd8-5621-afc9-de796506b5b4/08149aa9-acd8-5621-afc9-de796506b5b4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD13TWN%252F699176575%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176575/600 saved to cache
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08149aa9-acd8-5621-afc9-de796506b5b4
2026-03-28 22:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L4VSX/42810494?sv=2020-08-04&st=2026-03-28T22%3A05%3A40Z&se=2026-03-28T22%3A30%3A40Z&sr=b&sp=r&sig=mE8nvjL4n0uJDp6MhHZh7AnsGKq4y8zOa73KiQps19o%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981081/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ20UMA/42810780?sv=2020-08-04&st=2026-03-28T22%3A05%3A32Z&se=2026-03-28T22%3A30%3A32Z&sr=b&sp=r&sig=bOMtVseDP5%2B4q3gO7UJt%2FRZXlewTKJ%2F8pF1iERt4wLA%3D)
2026-03-28 22:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981059/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ20UMA/42810780?sv=2020-08-04&st=2026-03-28T22%3A05%3A32Z&se=2026-03-28T22%3A30%3A32Z&sr=b&sp=r&sig=bOMtVseDP5%2B4q3gO7UJt%2FRZXlewTKJ%2F8pF1iERt4wLA%3D)
2026-03-28 22:05:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993528/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993528>
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698971839%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971839 not downloaded yet
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698972691%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698972691 not downloaded yet
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015405%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015405 not downloaded yet
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158931%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158931 not downloaded yet
2026-03-28 22:05:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015345/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015345>
2026-03-28 22:05:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981144/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981144>
2026-03-28 22:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176601/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD13TWN/42806211?sv=2020-08-04&st=2026-03-28T22%3A05%3A28Z&se=2026-03-28T22%3A30%3A28Z&sr=b&sp=r&sig=wRfwJDLlJXXhiZvL3VXojvZD0PIHcruLftI3SeGjEFo%3D)
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993569%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993569 not downloaded yet
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981042%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981042 not downloaded yet
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554883990>
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d1bd1b-e75f-5786-8613-977c6a06c247/79d1bd1b-e75f-5786-8613-977c6a06c247_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML09TVX%252F699145694%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145694/600 saved to cache
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79d1bd1b-e75f-5786-8613-977c6a06c247
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698971854%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971854 not downloaded yet
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698972712%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698972712 not downloaded yet
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015424%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015424 not downloaded yet
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158942%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158942 not downloaded yet
2026-03-28 22:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176610/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD13TWN/42806211?sv=2020-08-04&st=2026-03-28T22%3A05%3A28Z&se=2026-03-28T22%3A30%3A28Z&sr=b&sp=r&sig=wRfwJDLlJXXhiZvL3VXojvZD0PIHcruLftI3SeGjEFo%3D)
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993574%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993574 not downloaded yet
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981070%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981070 not downloaded yet
2026-03-28 22:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972605/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF68PYB/42810634?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=Qnbhc%2F3Nk5rBw4e6MkVvsnHTegd%2BbIJ4VYeule%2Bchng%3D)
2026-03-28 22:05:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015355/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015355>
2026-03-28 22:05:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993539/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993539>
2026-03-28 22:05:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972642/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698972642>
2026-03-28 22:05:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971788/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971788>
2026-03-28 22:05:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158912/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WD72JHL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015442%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015442 not downloaded yet
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158947%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158947 not downloaded yet
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b04b50>
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9eb7897-258a-53be-b988-82acf7b5019f/c9eb7897-258a-53be-b988-82acf7b5019f_expert_report_file_560c974d-1c8d-4788-9862-ea8a7fb0562a.pdf HTTP/1.1" 201 0
2026-03-28 22:05:42 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c9eb7897-258a-53be-b988-82acf7b5019f
2026-03-28 22:05:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9eb7897-258a-53be-b988-82acf7b5019f, skipping ID generation
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9eb7897-258a-53be-b988-82acf7b5019f
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGU70SXD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GU70SXD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55435f0d0>
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ca5cba-185e-521d-a3da-10f6c18734b3/70ca5cba-185e-521d-a3da-10f6c18734b3_expert_report_file_49f2589c-37f7-405c-8b53-f8b0238754bb.pdf HTTP/1.1" 201 0
2026-03-28 22:05:42 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 70ca5cba-185e-521d-a3da-10f6c18734b3
2026-03-28 22:05:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70ca5cba-185e-521d-a3da-10f6c18734b3, skipping ID generation
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 70ca5cba-185e-521d-a3da-10f6c18734b3
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DL4VSX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=L4VSX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b073d0>
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_182b028b-defa-51b3-b97c-bb87ff17eb7b/182b028b-defa-51b3-b97c-bb87ff17eb7b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ20UMA%252F698981081%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981081/600 saved to cache
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 182b028b-defa-51b3-b97c-bb87ff17eb7b
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547632a50>
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_182b028b-defa-51b3-b97c-bb87ff17eb7b/182b028b-defa-51b3-b97c-bb87ff17eb7b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ20UMA%252F698981059%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981059/600 saved to cache
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 182b028b-defa-51b3-b97c-bb87ff17eb7b
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981089%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981089 not downloaded yet
2026-03-28 22:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993522/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA08JSV/42810825?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=U0wXwnmUHBvUuIYY%2ByLlbm%2FfPTDnQQS8jjz532gBcFY%3D)
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015457%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015457 not downloaded yet
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158957%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158957 not downloaded yet
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208602%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208602 not downloaded yet
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976047%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976047 not downloaded yet
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981125%27 HTTP/1.1" 200 None
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981125 not downloaded yet
2026-03-28 22:05:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554278d10>
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08149aa9-acd8-5621-afc9-de796506b5b4/08149aa9-acd8-5621-afc9-de796506b5b4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD13TWN%252F699176601%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176601/600 saved to cache
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08149aa9-acd8-5621-afc9-de796506b5b4
2026-03-28 22:05:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b0e3d0>
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08149aa9-acd8-5621-afc9-de796506b5b4/08149aa9-acd8-5621-afc9-de796506b5b4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD13TWN%252F699176610%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176610/600 saved to cache
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 08149aa9-acd8-5621-afc9-de796506b5b4
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547134150>
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1941c029-e601-57db-8da4-77ae3b1b387e/1941c029-e601-57db-8da4-77ae3b1b387e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF68PYB%252F698972605%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972605/600 saved to cache
2026-03-28 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1941c029-e601-57db-8da4-77ae3b1b387e
2026-03-28 22:05:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981024/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MJ18UDV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993555/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993555>
2026-03-28 22:05:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993560/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993560>
2026-03-28 22:05:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981291/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981291>
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158970%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158970 not downloaded yet
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208618%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208618 not downloaded yet
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976058%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976058 not downloaded yet
2026-03-28 22:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981144/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ20UMA/42810780?sv=2020-08-04&st=2026-03-28T22%3A05%3A32Z&se=2026-03-28T22%3A30%3A32Z&sr=b&sp=r&sig=bOMtVseDP5%2B4q3gO7UJt%2FRZXlewTKJ%2F8pF1iERt4wLA%3D)
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981146%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981146 not downloaded yet
2026-03-28 22:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015345/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE05WVK/42811009?sv=2020-08-04&st=2026-03-28T22%3A05%3A36Z&se=2026-03-28T22%3A30%3A36Z&sr=b&sp=r&sig=mupgw8rLb3y7HRkTTcsDAEi9vH9L04U4rd3rmNORr9c%3D)
2026-03-28 22:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993528/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA08JSV/42810825?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=U0wXwnmUHBvUuIYY%2ByLlbm%2FfPTDnQQS8jjz532gBcFY%3D)
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158982%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158982 not downloaded yet
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208643%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208643 not downloaded yet
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976071%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976071 not downloaded yet
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54713ee10>
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f257efe2-daf9-5bd3-a5cb-758b3c74ea0d/f257efe2-daf9-5bd3-a5cb-758b3c74ea0d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA08JSV%252F698993522%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993522/600 saved to cache
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f257efe2-daf9-5bd3-a5cb-758b3c74ea0d
2026-03-28 22:05:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158925/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158925>
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981175%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981175 not downloaded yet
2026-03-28 22:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158912/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD72JHL/42807865?sv=2020-08-04&st=2026-03-28T22%3A05%3A38Z&se=2026-03-28T22%3A30%3A38Z&sr=b&sp=r&sig=wwsnAuuWBNQzl1pmQDzNNycU4Ea5d5vZNz1D45DsB2o%3D)
2026-03-28 22:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972642/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF68PYB/42810634?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=Qnbhc%2F3Nk5rBw4e6MkVvsnHTegd%2BbIJ4VYeule%2Bchng%3D)
2026-03-28 22:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971788/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL71EGE/42810664?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=9jRkf4Wr%2B%2FWN%2B1GfIm%2BRv9CJsfAX3NU6%2B1LwAsEPOgc%3D)
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158989%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158989 not downloaded yet
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208659%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208659 not downloaded yet
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976096%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976096 not downloaded yet
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981202%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981202 not downloaded yet
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547730950>
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_182b028b-defa-51b3-b97c-bb87ff17eb7b/182b028b-defa-51b3-b97c-bb87ff17eb7b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ20UMA%252F698981144%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981144/600 saved to cache
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 182b028b-defa-51b3-b97c-bb87ff17eb7b
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554285210>
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_468e3ba1-3197-5e32-97b6-5380ba714d59/468e3ba1-3197-5e32-97b6-5380ba714d59_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE05WVK%252F699015345%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015345/600 saved to cache
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 468e3ba1-3197-5e32-97b6-5380ba714d59
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547151d90>
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f257efe2-daf9-5bd3-a5cb-758b3c74ea0d/f257efe2-daf9-5bd3-a5cb-758b3c74ea0d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA08JSV%252F698993528%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993528/600 saved to cache
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f257efe2-daf9-5bd3-a5cb-758b3c74ea0d
2026-03-28 22:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993539/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA08JSV/42810825?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=U0wXwnmUHBvUuIYY%2ByLlbm%2FfPTDnQQS8jjz532gBcFY%3D)
2026-03-28 22:05:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015424/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015424>
2026-03-28 22:05:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158942/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158942>
2026-03-28 22:05:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981089/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981089>
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699159002%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699159002 not downloaded yet
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208671%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208671 not downloaded yet
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976114%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976114 not downloaded yet
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981242%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981242 not downloaded yet
2026-03-28 22:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015355/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE05WVK/42811009?sv=2020-08-04&st=2026-03-28T22%3A05%3A36Z&se=2026-03-28T22%3A30%3A36Z&sr=b&sp=r&sig=mupgw8rLb3y7HRkTTcsDAEi9vH9L04U4rd3rmNORr9c%3D)
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208689%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208689 not downloaded yet
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976143%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976143 not downloaded yet
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547311550>
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d06042a9-4183-5322-b0e5-834acfc52d31/d06042a9-4183-5322-b0e5-834acfc52d31_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD72JHL%252F699158912%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158912/600 saved to cache
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d06042a9-4183-5322-b0e5-834acfc52d31
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547451410>
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1941c029-e601-57db-8da4-77ae3b1b387e/1941c029-e601-57db-8da4-77ae3b1b387e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF68PYB%252F698972642%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972642/600 saved to cache
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1941c029-e601-57db-8da4-77ae3b1b387e
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a945d0>
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b35f19-803b-5916-9d73-8fe099e2d84a/31b35f19-803b-5916-9d73-8fe099e2d84a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL71EGE%252F698971788%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971788/600 saved to cache
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 31b35f19-803b-5916-9d73-8fe099e2d84a
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981276%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981276 not downloaded yet
2026-03-28 22:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993555/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA08JSV/42810825?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=U0wXwnmUHBvUuIYY%2ByLlbm%2FfPTDnQQS8jjz532gBcFY%3D)
2026-03-28 22:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993560/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA08JSV/42810825?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=U0wXwnmUHBvUuIYY%2ByLlbm%2FfPTDnQQS8jjz532gBcFY%3D)
2026-03-28 22:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981024/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ18UDV/42810737?sv=2020-08-04&st=2026-03-28T22%3A05%3A39Z&se=2026-03-28T22%3A30%3A39Z&sr=b&sp=r&sig=xPZ7CxqtsgJvIvegCHBul0ES2CauNHQg2jhr9TcwBRs%3D)
2026-03-28 22:05:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158970/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158970>
2026-03-28 22:05:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976058/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976058>
2026-03-28 22:05:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208618/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208618>
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208710%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208710 not downloaded yet
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976179%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976179 not downloaded yet
2026-03-28 22:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981291/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ20UMA/42810780?sv=2020-08-04&st=2026-03-28T22%3A05%3A32Z&se=2026-03-28T22%3A30%3A32Z&sr=b&sp=r&sig=bOMtVseDP5%2B4q3gO7UJt%2FRZXlewTKJ%2F8pF1iERt4wLA%3D)
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a1a390>
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f257efe2-daf9-5bd3-a5cb-758b3c74ea0d/f257efe2-daf9-5bd3-a5cb-758b3c74ea0d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA08JSV%252F698993539%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993539/600 saved to cache
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f257efe2-daf9-5bd3-a5cb-758b3c74ea0d
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a1bc90>
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_468e3ba1-3197-5e32-97b6-5380ba714d59/468e3ba1-3197-5e32-97b6-5380ba714d59_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE05WVK%252F699015355%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015355/600 saved to cache
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 468e3ba1-3197-5e32-97b6-5380ba714d59
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208736%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208736 not downloaded yet
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976208%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976208 not downloaded yet
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208754%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208754 not downloaded yet
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698976240%27 HTTP/1.1" 200 None
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976240 not downloaded yet
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543d8810>
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f257efe2-daf9-5bd3-a5cb-758b3c74ea0d/f257efe2-daf9-5bd3-a5cb-758b3c74ea0d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA08JSV%252F698993555%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993555/600 saved to cache
2026-03-28 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f257efe2-daf9-5bd3-a5cb-758b3c74ea0d
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554555790>
2026-03-28 22:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f257efe2-daf9-5bd3-a5cb-758b3c74ea0d/f257efe2-daf9-5bd3-a5cb-758b3c74ea0d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA08JSV%252F698993560%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993560/600 saved to cache
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f257efe2-daf9-5bd3-a5cb-758b3c74ea0d
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548544d0>
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e282d348-5eb7-5636-8bba-650d60f1c196/e282d348-5eb7-5636-8bba-650d60f1c196_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ18UDV%252F698981024%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981024/600 saved to cache
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e282d348-5eb7-5636-8bba-650d60f1c196
2026-03-28 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158925/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD72JHL/42807865?sv=2020-08-04&st=2026-03-28T22%3A05%3A38Z&se=2026-03-28T22%3A30%3A38Z&sr=b&sp=r&sig=wwsnAuuWBNQzl1pmQDzNNycU4Ea5d5vZNz1D45DsB2o%3D)
2026-03-28 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981089/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ18UDV/42810737?sv=2020-08-04&st=2026-03-28T22%3A05%3A39Z&se=2026-03-28T22%3A30%3A39Z&sr=b&sp=r&sig=xPZ7CxqtsgJvIvegCHBul0ES2CauNHQg2jhr9TcwBRs%3D)
2026-03-28 22:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208643/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208643>
2026-03-28 22:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981175/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981175>
2026-03-28 22:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976096/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976096>
2026-03-28 22:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976071/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976071>
2026-03-28 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158942/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD72JHL/42807865?sv=2020-08-04&st=2026-03-28T22%3A05%3A38Z&se=2026-03-28T22%3A30%3A38Z&sr=b&sp=r&sig=wwsnAuuWBNQzl1pmQDzNNycU4Ea5d5vZNz1D45DsB2o%3D)
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548981d0>
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_182b028b-defa-51b3-b97c-bb87ff17eb7b/182b028b-defa-51b3-b97c-bb87ff17eb7b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ20UMA%252F698981291%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981291/600 saved to cache
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 182b028b-defa-51b3-b97c-bb87ff17eb7b
2026-03-28 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015424/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE05WVK/42811009?sv=2020-08-04&st=2026-03-28T22%3A05%3A36Z&se=2026-03-28T22%3A30%3A36Z&sr=b&sp=r&sig=mupgw8rLb3y7HRkTTcsDAEi9vH9L04U4rd3rmNORr9c%3D)
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547479790>
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d06042a9-4183-5322-b0e5-834acfc52d31/d06042a9-4183-5322-b0e5-834acfc52d31_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD72JHL%252F699158925%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158925/600 saved to cache
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d06042a9-4183-5322-b0e5-834acfc52d31
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556f62e50>
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e282d348-5eb7-5636-8bba-650d60f1c196/e282d348-5eb7-5636-8bba-650d60f1c196_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ18UDV%252F698981089%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981089/600 saved to cache
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e282d348-5eb7-5636-8bba-650d60f1c196
2026-03-28 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208618/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU70SXD/42803394?sv=2020-08-04&st=2026-03-28T22%3A05%3A39Z&se=2026-03-28T22%3A30%3A39Z&sr=b&sp=r&sig=a3zG5kKyKp3Odn7LKH%2F%2FskO1ryy5RWm7DEi%2F2QHY28A%3D)
2026-03-28 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976058/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L4VSX/42810494?sv=2020-08-04&st=2026-03-28T22%3A05%3A40Z&se=2026-03-28T22%3A30%3A40Z&sr=b&sp=r&sig=mE8nvjL4n0uJDp6MhHZh7AnsGKq4y8zOa73KiQps19o%3D)
2026-03-28 22:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981276/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981276>
2026-03-28 22:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208689/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208689>
2026-03-28 22:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976114/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976114>
2026-03-28 22:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981242/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981242>
2026-03-28 22:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976143/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976143>
2026-03-28 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158970/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD72JHL/42807865?sv=2020-08-04&st=2026-03-28T22%3A05%3A38Z&se=2026-03-28T22%3A30%3A38Z&sr=b&sp=r&sig=wwsnAuuWBNQzl1pmQDzNNycU4Ea5d5vZNz1D45DsB2o%3D)
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54738fc50>
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d06042a9-4183-5322-b0e5-834acfc52d31/d06042a9-4183-5322-b0e5-834acfc52d31_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD72JHL%252F699158942%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158942/600 saved to cache
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d06042a9-4183-5322-b0e5-834acfc52d31
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471ede50>
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_468e3ba1-3197-5e32-97b6-5380ba714d59/468e3ba1-3197-5e32-97b6-5380ba714d59_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE05WVK%252F699015424%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015424/600 saved to cache
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 468e3ba1-3197-5e32-97b6-5380ba714d59
2026-03-28 22:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208754/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208754>
2026-03-28 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976096/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L4VSX/42810494?sv=2020-08-04&st=2026-03-28T22%3A05%3A40Z&se=2026-03-28T22%3A30%3A40Z&sr=b&sp=r&sig=mE8nvjL4n0uJDp6MhHZh7AnsGKq4y8zOa73KiQps19o%3D)
2026-03-28 22:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976208/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976208>
2026-03-28 22:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976240/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976240>
2026-03-28 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981175/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ18UDV/42810737?sv=2020-08-04&st=2026-03-28T22%3A05%3A39Z&se=2026-03-28T22%3A30%3A39Z&sr=b&sp=r&sig=xPZ7CxqtsgJvIvegCHBul0ES2CauNHQg2jhr9TcwBRs%3D)
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554486dd0>
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9eb7897-258a-53be-b988-82acf7b5019f/c9eb7897-258a-53be-b988-82acf7b5019f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU70SXD%252F699208618%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208618/600 saved to cache
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9eb7897-258a-53be-b988-82acf7b5019f
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548cbad0>
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ca5cba-185e-521d-a3da-10f6c18734b3/70ca5cba-185e-521d-a3da-10f6c18734b3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL4VSX%252F698976058%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976058/600 saved to cache
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70ca5cba-185e-521d-a3da-10f6c18734b3
2026-03-28 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208643/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU70SXD/42803394?sv=2020-08-04&st=2026-03-28T22%3A05%3A39Z&se=2026-03-28T22%3A30%3A39Z&sr=b&sp=r&sig=a3zG5kKyKp3Odn7LKH%2F%2FskO1ryy5RWm7DEi%2F2QHY28A%3D)
2026-03-28 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976071/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L4VSX/42810494?sv=2020-08-04&st=2026-03-28T22%3A05%3A40Z&se=2026-03-28T22%3A30%3A40Z&sr=b&sp=r&sig=mE8nvjL4n0uJDp6MhHZh7AnsGKq4y8zOa73KiQps19o%3D)
2026-03-28 22:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208736/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208736>
2026-03-28 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976114/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L4VSX/42810494?sv=2020-08-04&st=2026-03-28T22%3A05%3A40Z&se=2026-03-28T22%3A30%3A40Z&sr=b&sp=r&sig=mE8nvjL4n0uJDp6MhHZh7AnsGKq4y8zOa73KiQps19o%3D)
2026-03-28 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981276/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ18UDV/42810737?sv=2020-08-04&st=2026-03-28T22%3A05%3A39Z&se=2026-03-28T22%3A30%3A39Z&sr=b&sp=r&sig=xPZ7CxqtsgJvIvegCHBul0ES2CauNHQg2jhr9TcwBRs%3D)
2026-03-28 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981242/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ18UDV/42810737?sv=2020-08-04&st=2026-03-28T22%3A05%3A39Z&se=2026-03-28T22%3A30%3A39Z&sr=b&sp=r&sig=xPZ7CxqtsgJvIvegCHBul0ES2CauNHQg2jhr9TcwBRs%3D)
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547173d50>
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d06042a9-4183-5322-b0e5-834acfc52d31/d06042a9-4183-5322-b0e5-834acfc52d31_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD72JHL%252F699158970%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158970/600 saved to cache
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d06042a9-4183-5322-b0e5-834acfc52d31
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55420e810>
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ca5cba-185e-521d-a3da-10f6c18734b3/70ca5cba-185e-521d-a3da-10f6c18734b3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL4VSX%252F698976096%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976096/600 saved to cache
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 70ca5cba-185e-521d-a3da-10f6c18734b3
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554869d10>
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e282d348-5eb7-5636-8bba-650d60f1c196/e282d348-5eb7-5636-8bba-650d60f1c196_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ18UDV%252F698981175%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981175/600 saved to cache
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e282d348-5eb7-5636-8bba-650d60f1c196
2026-03-28 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208689/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU70SXD/42803394?sv=2020-08-04&st=2026-03-28T22%3A05%3A39Z&se=2026-03-28T22%3A30%3A39Z&sr=b&sp=r&sig=a3zG5kKyKp3Odn7LKH%2F%2FskO1ryy5RWm7DEi%2F2QHY28A%3D)
2026-03-28 22:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208710/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208710>
2026-03-28 22:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976179/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976179>
2026-03-28 22:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208671/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208671>
2026-03-28 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976143/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L4VSX/42810494?sv=2020-08-04&st=2026-03-28T22%3A05%3A40Z&se=2026-03-28T22%3A30%3A40Z&sr=b&sp=r&sig=mE8nvjL4n0uJDp6MhHZh7AnsGKq4y8zOa73KiQps19o%3D)
2026-03-28 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976240/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L4VSX/42810494?sv=2020-08-04&st=2026-03-28T22%3A05%3A40Z&se=2026-03-28T22%3A30%3A40Z&sr=b&sp=r&sig=mE8nvjL4n0uJDp6MhHZh7AnsGKq4y8zOa73KiQps19o%3D)
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554adfb50>
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9eb7897-258a-53be-b988-82acf7b5019f/c9eb7897-258a-53be-b988-82acf7b5019f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU70SXD%252F699208643%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208643/600 saved to cache
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9eb7897-258a-53be-b988-82acf7b5019f
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548fcb10>
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ca5cba-185e-521d-a3da-10f6c18734b3/70ca5cba-185e-521d-a3da-10f6c18734b3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL4VSX%252F698976071%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976071/600 saved to cache
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70ca5cba-185e-521d-a3da-10f6c18734b3
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547733c90>
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ca5cba-185e-521d-a3da-10f6c18734b3/70ca5cba-185e-521d-a3da-10f6c18734b3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL4VSX%252F698976114%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976114/600 saved to cache
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70ca5cba-185e-521d-a3da-10f6c18734b3
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554979790>
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e282d348-5eb7-5636-8bba-650d60f1c196/e282d348-5eb7-5636-8bba-650d60f1c196_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ18UDV%252F698981276%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981276/600 saved to cache
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e282d348-5eb7-5636-8bba-650d60f1c196
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547633d10>
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e282d348-5eb7-5636-8bba-650d60f1c196/e282d348-5eb7-5636-8bba-650d60f1c196_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ18UDV%252F698981242%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981242/600 saved to cache
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e282d348-5eb7-5636-8bba-650d60f1c196
2026-03-28 22:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699159002/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699159002>
2026-03-28 22:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981202/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981202>
2026-03-28 22:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208659/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208659>
2026-03-28 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976208/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L4VSX/42810494?sv=2020-08-04&st=2026-03-28T22%3A05%3A40Z&se=2026-03-28T22%3A30%3A40Z&sr=b&sp=r&sig=mE8nvjL4n0uJDp6MhHZh7AnsGKq4y8zOa73KiQps19o%3D)
2026-03-28 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208736/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU70SXD/42803394?sv=2020-08-04&st=2026-03-28T22%3A05%3A39Z&se=2026-03-28T22%3A30%3A39Z&sr=b&sp=r&sig=a3zG5kKyKp3Odn7LKH%2F%2FskO1ryy5RWm7DEi%2F2QHY28A%3D)
2026-03-28 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208754/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU70SXD/42803394?sv=2020-08-04&st=2026-03-28T22%3A05%3A39Z&se=2026-03-28T22%3A30%3A39Z&sr=b&sp=r&sig=a3zG5kKyKp3Odn7LKH%2F%2FskO1ryy5RWm7DEi%2F2QHY28A%3D)
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547312290>
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9eb7897-258a-53be-b988-82acf7b5019f/c9eb7897-258a-53be-b988-82acf7b5019f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU70SXD%252F699208689%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208689/600 saved to cache
2026-03-28 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9eb7897-258a-53be-b988-82acf7b5019f
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547453e90>
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ca5cba-185e-521d-a3da-10f6c18734b3/70ca5cba-185e-521d-a3da-10f6c18734b3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL4VSX%252F698976143%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976143/600 saved to cache
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 70ca5cba-185e-521d-a3da-10f6c18734b3
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b06ed0>
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ca5cba-185e-521d-a3da-10f6c18734b3/70ca5cba-185e-521d-a3da-10f6c18734b3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL4VSX%252F698976240%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976240/600 saved to cache
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 70ca5cba-185e-521d-a3da-10f6c18734b3
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547452510>
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ca5cba-185e-521d-a3da-10f6c18734b3/70ca5cba-185e-521d-a3da-10f6c18734b3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL4VSX%252F698976208%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976208/600 saved to cache
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 70ca5cba-185e-521d-a3da-10f6c18734b3
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54747bb10>
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9eb7897-258a-53be-b988-82acf7b5019f/c9eb7897-258a-53be-b988-82acf7b5019f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU70SXD%252F699208736%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208736/600 saved to cache
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c9eb7897-258a-53be-b988-82acf7b5019f
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554287390>
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9eb7897-258a-53be-b988-82acf7b5019f/c9eb7897-258a-53be-b988-82acf7b5019f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU70SXD%252F699208754%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208754/600 saved to cache
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c9eb7897-258a-53be-b988-82acf7b5019f
2026-03-28 22:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208671/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU70SXD/42803394?sv=2020-08-04&st=2026-03-28T22%3A05%3A39Z&se=2026-03-28T22%3A30%3A39Z&sr=b&sp=r&sig=a3zG5kKyKp3Odn7LKH%2F%2FskO1ryy5RWm7DEi%2F2QHY28A%3D)
2026-03-28 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158982/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158982>
2026-03-28 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981125/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981125>
2026-03-28 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981146/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981146>
2026-03-28 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158989/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158989>
2026-03-28 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976047/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976047>
2026-03-28 22:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208710/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU70SXD/42803394?sv=2020-08-04&st=2026-03-28T22%3A05%3A39Z&se=2026-03-28T22%3A30%3A39Z&sr=b&sp=r&sig=a3zG5kKyKp3Odn7LKH%2F%2FskO1ryy5RWm7DEi%2F2QHY28A%3D)
2026-03-28 22:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208659/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU70SXD/42803394?sv=2020-08-04&st=2026-03-28T22%3A05%3A39Z&se=2026-03-28T22%3A30%3A39Z&sr=b&sp=r&sig=a3zG5kKyKp3Odn7LKH%2F%2FskO1ryy5RWm7DEi%2F2QHY28A%3D)
2026-03-28 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208602/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208602>
2026-03-28 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158957/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158957>
2026-03-28 22:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976179/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L4VSX/42810494?sv=2020-08-04&st=2026-03-28T22%3A05%3A40Z&se=2026-03-28T22%3A30%3A40Z&sr=b&sp=r&sig=mE8nvjL4n0uJDp6MhHZh7AnsGKq4y8zOa73KiQps19o%3D)
2026-03-28 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015457/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015457>
2026-03-28 22:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981202/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ18UDV/42810737?sv=2020-08-04&st=2026-03-28T22%3A05%3A39Z&se=2026-03-28T22%3A30%3A39Z&sr=b&sp=r&sig=xPZ7CxqtsgJvIvegCHBul0ES2CauNHQg2jhr9TcwBRs%3D)
2026-03-28 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976035/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=L4VSX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b89b10>
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9eb7897-258a-53be-b988-82acf7b5019f/c9eb7897-258a-53be-b988-82acf7b5019f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU70SXD%252F699208671%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208671/600 saved to cache
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9eb7897-258a-53be-b988-82acf7b5019f
2026-03-28 22:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699159002/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD72JHL/42807865?sv=2020-08-04&st=2026-03-28T22%3A05%3A38Z&se=2026-03-28T22%3A30%3A38Z&sr=b&sp=r&sig=wwsnAuuWBNQzl1pmQDzNNycU4Ea5d5vZNz1D45DsB2o%3D)
2026-03-28 22:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981146/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ18UDV/42810737?sv=2020-08-04&st=2026-03-28T22%3A05%3A39Z&se=2026-03-28T22%3A30%3A39Z&sr=b&sp=r&sig=xPZ7CxqtsgJvIvegCHBul0ES2CauNHQg2jhr9TcwBRs%3D)
2026-03-28 22:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981125/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ18UDV/42810737?sv=2020-08-04&st=2026-03-28T22%3A05%3A39Z&se=2026-03-28T22%3A30%3A39Z&sr=b&sp=r&sig=xPZ7CxqtsgJvIvegCHBul0ES2CauNHQg2jhr9TcwBRs%3D)
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55491f250>
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9eb7897-258a-53be-b988-82acf7b5019f/c9eb7897-258a-53be-b988-82acf7b5019f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU70SXD%252F699208710%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208710/600 saved to cache
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9eb7897-258a-53be-b988-82acf7b5019f
2026-03-28 22:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976047/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L4VSX/42810494?sv=2020-08-04&st=2026-03-28T22%3A05%3A40Z&se=2026-03-28T22%3A30%3A40Z&sr=b&sp=r&sig=mE8nvjL4n0uJDp6MhHZh7AnsGKq4y8zOa73KiQps19o%3D)
2026-03-28 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208592/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GU70SXD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158989/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD72JHL/42807865?sv=2020-08-04&st=2026-03-28T22%3A05%3A38Z&se=2026-03-28T22%3A30%3A38Z&sr=b&sp=r&sig=wwsnAuuWBNQzl1pmQDzNNycU4Ea5d5vZNz1D45DsB2o%3D)
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b8aa10>
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9eb7897-258a-53be-b988-82acf7b5019f/c9eb7897-258a-53be-b988-82acf7b5019f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU70SXD%252F699208659%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208659/600 saved to cache
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9eb7897-258a-53be-b988-82acf7b5019f
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554841e90>
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ca5cba-185e-521d-a3da-10f6c18734b3/70ca5cba-185e-521d-a3da-10f6c18734b3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL4VSX%252F698976179%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976179/600 saved to cache
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 70ca5cba-185e-521d-a3da-10f6c18734b3
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f994d0>
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e282d348-5eb7-5636-8bba-650d60f1c196/e282d348-5eb7-5636-8bba-650d60f1c196_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ18UDV%252F698981202%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981202/600 saved to cache
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e282d348-5eb7-5636-8bba-650d60f1c196
2026-03-28 22:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158982/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD72JHL/42807865?sv=2020-08-04&st=2026-03-28T22%3A05%3A38Z&se=2026-03-28T22%3A30%3A38Z&sr=b&sp=r&sig=wwsnAuuWBNQzl1pmQDzNNycU4Ea5d5vZNz1D45DsB2o%3D)
2026-03-28 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158947/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158947>
2026-03-28 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015442/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015442>
2026-03-28 22:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158957/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD72JHL/42807865?sv=2020-08-04&st=2026-03-28T22%3A05%3A38Z&se=2026-03-28T22%3A30%3A38Z&sr=b&sp=r&sig=wwsnAuuWBNQzl1pmQDzNNycU4Ea5d5vZNz1D45DsB2o%3D)
2026-03-28 22:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208602/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU70SXD/42803394?sv=2020-08-04&st=2026-03-28T22%3A05%3A39Z&se=2026-03-28T22%3A30%3A39Z&sr=b&sp=r&sig=a3zG5kKyKp3Odn7LKH%2F%2FskO1ryy5RWm7DEi%2F2QHY28A%3D)
2026-03-28 22:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015457/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE05WVK/42811009?sv=2020-08-04&st=2026-03-28T22%3A05%3A36Z&se=2026-03-28T22%3A30%3A36Z&sr=b&sp=r&sig=mupgw8rLb3y7HRkTTcsDAEi9vH9L04U4rd3rmNORr9c%3D)
2026-03-28 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981070/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981070>
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547390bd0>
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d06042a9-4183-5322-b0e5-834acfc52d31/d06042a9-4183-5322-b0e5-834acfc52d31_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD72JHL%252F699159002%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699159002/600 saved to cache
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d06042a9-4183-5322-b0e5-834acfc52d31
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548c5190>
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e282d348-5eb7-5636-8bba-650d60f1c196/e282d348-5eb7-5636-8bba-650d60f1c196_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ18UDV%252F698981146%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981146/600 saved to cache
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e282d348-5eb7-5636-8bba-650d60f1c196
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b407d0>
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e282d348-5eb7-5636-8bba-650d60f1c196/e282d348-5eb7-5636-8bba-650d60f1c196_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ18UDV%252F698981125%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981125/600 saved to cache
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e282d348-5eb7-5636-8bba-650d60f1c196
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b42750>
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ca5cba-185e-521d-a3da-10f6c18734b3/70ca5cba-185e-521d-a3da-10f6c18734b3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL4VSX%252F698976047%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976047/600 saved to cache
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70ca5cba-185e-521d-a3da-10f6c18734b3
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547114cd0>
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d06042a9-4183-5322-b0e5-834acfc52d31/d06042a9-4183-5322-b0e5-834acfc52d31_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD72JHL%252F699158989%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158989/600 saved to cache
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d06042a9-4183-5322-b0e5-834acfc52d31
2026-03-28 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993574/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993574>
2026-03-28 22:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976035/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L4VSX/42810494?sv=2020-08-04&st=2026-03-28T22%3A05%3A40Z&se=2026-03-28T22%3A30%3A40Z&sr=b&sp=r&sig=mE8nvjL4n0uJDp6MhHZh7AnsGKq4y8zOa73KiQps19o%3D)
2026-03-28 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981042/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981042>
2026-03-28 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971854/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971854>
2026-03-28 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972712/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698972712>
2026-03-28 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993569/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993569>
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547255e10>
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d06042a9-4183-5322-b0e5-834acfc52d31/d06042a9-4183-5322-b0e5-834acfc52d31_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD72JHL%252F699158982%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158982/600 saved to cache
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d06042a9-4183-5322-b0e5-834acfc52d31
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b0e050>
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d06042a9-4183-5322-b0e5-834acfc52d31/d06042a9-4183-5322-b0e5-834acfc52d31_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD72JHL%252F699158957%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158957/600 saved to cache
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d06042a9-4183-5322-b0e5-834acfc52d31
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543ff550>
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9eb7897-258a-53be-b988-82acf7b5019f/c9eb7897-258a-53be-b988-82acf7b5019f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU70SXD%252F699208602%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208602/600 saved to cache
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9eb7897-258a-53be-b988-82acf7b5019f
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554285d10>
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_468e3ba1-3197-5e32-97b6-5380ba714d59/468e3ba1-3197-5e32-97b6-5380ba714d59_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE05WVK%252F699015457%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015457/600 saved to cache
2026-03-28 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 468e3ba1-3197-5e32-97b6-5380ba714d59
2026-03-28 22:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208592/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU70SXD/42803394?sv=2020-08-04&st=2026-03-28T22%3A05%3A39Z&se=2026-03-28T22%3A30%3A39Z&sr=b&sp=r&sig=a3zG5kKyKp3Odn7LKH%2F%2FskO1ryy5RWm7DEi%2F2QHY28A%3D)
2026-03-28 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158931/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158931>
2026-03-28 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971839/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971839>
2026-03-28 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015388/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015388>
2026-03-28 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015405/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015405>
2026-03-28 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972691/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698972691>
2026-03-28 22:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158947/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD72JHL/42807865?sv=2020-08-04&st=2026-03-28T22%3A05%3A38Z&se=2026-03-28T22%3A30%3A38Z&sr=b&sp=r&sig=wwsnAuuWBNQzl1pmQDzNNycU4Ea5d5vZNz1D45DsB2o%3D)
2026-03-28 22:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015442/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE05WVK/42811009?sv=2020-08-04&st=2026-03-28T22%3A05%3A36Z&se=2026-03-28T22%3A30%3A36Z&sr=b&sp=r&sig=mupgw8rLb3y7HRkTTcsDAEi9vH9L04U4rd3rmNORr9c%3D)
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554968c50>
2026-03-28 22:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ca5cba-185e-521d-a3da-10f6c18734b3/70ca5cba-185e-521d-a3da-10f6c18734b3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL4VSX%252F698976035%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976035/600 saved to cache
2026-03-28 22:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70ca5cba-185e-521d-a3da-10f6c18734b3
2026-03-28 22:05:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70ca5cba-185e-521d-a3da-10f6c18734b3, skipping ID generation
2026-03-28 22:05:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70ca5cba-185e-521d-a3da-10f6c18734b3 sending to next pipeline
2026-03-28 22:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 70ca5cba-185e-521d-a3da-10f6c18734b3, identifier: L4%20VSX
2026-03-28 22:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 70ca5cba-185e-521d-a3da-10f6c18734b3 with identifier: L4%20VSX
2026-03-28 22:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 70ca5cba-185e-521d-a3da-10f6c18734b3 with identifier: L4%20VSX
2026-03-28 22:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 70ca5cba-185e-521d-a3da-10f6c18734b3 with identifier: L4%20VSX to the API
2026-03-28 22:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976035/600>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ca5cba-185e-521d-a3da-10f6c18734b3/70ca5cba-185e-521d-a3da-10f6c18734b3_expert_report_file_49f2589c-37f7-405c-8b53-f8b0238754bb.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=L4%20VSX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '70ca5cba-185e-521d-a3da-10f6c18734b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'L4 VSX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=L4%20VSX&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 91557,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ca5cba-185e-521d-a3da-10f6c18734b3/70ca5cba-185e-521d-a3da-10f6c18734b3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38998,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976035/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ca5cba-185e-521d-a3da-10f6c18734b3/70ca5cba-185e-521d-a3da-10f6c18734b3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39526,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976047/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ca5cba-185e-521d-a3da-10f6c18734b3/70ca5cba-185e-521d-a3da-10f6c18734b3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40179,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976058/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ca5cba-185e-521d-a3da-10f6c18734b3/70ca5cba-185e-521d-a3da-10f6c18734b3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40715,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976071/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ca5cba-185e-521d-a3da-10f6c18734b3/70ca5cba-185e-521d-a3da-10f6c18734b3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36016,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976096/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ca5cba-185e-521d-a3da-10f6c18734b3/70ca5cba-185e-521d-a3da-10f6c18734b3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34262,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976114/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ca5cba-185e-521d-a3da-10f6c18734b3/70ca5cba-185e-521d-a3da-10f6c18734b3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91355,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976143/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ca5cba-185e-521d-a3da-10f6c18734b3/70ca5cba-185e-521d-a3da-10f6c18734b3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84578,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976179/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ca5cba-185e-521d-a3da-10f6c18734b3/70ca5cba-185e-521d-a3da-10f6c18734b3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95908,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976208/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ca5cba-185e-521d-a3da-10f6c18734b3/70ca5cba-185e-521d-a3da-10f6c18734b3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82844,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L4VSX/698976240/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'ZETEC',
'vin': 'WF0PXXWPDP8B53141',
'year': 2008}
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L4%2520VSX%27 HTTP/1.1" 200 None
2026-03-28 22:05:47 [bca.uk] INFO: Saving data for L4%20VSX: {'created_time': 1774735547.169539, 'last_price_update_time': 1774735547.169551, 'auction_closing_time': 1774864800.0}
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='L4%2520VSX') HTTP/1.1" 204 0
2026-03-28 22:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981042/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ18UDV/42810737?sv=2020-08-04&st=2026-03-28T22%3A05%3A39Z&se=2026-03-28T22%3A30%3A39Z&sr=b&sp=r&sig=xPZ7CxqtsgJvIvegCHBul0ES2CauNHQg2jhr9TcwBRs%3D)
2026-03-28 22:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981070/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ18UDV/42810737?sv=2020-08-04&st=2026-03-28T22%3A05%3A39Z&se=2026-03-28T22%3A30%3A39Z&sr=b&sp=r&sig=xPZ7CxqtsgJvIvegCHBul0ES2CauNHQg2jhr9TcwBRs%3D)
2026-03-28 22:05:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972674/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698972674>
2026-03-28 22:05:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971819/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971819>
2026-03-28 22:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971854/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL71EGE/42810664?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=9jRkf4Wr%2B%2FWN%2B1GfIm%2BRv9CJsfAX3NU6%2B1LwAsEPOgc%3D)
2026-03-28 22:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972712/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF68PYB/42810634?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=Qnbhc%2F3Nk5rBw4e6MkVvsnHTegd%2BbIJ4VYeule%2Bchng%3D)
2026-03-28 22:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993569/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA08JSV/42810825?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=U0wXwnmUHBvUuIYY%2ByLlbm%2FfPTDnQQS8jjz532gBcFY%3D)
2026-03-28 22:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993574/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA08JSV/42810825?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=U0wXwnmUHBvUuIYY%2ByLlbm%2FfPTDnQQS8jjz532gBcFY%3D)
2026-03-28 22:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471ef290>
2026-03-28 22:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9eb7897-258a-53be-b988-82acf7b5019f/c9eb7897-258a-53be-b988-82acf7b5019f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU70SXD%252F699208592%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208592/600 saved to cache
2026-03-28 22:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9eb7897-258a-53be-b988-82acf7b5019f
2026-03-28 22:05:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9eb7897-258a-53be-b988-82acf7b5019f, skipping ID generation
2026-03-28 22:05:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9eb7897-258a-53be-b988-82acf7b5019f sending to next pipeline
2026-03-28 22:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c9eb7897-258a-53be-b988-82acf7b5019f, identifier: GU70%20SXD
2026-03-28 22:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547743410>
2026-03-28 22:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d06042a9-4183-5322-b0e5-834acfc52d31/d06042a9-4183-5322-b0e5-834acfc52d31_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD72JHL%252F699158947%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158947/600 saved to cache
2026-03-28 22:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d06042a9-4183-5322-b0e5-834acfc52d31
2026-03-28 22:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55484a910>
2026-03-28 22:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_468e3ba1-3197-5e32-97b6-5380ba714d59/468e3ba1-3197-5e32-97b6-5380ba714d59_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE05WVK%252F699015442%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015442/600 saved to cache
2026-03-28 22:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 468e3ba1-3197-5e32-97b6-5380ba714d59
2026-03-28 22:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c9eb7897-258a-53be-b988-82acf7b5019f with identifier: GU70%20SXD
2026-03-28 22:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c9eb7897-258a-53be-b988-82acf7b5019f with identifier: GU70%20SXD
2026-03-28 22:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c9eb7897-258a-53be-b988-82acf7b5019f with identifier: GU70%20SXD to the API
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208592/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9eb7897-258a-53be-b988-82acf7b5019f/c9eb7897-258a-53be-b988-82acf7b5019f_expert_report_file_560c974d-1c8d-4788-9862-ea8a7fb0562a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU70%20SXD-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c9eb7897-258a-53be-b988-82acf7b5019f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU70 SXD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GU70%20SXD&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'BMW',
'model': '118I',
'odometer': 44349,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9eb7897-258a-53be-b988-82acf7b5019f/c9eb7897-258a-53be-b988-82acf7b5019f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47530,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208592/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9eb7897-258a-53be-b988-82acf7b5019f/c9eb7897-258a-53be-b988-82acf7b5019f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46359,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208602/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9eb7897-258a-53be-b988-82acf7b5019f/c9eb7897-258a-53be-b988-82acf7b5019f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41208,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208618/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9eb7897-258a-53be-b988-82acf7b5019f/c9eb7897-258a-53be-b988-82acf7b5019f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41323,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208643/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9eb7897-258a-53be-b988-82acf7b5019f/c9eb7897-258a-53be-b988-82acf7b5019f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40397,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208659/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9eb7897-258a-53be-b988-82acf7b5019f/c9eb7897-258a-53be-b988-82acf7b5019f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39263,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208671/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9eb7897-258a-53be-b988-82acf7b5019f/c9eb7897-258a-53be-b988-82acf7b5019f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98549,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208689/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9eb7897-258a-53be-b988-82acf7b5019f/c9eb7897-258a-53be-b988-82acf7b5019f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87240,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208710/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9eb7897-258a-53be-b988-82acf7b5019f/c9eb7897-258a-53be-b988-82acf7b5019f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99837,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208736/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9eb7897-258a-53be-b988-82acf7b5019f/c9eb7897-258a-53be-b988-82acf7b5019f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75023,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU70SXD/699208754/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'BMW 118I 1.5 M SPORT Hatchback',
'transmission': 'manual',
'trim': 'M SPORT',
'vin': 'WBA7K320807G76551',
'year': 2020}
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU70%2520SXD%27 HTTP/1.1" 200 None
2026-03-28 22:05:47 [bca.uk] INFO: Saving data for GU70%20SXD: {'created_time': 1774735547.791472, 'last_price_update_time': 1774735547.791483, 'auction_closing_time': 1774864800.0}
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GU70%2520SXD') HTTP/1.1" 204 0
2026-03-28 22:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158931/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WD72JHL/42807865?sv=2020-08-04&st=2026-03-28T22%3A05%3A38Z&se=2026-03-28T22%3A30%3A38Z&sr=b&sp=r&sig=wwsnAuuWBNQzl1pmQDzNNycU4Ea5d5vZNz1D45DsB2o%3D)
2026-03-28 22:05:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015369/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015369>
2026-03-28 22:05:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972661/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698972661>
2026-03-28 22:05:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981252/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981252>
2026-03-28 22:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015388/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE05WVK/42811009?sv=2020-08-04&st=2026-03-28T22%3A05%3A36Z&se=2026-03-28T22%3A30%3A36Z&sr=b&sp=r&sig=mupgw8rLb3y7HRkTTcsDAEi9vH9L04U4rd3rmNORr9c%3D)
2026-03-28 22:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972691/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF68PYB/42810634?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=Qnbhc%2F3Nk5rBw4e6MkVvsnHTegd%2BbIJ4VYeule%2Bchng%3D)
2026-03-28 22:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547172810>
2026-03-28 22:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e282d348-5eb7-5636-8bba-650d60f1c196/e282d348-5eb7-5636-8bba-650d60f1c196_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ18UDV%252F698981042%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981042/600 saved to cache
2026-03-28 22:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e282d348-5eb7-5636-8bba-650d60f1c196
2026-03-28 22:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547631e50>
2026-03-28 22:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e282d348-5eb7-5636-8bba-650d60f1c196/e282d348-5eb7-5636-8bba-650d60f1c196_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ18UDV%252F698981070%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981070/600 saved to cache
2026-03-28 22:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e282d348-5eb7-5636-8bba-650d60f1c196
2026-03-28 22:05:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e282d348-5eb7-5636-8bba-650d60f1c196, skipping ID generation
2026-03-28 22:05:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e282d348-5eb7-5636-8bba-650d60f1c196 sending to next pipeline
2026-03-28 22:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e282d348-5eb7-5636-8bba-650d60f1c196, identifier: MJ18%20UDV
2026-03-28 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543fef50>
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b35f19-803b-5916-9d73-8fe099e2d84a/31b35f19-803b-5916-9d73-8fe099e2d84a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL71EGE%252F698971854%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971854/600 saved to cache
2026-03-28 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 31b35f19-803b-5916-9d73-8fe099e2d84a
2026-03-28 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547106f50>
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1941c029-e601-57db-8da4-77ae3b1b387e/1941c029-e601-57db-8da4-77ae3b1b387e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF68PYB%252F698972712%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972712/600 saved to cache
2026-03-28 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1941c029-e601-57db-8da4-77ae3b1b387e
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547319890>
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f257efe2-daf9-5bd3-a5cb-758b3c74ea0d/f257efe2-daf9-5bd3-a5cb-758b3c74ea0d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA08JSV%252F698993569%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993569/600 saved to cache
2026-03-28 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f257efe2-daf9-5bd3-a5cb-758b3c74ea0d
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f98f90>
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f257efe2-daf9-5bd3-a5cb-758b3c74ea0d/f257efe2-daf9-5bd3-a5cb-758b3c74ea0d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA08JSV%252F698993574%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993574/600 saved to cache
2026-03-28 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f257efe2-daf9-5bd3-a5cb-758b3c74ea0d
2026-03-28 22:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015405/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE05WVK/42811009?sv=2020-08-04&st=2026-03-28T22%3A05%3A36Z&se=2026-03-28T22%3A30%3A36Z&sr=b&sp=r&sig=mupgw8rLb3y7HRkTTcsDAEi9vH9L04U4rd3rmNORr9c%3D)
2026-03-28 22:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971839/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL71EGE/42810664?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=9jRkf4Wr%2B%2FWN%2B1GfIm%2BRv9CJsfAX3NU6%2B1LwAsEPOgc%3D)
2026-03-28 22:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e282d348-5eb7-5636-8bba-650d60f1c196 with identifier: MJ18%20UDV
2026-03-28 22:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e282d348-5eb7-5636-8bba-650d60f1c196 with identifier: MJ18%20UDV
2026-03-28 22:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e282d348-5eb7-5636-8bba-650d60f1c196 with identifier: MJ18%20UDV to the API
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981070/600>
{'auction_title': '',
'c_o_2_emission_value': 132,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e282d348-5eb7-5636-8bba-650d60f1c196/e282d348-5eb7-5636-8bba-650d60f1c196_expert_report_file_42a57d69-f69a-461c-b227-2124c6408022.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MJ18%20UDV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e282d348-5eb7-5636-8bba-650d60f1c196',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MJ18 UDV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MJ18%20UDV&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'AUDI',
'model': 'Q5',
'odometer': 73762,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e282d348-5eb7-5636-8bba-650d60f1c196/e282d348-5eb7-5636-8bba-650d60f1c196_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45013,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981024/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e282d348-5eb7-5636-8bba-650d60f1c196/e282d348-5eb7-5636-8bba-650d60f1c196_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43133,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981042/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e282d348-5eb7-5636-8bba-650d60f1c196/e282d348-5eb7-5636-8bba-650d60f1c196_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41658,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981070/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e282d348-5eb7-5636-8bba-650d60f1c196/e282d348-5eb7-5636-8bba-650d60f1c196_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42263,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981089/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e282d348-5eb7-5636-8bba-650d60f1c196/e282d348-5eb7-5636-8bba-650d60f1c196_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37821,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981125/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e282d348-5eb7-5636-8bba-650d60f1c196/e282d348-5eb7-5636-8bba-650d60f1c196_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35755,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981146/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e282d348-5eb7-5636-8bba-650d60f1c196/e282d348-5eb7-5636-8bba-650d60f1c196_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87166,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981175/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e282d348-5eb7-5636-8bba-650d60f1c196/e282d348-5eb7-5636-8bba-650d60f1c196_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84957,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981202/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e282d348-5eb7-5636-8bba-650d60f1c196/e282d348-5eb7-5636-8bba-650d60f1c196_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97387,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981242/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e282d348-5eb7-5636-8bba-650d60f1c196/e282d348-5eb7-5636-8bba-650d60f1c196_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100700,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ18UDV/698981276/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'AUDI Q5 2.0 TDI 190 QUATTRO SPORT S-T StationWagon',
'transmission': 'automatic',
'trim': 'TDI 190 QUATTRO SPORT S-T',
'vin': 'WAUZZZFYXJ2150148',
'year': 2018}
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ18%2520UDV%27 HTTP/1.1" 200 None
2026-03-28 22:05:48 [bca.uk] INFO: Saving data for MJ18%20UDV: {'created_time': 1774735548.62935, 'last_price_update_time': 1774735548.62936, 'auction_closing_time': 1774778400.0}
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MJ18%2520UDV') HTTP/1.1" 204 0
2026-03-28 22:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981209/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981209>
2026-03-28 22:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981176/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981176>
2026-03-28 22:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971803/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971803>
2026-03-28 22:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993546/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993546>
2026-03-28 22:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972674/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF68PYB/42810634?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=Qnbhc%2F3Nk5rBw4e6MkVvsnHTegd%2BbIJ4VYeule%2Bchng%3D)
2026-03-28 22:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971819/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL71EGE/42810664?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=9jRkf4Wr%2B%2FWN%2B1GfIm%2BRv9CJsfAX3NU6%2B1LwAsEPOgc%3D)
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555ca6110>
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d06042a9-4183-5322-b0e5-834acfc52d31/d06042a9-4183-5322-b0e5-834acfc52d31_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWD72JHL%252F699158931%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158931/600 saved to cache
2026-03-28 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d06042a9-4183-5322-b0e5-834acfc52d31
2026-03-28 22:05:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d06042a9-4183-5322-b0e5-834acfc52d31, skipping ID generation
2026-03-28 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d06042a9-4183-5322-b0e5-834acfc52d31 sending to next pipeline
2026-03-28 22:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d06042a9-4183-5322-b0e5-834acfc52d31, identifier: WD72%20JHL
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547325350>
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_468e3ba1-3197-5e32-97b6-5380ba714d59/468e3ba1-3197-5e32-97b6-5380ba714d59_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE05WVK%252F699015388%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015388/600 saved to cache
2026-03-28 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 468e3ba1-3197-5e32-97b6-5380ba714d59
2026-03-28 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547683bd0>
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1941c029-e601-57db-8da4-77ae3b1b387e/1941c029-e601-57db-8da4-77ae3b1b387e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF68PYB%252F698972691%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972691/600 saved to cache
2026-03-28 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1941c029-e601-57db-8da4-77ae3b1b387e
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547479ed0>
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_468e3ba1-3197-5e32-97b6-5380ba714d59/468e3ba1-3197-5e32-97b6-5380ba714d59_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE05WVK%252F699015405%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015405/600 saved to cache
2026-03-28 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 468e3ba1-3197-5e32-97b6-5380ba714d59
2026-03-28 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547105b10>
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b35f19-803b-5916-9d73-8fe099e2d84a/31b35f19-803b-5916-9d73-8fe099e2d84a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL71EGE%252F698971839%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971839/600 saved to cache
2026-03-28 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 31b35f19-803b-5916-9d73-8fe099e2d84a
2026-03-28 22:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d06042a9-4183-5322-b0e5-834acfc52d31 with identifier: WD72%20JHL
2026-03-28 22:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d06042a9-4183-5322-b0e5-834acfc52d31 with identifier: WD72%20JHL
2026-03-28 22:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d06042a9-4183-5322-b0e5-834acfc52d31 with identifier: WD72%20JHL to the API
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158931/600>
{'auction_title': '',
'c_o_2_emission_value': 131,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d06042a9-4183-5322-b0e5-834acfc52d31/d06042a9-4183-5322-b0e5-834acfc52d31_expert_report_file_05f4ab43-dde0-4d2a-b465-4d90c0cfe1b3.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WD72%20JHL-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd06042a9-4183-5322-b0e5-834acfc52d31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WD72 JHL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WD72%20JHL&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 32638,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d06042a9-4183-5322-b0e5-834acfc52d31/d06042a9-4183-5322-b0e5-834acfc52d31_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49139,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158912/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d06042a9-4183-5322-b0e5-834acfc52d31/d06042a9-4183-5322-b0e5-834acfc52d31_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49539,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158925/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d06042a9-4183-5322-b0e5-834acfc52d31/d06042a9-4183-5322-b0e5-834acfc52d31_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48235,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158931/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d06042a9-4183-5322-b0e5-834acfc52d31/d06042a9-4183-5322-b0e5-834acfc52d31_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46785,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158942/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d06042a9-4183-5322-b0e5-834acfc52d31/d06042a9-4183-5322-b0e5-834acfc52d31_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43589,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158947/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d06042a9-4183-5322-b0e5-834acfc52d31/d06042a9-4183-5322-b0e5-834acfc52d31_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45088,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158957/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d06042a9-4183-5322-b0e5-834acfc52d31/d06042a9-4183-5322-b0e5-834acfc52d31_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91799,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158970/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d06042a9-4183-5322-b0e5-834acfc52d31/d06042a9-4183-5322-b0e5-834acfc52d31_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79224,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158982/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d06042a9-4183-5322-b0e5-834acfc52d31/d06042a9-4183-5322-b0e5-834acfc52d31_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90994,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699158989/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d06042a9-4183-5322-b0e5-834acfc52d31/d06042a9-4183-5322-b0e5-834acfc52d31_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77132,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WD72JHL/699159002/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 100 ST-LINE X Hatchback',
'transmission': 'manual',
'trim': 'E/B 100 ST-LINE X',
'vin': 'WF0JXXGAHJNG89582',
'year': 2023}
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD72%2520JHL%27 HTTP/1.1" 200 None
2026-03-28 22:05:49 [bca.uk] INFO: Saving data for WD72%20JHL: {'created_time': 1774735549.31875, 'last_price_update_time': 1774735549.318764, 'auction_closing_time': 1774864800.0}
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WD72%2520JHL') HTTP/1.1" 204 0
2026-03-28 22:05:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS69HBC/42809493?sv=2020-08-04&st=2026-03-28T22%3A05%3A48Z&se=2026-03-28T22%3A30%3A48Z&sr=b&sp=r&sig=RPTbTL6IWpJUqHEI5e6UpRd1kf3yXEufMgKsYj7zUWk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KS69%20HBC-GB>
2026-03-28 22:05:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972622/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698972622>
2026-03-28 22:05:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971780/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971780>
2026-03-28 22:05:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ69TFF/42809455?sv=2020-08-04&st=2026-03-28T22%3A05%3A48Z&se=2026-03-28T22%3A30%3A48Z&sr=b&sp=r&sig=E3vyVEVNQt9QGJ6lipDyfIWGUUx355bY1acjAnvJwVM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EJ69%20TFF-GB>
2026-03-28 22:05:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015339/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PE05WVK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981252/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ20UMA/42810780?sv=2020-08-04&st=2026-03-28T22%3A05%3A32Z&se=2026-03-28T22%3A30%3A32Z&sr=b&sp=r&sig=bOMtVseDP5%2B4q3gO7UJt%2FRZXlewTKJ%2F8pF1iERt4wLA%3D)
2026-03-28 22:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972661/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF68PYB/42810634?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=Qnbhc%2F3Nk5rBw4e6MkVvsnHTegd%2BbIJ4VYeule%2Bchng%3D)
2026-03-28 22:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015369/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE05WVK/42811009?sv=2020-08-04&st=2026-03-28T22%3A05%3A36Z&se=2026-03-28T22%3A30%3A36Z&sr=b&sp=r&sig=mupgw8rLb3y7HRkTTcsDAEi9vH9L04U4rd3rmNORr9c%3D)
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b89f50>
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1941c029-e601-57db-8da4-77ae3b1b387e/1941c029-e601-57db-8da4-77ae3b1b387e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF68PYB%252F698972674%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972674/600 saved to cache
2026-03-28 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1941c029-e601-57db-8da4-77ae3b1b387e
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54713d690>
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b35f19-803b-5916-9d73-8fe099e2d84a/31b35f19-803b-5916-9d73-8fe099e2d84a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL71EGE%252F698971819%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971819/600 saved to cache
2026-03-28 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 31b35f19-803b-5916-9d73-8fe099e2d84a
2026-03-28 22:05:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972614/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698972614>
2026-03-28 22:05:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971763/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971763>
2026-03-28 22:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993546/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA08JSV/42810825?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=U0wXwnmUHBvUuIYY%2ByLlbm%2FfPTDnQQS8jjz532gBcFY%3D)
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547265510>
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_182b028b-defa-51b3-b97c-bb87ff17eb7b/182b028b-defa-51b3-b97c-bb87ff17eb7b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ20UMA%252F698981252%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981252/600 saved to cache
2026-03-28 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 182b028b-defa-51b3-b97c-bb87ff17eb7b
2026-03-28 22:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972622/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF68PYB/42810634?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=Qnbhc%2F3Nk5rBw4e6MkVvsnHTegd%2BbIJ4VYeule%2Bchng%3D)
2026-03-28 22:05:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981128/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981128>
2026-03-28 22:05:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145743/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145743>
2026-03-28 22:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971780/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL71EGE/42810664?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=9jRkf4Wr%2B%2FWN%2B1GfIm%2BRv9CJsfAX3NU6%2B1LwAsEPOgc%3D)
2026-03-28 22:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971803/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL71EGE/42810664?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=9jRkf4Wr%2B%2FWN%2B1GfIm%2BRv9CJsfAX3NU6%2B1LwAsEPOgc%3D)
2026-03-28 22:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS69HBC/42809493?sv=2020-08-04&st=2026-03-28T22%3A05%3A48Z&se=2026-03-28T22%3A30%3A48Z&sr=b&sp=r&sig=RPTbTL6IWpJUqHEI5e6UpRd1kf3yXEufMgKsYj7zUWk%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981209/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ20UMA/42810780?sv=2020-08-04&st=2026-03-28T22%3A05%3A32Z&se=2026-03-28T22%3A30%3A32Z&sr=b&sp=r&sig=bOMtVseDP5%2B4q3gO7UJt%2FRZXlewTKJ%2F8pF1iERt4wLA%3D)
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe564c10bd0>
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1941c029-e601-57db-8da4-77ae3b1b387e/1941c029-e601-57db-8da4-77ae3b1b387e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF68PYB%252F698972661%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972661/600 saved to cache
2026-03-28 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1941c029-e601-57db-8da4-77ae3b1b387e
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473dd210>
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_468e3ba1-3197-5e32-97b6-5380ba714d59/468e3ba1-3197-5e32-97b6-5380ba714d59_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE05WVK%252F699015369%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015369/600 saved to cache
2026-03-28 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 468e3ba1-3197-5e32-97b6-5380ba714d59
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554250810>
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f257efe2-daf9-5bd3-a5cb-758b3c74ea0d/f257efe2-daf9-5bd3-a5cb-758b3c74ea0d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA08JSV%252F698993546%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993546/600 saved to cache
2026-03-28 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f257efe2-daf9-5bd3-a5cb-758b3c74ea0d
2026-03-28 22:05:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971746/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971746>
2026-03-28 22:05:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145730/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145730>
2026-03-28 22:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981176/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ20UMA/42810780?sv=2020-08-04&st=2026-03-28T22%3A05%3A32Z&se=2026-03-28T22%3A30%3A32Z&sr=b&sp=r&sig=bOMtVseDP5%2B4q3gO7UJt%2FRZXlewTKJ%2F8pF1iERt4wLA%3D)
2026-03-28 22:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015339/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE05WVK/42811009?sv=2020-08-04&st=2026-03-28T22%3A05%3A36Z&se=2026-03-28T22%3A30%3A36Z&sr=b&sp=r&sig=mupgw8rLb3y7HRkTTcsDAEi9vH9L04U4rd3rmNORr9c%3D)
2026-03-28 22:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ69TFF/42809455?sv=2020-08-04&st=2026-03-28T22%3A05%3A48Z&se=2026-03-28T22%3A30%3A48Z&sr=b&sp=r&sig=E3vyVEVNQt9QGJ6lipDyfIWGUUx355bY1acjAnvJwVM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547682810>
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1941c029-e601-57db-8da4-77ae3b1b387e/1941c029-e601-57db-8da4-77ae3b1b387e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF68PYB%252F698972622%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972622/600 saved to cache
2026-03-28 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1941c029-e601-57db-8da4-77ae3b1b387e
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543ff4d0>
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b35f19-803b-5916-9d73-8fe099e2d84a/31b35f19-803b-5916-9d73-8fe099e2d84a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL71EGE%252F698971780%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971780/600 saved to cache
2026-03-28 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 31b35f19-803b-5916-9d73-8fe099e2d84a
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554978d90>
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b35f19-803b-5916-9d73-8fe099e2d84a/31b35f19-803b-5916-9d73-8fe099e2d84a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL71EGE%252F698971803%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971803/600 saved to cache
2026-03-28 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 31b35f19-803b-5916-9d73-8fe099e2d84a
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55430e3d0>
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567b92e4-538d-5dfd-a509-01ee1c685e60/567b92e4-538d-5dfd-a509-01ee1c685e60_expert_report_file_85875d39-97ba-43e4-b63a-031c437498be.pdf HTTP/1.1" 201 0
2026-03-28 22:05:49 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 567b92e4-538d-5dfd-a509-01ee1c685e60
2026-03-28 22:05:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 567b92e4-538d-5dfd-a509-01ee1c685e60, skipping ID generation
2026-03-28 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 567b92e4-538d-5dfd-a509-01ee1c685e60
2026-03-28 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKS69HBC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KS69HBC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55497b1d0>
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_182b028b-defa-51b3-b97c-bb87ff17eb7b/182b028b-defa-51b3-b97c-bb87ff17eb7b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ20UMA%252F698981209%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981209/600 saved to cache
2026-03-28 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 182b028b-defa-51b3-b97c-bb87ff17eb7b
2026-03-28 22:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972614/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF68PYB/42810634?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=Qnbhc%2F3Nk5rBw4e6MkVvsnHTegd%2BbIJ4VYeule%2Bchng%3D)
2026-03-28 22:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981128/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ20UMA/42810780?sv=2020-08-04&st=2026-03-28T22%3A05%3A32Z&se=2026-03-28T22%3A30%3A32Z&sr=b&sp=r&sig=bOMtVseDP5%2B4q3gO7UJt%2FRZXlewTKJ%2F8pF1iERt4wLA%3D)
2026-03-28 22:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971763/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL71EGE/42810664?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=9jRkf4Wr%2B%2FWN%2B1GfIm%2BRv9CJsfAX3NU6%2B1LwAsEPOgc%3D)
2026-03-28 22:05:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993512/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YA08JSV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981100/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981100>
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699330700%27 HTTP/1.1" 200 None
2026-03-28 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330700 not downloaded yet
2026-03-28 22:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145743/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML09TVX/42810920?sv=2020-08-04&st=2026-03-28T22%3A05%3A29Z&se=2026-03-28T22%3A30%3A29Z&sr=b&sp=r&sig=3CS5OP6y37ZBf1km95kjXxQgZGTyyd1Q098%2Fto%2FWbZ0%3D)
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699330703%27 HTTP/1.1" 200 None
2026-03-28 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330703 not downloaded yet
2026-03-28 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471a2c90>
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_182b028b-defa-51b3-b97c-bb87ff17eb7b/182b028b-defa-51b3-b97c-bb87ff17eb7b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ20UMA%252F698981176%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981176/600 saved to cache
2026-03-28 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 182b028b-defa-51b3-b97c-bb87ff17eb7b
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54713eed0>
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_468e3ba1-3197-5e32-97b6-5380ba714d59/468e3ba1-3197-5e32-97b6-5380ba714d59_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE05WVK%252F699015339%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015339/600 saved to cache
2026-03-28 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 468e3ba1-3197-5e32-97b6-5380ba714d59
2026-03-28 22:05:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 468e3ba1-3197-5e32-97b6-5380ba714d59, skipping ID generation
2026-03-28 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 468e3ba1-3197-5e32-97b6-5380ba714d59 sending to next pipeline
2026-03-28 22:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 468e3ba1-3197-5e32-97b6-5380ba714d59, identifier: PE05%20WVK
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b40510>
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0000ca0-cda2-564a-a588-b58706c95283/a0000ca0-cda2-564a-a588-b58706c95283_expert_report_file_751445b6-6112-4cd7-b6b5-fe0c7535bcd5.pdf HTTP/1.1" 201 0
2026-03-28 22:05:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a0000ca0-cda2-564a-a588-b58706c95283
2026-03-28 22:05:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0000ca0-cda2-564a-a588-b58706c95283, skipping ID generation
2026-03-28 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a0000ca0-cda2-564a-a588-b58706c95283
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEJ69TFF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EJ69TFF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699330707%27 HTTP/1.1" 200 None
2026-03-28 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330707 not downloaded yet
2026-03-28 22:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 468e3ba1-3197-5e32-97b6-5380ba714d59 with identifier: PE05%20WVK
2026-03-28 22:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 468e3ba1-3197-5e32-97b6-5380ba714d59 with identifier: PE05%20WVK
2026-03-28 22:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 468e3ba1-3197-5e32-97b6-5380ba714d59 with identifier: PE05%20WVK to the API
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015339/600>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468e3ba1-3197-5e32-97b6-5380ba714d59/468e3ba1-3197-5e32-97b6-5380ba714d59_expert_report_file_cf954390-c323-4eb6-ada7-50bd31c4081e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PE05%20WVK-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '468e3ba1-3197-5e32-97b6-5380ba714d59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PE05 WVK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PE05%20WVK&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 98719,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468e3ba1-3197-5e32-97b6-5380ba714d59/468e3ba1-3197-5e32-97b6-5380ba714d59_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 185035,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015339/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468e3ba1-3197-5e32-97b6-5380ba714d59/468e3ba1-3197-5e32-97b6-5380ba714d59_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183096,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015345/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468e3ba1-3197-5e32-97b6-5380ba714d59/468e3ba1-3197-5e32-97b6-5380ba714d59_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182748,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015355/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468e3ba1-3197-5e32-97b6-5380ba714d59/468e3ba1-3197-5e32-97b6-5380ba714d59_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179028,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015369/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468e3ba1-3197-5e32-97b6-5380ba714d59/468e3ba1-3197-5e32-97b6-5380ba714d59_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 127132,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015388/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468e3ba1-3197-5e32-97b6-5380ba714d59/468e3ba1-3197-5e32-97b6-5380ba714d59_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 136126,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015405/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468e3ba1-3197-5e32-97b6-5380ba714d59/468e3ba1-3197-5e32-97b6-5380ba714d59_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151556,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015424/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468e3ba1-3197-5e32-97b6-5380ba714d59/468e3ba1-3197-5e32-97b6-5380ba714d59_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 138974,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015442/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468e3ba1-3197-5e32-97b6-5380ba714d59/468e3ba1-3197-5e32-97b6-5380ba714d59_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154965,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE05WVK/699015457/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.4 ZETEC 16V Hatchback',
'transmission': 'manual',
'trim': 'ZETEC 16V',
'vin': 'WF0HXXGAJH5U49834',
'year': 2005}
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE05%2520WVK%27 HTTP/1.1" 200 None
2026-03-28 22:05:50 [bca.uk] INFO: Saving data for PE05%20WVK: {'created_time': 1774735550.768535, 'last_price_update_time': 1774735550.768547, 'auction_closing_time': 1774778400.0}
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PE05%2520WVK') HTTP/1.1" 204 0
2026-03-28 22:05:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE70UFX/42810935?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=d6kzkQBS6qyUOSn%2FKWcXlM7owUfN8r20q1jXHVNaPsQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FE70%20UFX-GB>
2026-03-28 22:05:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972598/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698972598>
2026-03-28 22:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971746/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL71EGE/42810664?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=9jRkf4Wr%2B%2FWN%2B1GfIm%2BRv9CJsfAX3NU6%2B1LwAsEPOgc%3D)
2026-03-28 22:05:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145719/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145719>
2026-03-28 22:05:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971732/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971732>
2026-03-28 22:05:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX71JPO/42805662?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=xA8%2BwPzsdUYGq0awyU%2BCpPk%2BGKY5WK5rDm563xgRFtc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EX71%20JPO-GB>
2026-03-28 22:05:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EP68DWV/42810946?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=1uJdwmrGOIygBj5SYsULEl4Y3gQ8gCcgWMy197GaNm4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EP68%20DWV-GB>
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699084986%27 HTTP/1.1" 200 None
2026-03-28 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699084986 not downloaded yet
2026-03-28 22:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145730/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML09TVX/42810920?sv=2020-08-04&st=2026-03-28T22%3A05%3A29Z&se=2026-03-28T22%3A30%3A29Z&sr=b&sp=r&sig=3CS5OP6y37ZBf1km95kjXxQgZGTyyd1Q098%2Fto%2FWbZ0%3D)
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699330710%27 HTTP/1.1" 200 None
2026-03-28 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330710 not downloaded yet
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699084996%27 HTTP/1.1" 200 None
2026-03-28 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699084996 not downloaded yet
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699330714%27 HTTP/1.1" 200 None
2026-03-28 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330714 not downloaded yet
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554892d10>
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1941c029-e601-57db-8da4-77ae3b1b387e/1941c029-e601-57db-8da4-77ae3b1b387e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF68PYB%252F698972614%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972614/600 saved to cache
2026-03-28 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1941c029-e601-57db-8da4-77ae3b1b387e
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fd5710>
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_182b028b-defa-51b3-b97c-bb87ff17eb7b/182b028b-defa-51b3-b97c-bb87ff17eb7b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ20UMA%252F698981128%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981128/600 saved to cache
2026-03-28 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 182b028b-defa-51b3-b97c-bb87ff17eb7b
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548c8710>
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b35f19-803b-5916-9d73-8fe099e2d84a/31b35f19-803b-5916-9d73-8fe099e2d84a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL71EGE%252F698971763%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971763/600 saved to cache
2026-03-28 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 31b35f19-803b-5916-9d73-8fe099e2d84a
2026-03-28 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55491ca10>
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d1bd1b-e75f-5786-8613-977c6a06c247/79d1bd1b-e75f-5786-8613-977c6a06c247_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML09TVX%252F699145743%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145743/600 saved to cache
2026-03-28 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 79d1bd1b-e75f-5786-8613-977c6a06c247
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699085005%27 HTTP/1.1" 200 None
2026-03-28 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085005 not downloaded yet
2026-03-28 22:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981100/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ20UMA/42810780?sv=2020-08-04&st=2026-03-28T22%3A05%3A32Z&se=2026-03-28T22%3A30%3A32Z&sr=b&sp=r&sig=bOMtVseDP5%2B4q3gO7UJt%2FRZXlewTKJ%2F8pF1iERt4wLA%3D)
2026-03-28 22:05:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145705/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145705>
2026-03-28 22:05:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330696/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KS69HBC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971706/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FL71EGE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN20ENC/42810973?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=kGUZlxgHDSmh3M8ha1IcDF2bC1%2Bndw%2Fh4Basuy5oHgI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DN20%20ENC-GB>
2026-03-28 22:05:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ68AYD/42810659?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=cnhjX37xQeAN9fU2XVDm5fPqVx51LCxf4mwO0xB6ZyY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ68%20AYD-GB>
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699330719%27 HTTP/1.1" 200 None
2026-03-28 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330719 not downloaded yet
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699085016%27 HTTP/1.1" 200 None
2026-03-28 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085016 not downloaded yet
2026-03-28 22:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993512/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA08JSV/42810825?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=U0wXwnmUHBvUuIYY%2ByLlbm%2FfPTDnQQS8jjz532gBcFY%3D)
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699330722%27 HTTP/1.1" 200 None
2026-03-28 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330722 not downloaded yet
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699085025%27 HTTP/1.1" 200 None
2026-03-28 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085025 not downloaded yet
2026-03-28 22:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473116d0>
2026-03-28 22:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b35f19-803b-5916-9d73-8fe099e2d84a/31b35f19-803b-5916-9d73-8fe099e2d84a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL71EGE%252F698971746%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971746/600 saved to cache
2026-03-28 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 31b35f19-803b-5916-9d73-8fe099e2d84a
2026-03-28 22:05:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471052d0>
2026-03-28 22:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d1bd1b-e75f-5786-8613-977c6a06c247/79d1bd1b-e75f-5786-8613-977c6a06c247_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML09TVX%252F699145730%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145730/600 saved to cache
2026-03-28 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 79d1bd1b-e75f-5786-8613-977c6a06c247
2026-03-28 22:05:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972593/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PF68PYB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699330727%27 HTTP/1.1" 200 None
2026-03-28 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330727 not downloaded yet
2026-03-28 22:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971732/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL71EGE/42810664?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=9jRkf4Wr%2B%2FWN%2B1GfIm%2BRv9CJsfAX3NU6%2B1LwAsEPOgc%3D)
2026-03-28 22:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972598/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF68PYB/42810634?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=Qnbhc%2F3Nk5rBw4e6MkVvsnHTegd%2BbIJ4VYeule%2Bchng%3D)
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699085047%27 HTTP/1.1" 200 None
2026-03-28 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085047 not downloaded yet
2026-03-28 22:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145719/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML09TVX/42810920?sv=2020-08-04&st=2026-03-28T22%3A05%3A29Z&se=2026-03-28T22%3A30%3A29Z&sr=b&sp=r&sig=3CS5OP6y37ZBf1km95kjXxQgZGTyyd1Q098%2Fto%2FWbZ0%3D)
2026-03-28 22:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EP68DWV/42810946?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=1uJdwmrGOIygBj5SYsULEl4Y3gQ8gCcgWMy197GaNm4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699330732%27 HTTP/1.1" 200 None
2026-03-28 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330732 not downloaded yet
2026-03-28 22:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE70UFX/42810935?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=d6kzkQBS6qyUOSn%2FKWcXlM7owUfN8r20q1jXHVNaPsQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX71JPO/42805662?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=xA8%2BwPzsdUYGq0awyU%2BCpPk%2BGKY5WK5rDm563xgRFtc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699085062%27 HTTP/1.1" 200 None
2026-03-28 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085062 not downloaded yet
2026-03-28 22:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547741f10>
2026-03-28 22:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_182b028b-defa-51b3-b97c-bb87ff17eb7b/182b028b-defa-51b3-b97c-bb87ff17eb7b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ20UMA%252F698981100%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981100/600 saved to cache
2026-03-28 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 182b028b-defa-51b3-b97c-bb87ff17eb7b
2026-03-28 22:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b42110>
2026-03-28 22:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f257efe2-daf9-5bd3-a5cb-758b3c74ea0d/f257efe2-daf9-5bd3-a5cb-758b3c74ea0d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA08JSV%252F698993512%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993512/600 saved to cache
2026-03-28 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f257efe2-daf9-5bd3-a5cb-758b3c74ea0d
2026-03-28 22:05:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f257efe2-daf9-5bd3-a5cb-758b3c74ea0d, skipping ID generation
2026-03-28 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f257efe2-daf9-5bd3-a5cb-758b3c74ea0d sending to next pipeline
2026-03-28 22:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f257efe2-daf9-5bd3-a5cb-758b3c74ea0d, identifier: YA08%20JSV
2026-03-28 22:05:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699084972/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EJ69TFF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699085082%27 HTTP/1.1" 200 None
2026-03-28 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085082 not downloaded yet
2026-03-28 22:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f257efe2-daf9-5bd3-a5cb-758b3c74ea0d with identifier: YA08%20JSV
2026-03-28 22:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f257efe2-daf9-5bd3-a5cb-758b3c74ea0d with identifier: YA08%20JSV
2026-03-28 22:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f257efe2-daf9-5bd3-a5cb-758b3c74ea0d with identifier: YA08%20JSV to the API
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993512/600>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f257efe2-daf9-5bd3-a5cb-758b3c74ea0d/f257efe2-daf9-5bd3-a5cb-758b3c74ea0d_expert_report_file_50da8abd-7551-48de-9b16-7ab606dcc45d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YA08%20JSV-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f257efe2-daf9-5bd3-a5cb-758b3c74ea0d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YA08 JSV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YA08%20JSV&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 115064,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f257efe2-daf9-5bd3-a5cb-758b3c74ea0d/f257efe2-daf9-5bd3-a5cb-758b3c74ea0d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189362,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993512/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f257efe2-daf9-5bd3-a5cb-758b3c74ea0d/f257efe2-daf9-5bd3-a5cb-758b3c74ea0d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 177026,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993522/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f257efe2-daf9-5bd3-a5cb-758b3c74ea0d/f257efe2-daf9-5bd3-a5cb-758b3c74ea0d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176266,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993528/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f257efe2-daf9-5bd3-a5cb-758b3c74ea0d/f257efe2-daf9-5bd3-a5cb-758b3c74ea0d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183185,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993539/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f257efe2-daf9-5bd3-a5cb-758b3c74ea0d/f257efe2-daf9-5bd3-a5cb-758b3c74ea0d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 136848,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993546/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f257efe2-daf9-5bd3-a5cb-758b3c74ea0d/f257efe2-daf9-5bd3-a5cb-758b3c74ea0d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 140189,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993555/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f257efe2-daf9-5bd3-a5cb-758b3c74ea0d/f257efe2-daf9-5bd3-a5cb-758b3c74ea0d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 160004,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993560/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f257efe2-daf9-5bd3-a5cb-758b3c74ea0d/f257efe2-daf9-5bd3-a5cb-758b3c74ea0d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147598,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993569/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f257efe2-daf9-5bd3-a5cb-758b3c74ea0d/f257efe2-daf9-5bd3-a5cb-758b3c74ea0d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139893,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA08JSV/698993574/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.4 GHIA Hatchback',
'transmission': 'manual',
'trim': 'GHIA',
'vin': 'WF0HXXWPJH8A34378',
'year': 2008}
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA08%2520JSV%27 HTTP/1.1" 200 None
2026-03-28 22:05:51 [bca.uk] INFO: Saving data for YA08%20JSV: {'created_time': 1774735551.88244, 'last_price_update_time': 1774735551.88245, 'auction_closing_time': 1774778400.0}
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YA08%2520JSV') HTTP/1.1" 204 0
2026-03-28 22:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330696/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS69HBC/42809493?sv=2020-08-04&st=2026-03-28T22%3A05%3A48Z&se=2026-03-28T22%3A30%3A48Z&sr=b&sp=r&sig=RPTbTL6IWpJUqHEI5e6UpRd1kf3yXEufMgKsYj7zUWk%3D)
2026-03-28 22:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971706/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL71EGE/42810664?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=9jRkf4Wr%2B%2FWN%2B1GfIm%2BRv9CJsfAX3NU6%2B1LwAsEPOgc%3D)
2026-03-28 22:05:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330707/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330707>
2026-03-28 22:05:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330714/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330714>
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699085098%27 HTTP/1.1" 200 None
2026-03-28 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085098 not downloaded yet
2026-03-28 22:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ68AYD/42810659?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=cnhjX37xQeAN9fU2XVDm5fPqVx51LCxf4mwO0xB6ZyY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN20ENC/42810973?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=kGUZlxgHDSmh3M8ha1IcDF2bC1%2Bndw%2Fh4Basuy5oHgI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145705/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML09TVX/42810920?sv=2020-08-04&st=2026-03-28T22%3A05%3A29Z&se=2026-03-28T22%3A30%3A29Z&sr=b&sp=r&sig=3CS5OP6y37ZBf1km95kjXxQgZGTyyd1Q098%2Fto%2FWbZ0%3D)
2026-03-28 22:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473b79d0>
2026-03-28 22:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b35f19-803b-5916-9d73-8fe099e2d84a/31b35f19-803b-5916-9d73-8fe099e2d84a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL71EGE%252F698971732%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971732/600 saved to cache
2026-03-28 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 31b35f19-803b-5916-9d73-8fe099e2d84a
2026-03-28 22:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554881c10>
2026-03-28 22:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1941c029-e601-57db-8da4-77ae3b1b387e/1941c029-e601-57db-8da4-77ae3b1b387e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF68PYB%252F698972598%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972598/600 saved to cache
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1941c029-e601-57db-8da4-77ae3b1b387e
2026-03-28 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f942d0>
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d1bd1b-e75f-5786-8613-977c6a06c247/79d1bd1b-e75f-5786-8613-977c6a06c247_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML09TVX%252F699145719%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145719/600 saved to cache
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 79d1bd1b-e75f-5786-8613-977c6a06c247
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547396110>
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0/75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0_expert_report_file_362a99e8-239e-48e6-804f-0fd609419f22.pdf HTTP/1.1" 201 0
2026-03-28 22:05:52 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0
2026-03-28 22:05:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0, skipping ID generation
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEP68DWV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EP68DWV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f94e90>
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b/f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b_expert_report_file_84856b06-7296-493e-8b38-44d41ce4d732.pdf HTTP/1.1" 201 0
2026-03-28 22:05:52 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b
2026-03-28 22:05:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b, skipping ID generation
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFE70UFX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FE70UFX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f95cd0>
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b97ea534-9544-5066-9940-a3af577b97fd/b97ea534-9544-5066-9940-a3af577b97fd_expert_report_file_a0f1cd6e-b23f-469f-aeba-2f48306e4012.pdf HTTP/1.1" 201 0
2026-03-28 22:05:52 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b97ea534-9544-5066-9940-a3af577b97fd
2026-03-28 22:05:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b97ea534-9544-5066-9940-a3af577b97fd, skipping ID generation
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b97ea534-9544-5066-9940-a3af577b97fd
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEX71JPO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EX71JPO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972593/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF68PYB/42810634?sv=2020-08-04&st=2026-03-28T22%3A05%3A34Z&se=2026-03-28T22%3A30%3A34Z&sr=b&sp=r&sig=Qnbhc%2F3Nk5rBw4e6MkVvsnHTegd%2BbIJ4VYeule%2Bchng%3D)
2026-03-28 22:05:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085025/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085025>
2026-03-28 22:05:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085016/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085016>
2026-03-28 22:05:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330722/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330722>
2026-03-28 22:05:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330727/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330727>
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143383%27 HTTP/1.1" 200 None
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143383 not downloaded yet
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143525%27 HTTP/1.1" 200 None
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143525 not downloaded yet
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208532%27 HTTP/1.1" 200 None
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208532 not downloaded yet
2026-03-28 22:05:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330732/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330732>
2026-03-28 22:05:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330719/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330719>
2026-03-28 22:05:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085047/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085047>
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143392%27 HTTP/1.1" 200 None
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143392 not downloaded yet
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143538%27 HTTP/1.1" 200 None
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143538 not downloaded yet
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208539%27 HTTP/1.1" 200 None
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208539 not downloaded yet
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554942b50>
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567b92e4-538d-5dfd-a509-01ee1c685e60/567b92e4-538d-5dfd-a509-01ee1c685e60_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS69HBC%252F699330696%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330696/600 saved to cache
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 567b92e4-538d-5dfd-a509-01ee1c685e60
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557618d10>
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b35f19-803b-5916-9d73-8fe099e2d84a/31b35f19-803b-5916-9d73-8fe099e2d84a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL71EGE%252F698971706%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971706/600 saved to cache
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31b35f19-803b-5916-9d73-8fe099e2d84a
2026-03-28 22:05:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31b35f19-803b-5916-9d73-8fe099e2d84a, skipping ID generation
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31b35f19-803b-5916-9d73-8fe099e2d84a sending to next pipeline
2026-03-28 22:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 31b35f19-803b-5916-9d73-8fe099e2d84a, identifier: FL71%20EGE
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a1abd0>
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d2cdd9b-103e-5d8d-ac18-3bf908918b6c/2d2cdd9b-103e-5d8d-ac18-3bf908918b6c_expert_report_file_9660c0d8-2c76-4178-a2d2-a605c66e0865.pdf HTTP/1.1" 201 0
2026-03-28 22:05:52 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2d2cdd9b-103e-5d8d-ac18-3bf908918b6c
2026-03-28 22:05:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d2cdd9b-103e-5d8d-ac18-3bf908918b6c, skipping ID generation
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2d2cdd9b-103e-5d8d-ac18-3bf908918b6c
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPJ68AYD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PJ68AYD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554898550>
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85b056c6-c0d6-5d9f-8894-629a1e21efb8/85b056c6-c0d6-5d9f-8894-629a1e21efb8_expert_report_file_b7702a61-9eed-4249-83bc-24a8a19ae02a.pdf HTTP/1.1" 201 0
2026-03-28 22:05:52 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 85b056c6-c0d6-5d9f-8894-629a1e21efb8
2026-03-28 22:05:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 85b056c6-c0d6-5d9f-8894-629a1e21efb8, skipping ID generation
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 85b056c6-c0d6-5d9f-8894-629a1e21efb8
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDN20ENC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DN20ENC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473cf910>
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d1bd1b-e75f-5786-8613-977c6a06c247/79d1bd1b-e75f-5786-8613-977c6a06c247_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML09TVX%252F699145705%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145705/600 saved to cache
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79d1bd1b-e75f-5786-8613-977c6a06c247
2026-03-28 22:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330707/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS69HBC/42809493?sv=2020-08-04&st=2026-03-28T22%3A05%3A48Z&se=2026-03-28T22%3A30%3A48Z&sr=b&sp=r&sig=RPTbTL6IWpJUqHEI5e6UpRd1kf3yXEufMgKsYj7zUWk%3D)
2026-03-28 22:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699084972/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ69TFF/42809455?sv=2020-08-04&st=2026-03-28T22%3A05%3A48Z&se=2026-03-28T22%3A30%3A48Z&sr=b&sp=r&sig=E3vyVEVNQt9QGJ6lipDyfIWGUUx355bY1acjAnvJwVM%3D)
2026-03-28 22:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330714/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS69HBC/42809493?sv=2020-08-04&st=2026-03-28T22%3A05%3A48Z&se=2026-03-28T22%3A30%3A48Z&sr=b&sp=r&sig=RPTbTL6IWpJUqHEI5e6UpRd1kf3yXEufMgKsYj7zUWk%3D)
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143398%27 HTTP/1.1" 200 None
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143398 not downloaded yet
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143556%27 HTTP/1.1" 200 None
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143556 not downloaded yet
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208549%27 HTTP/1.1" 200 None
2026-03-28 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208549 not downloaded yet
2026-03-28 22:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 31b35f19-803b-5916-9d73-8fe099e2d84a with identifier: FL71%20EGE
2026-03-28 22:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 31b35f19-803b-5916-9d73-8fe099e2d84a with identifier: FL71%20EGE
2026-03-28 22:05:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 31b35f19-803b-5916-9d73-8fe099e2d84a with identifier: FL71%20EGE to the API
2026-03-28 22:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971706/600>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b35f19-803b-5916-9d73-8fe099e2d84a/31b35f19-803b-5916-9d73-8fe099e2d84a_expert_report_file_029fe802-3827-4cd0-9f0e-5c85a9718c6a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FL71%20EGE-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '31b35f19-803b-5916-9d73-8fe099e2d84a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FL71 EGE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FL71%20EGE&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'BMW',
'model': '118I',
'odometer': 36588,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b35f19-803b-5916-9d73-8fe099e2d84a/31b35f19-803b-5916-9d73-8fe099e2d84a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48644,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971706/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b35f19-803b-5916-9d73-8fe099e2d84a/31b35f19-803b-5916-9d73-8fe099e2d84a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46715,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971732/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b35f19-803b-5916-9d73-8fe099e2d84a/31b35f19-803b-5916-9d73-8fe099e2d84a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42496,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971746/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b35f19-803b-5916-9d73-8fe099e2d84a/31b35f19-803b-5916-9d73-8fe099e2d84a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43408,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971763/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b35f19-803b-5916-9d73-8fe099e2d84a/31b35f19-803b-5916-9d73-8fe099e2d84a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39371,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971780/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b35f19-803b-5916-9d73-8fe099e2d84a/31b35f19-803b-5916-9d73-8fe099e2d84a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37267,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971788/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b35f19-803b-5916-9d73-8fe099e2d84a/31b35f19-803b-5916-9d73-8fe099e2d84a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84571,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971803/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b35f19-803b-5916-9d73-8fe099e2d84a/31b35f19-803b-5916-9d73-8fe099e2d84a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91478,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971819/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b35f19-803b-5916-9d73-8fe099e2d84a/31b35f19-803b-5916-9d73-8fe099e2d84a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95289,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971839/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b35f19-803b-5916-9d73-8fe099e2d84a/31b35f19-803b-5916-9d73-8fe099e2d84a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104576,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL71EGE/698971854/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'BMW 118I 1.5 136 M SPORT STEP Hatchback',
'transmission': 'automatic',
'trim': '136 M SPORT STEP',
'vin': 'WBA7K320507K03462',
'year': 2021}
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL71%2520EGE%27 HTTP/1.1" 200 None
2026-03-28 22:05:53 [bca.uk] INFO: Saving data for FL71%20EGE: {'created_time': 1774735553.119493, 'last_price_update_time': 1774735553.119503, 'auction_closing_time': 1774864800.0}
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FL71%2520EGE') HTTP/1.1" 204 0
2026-03-28 22:05:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085062/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085062>
2026-03-28 22:05:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085005/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085005>
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002748%27 HTTP/1.1" 200 None
2026-03-28 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002748 not downloaded yet
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142955%27 HTTP/1.1" 200 None
2026-03-28 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142955 not downloaded yet
2026-03-28 22:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a18910>
2026-03-28 22:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1941c029-e601-57db-8da4-77ae3b1b387e/1941c029-e601-57db-8da4-77ae3b1b387e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF68PYB%252F698972593%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972593/600 saved to cache
2026-03-28 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1941c029-e601-57db-8da4-77ae3b1b387e
2026-03-28 22:05:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1941c029-e601-57db-8da4-77ae3b1b387e, skipping ID generation
2026-03-28 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1941c029-e601-57db-8da4-77ae3b1b387e sending to next pipeline
2026-03-28 22:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1941c029-e601-57db-8da4-77ae3b1b387e, identifier: PF68%20PYB
2026-03-28 22:05:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085082/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085082>
2026-03-28 22:05:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085098/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085098>
2026-03-28 22:05:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699084996/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699084996>
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143404%27 HTTP/1.1" 200 None
2026-03-28 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143404 not downloaded yet
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143567%27 HTTP/1.1" 200 None
2026-03-28 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143567 not downloaded yet
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208560%27 HTTP/1.1" 200 None
2026-03-28 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208560 not downloaded yet
2026-03-28 22:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1941c029-e601-57db-8da4-77ae3b1b387e with identifier: PF68%20PYB
2026-03-28 22:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1941c029-e601-57db-8da4-77ae3b1b387e with identifier: PF68%20PYB
2026-03-28 22:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1941c029-e601-57db-8da4-77ae3b1b387e with identifier: PF68%20PYB to the API
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972593/600>
{'auction_title': '',
'c_o_2_emission_value': 143,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1941c029-e601-57db-8da4-77ae3b1b387e/1941c029-e601-57db-8da4-77ae3b1b387e_expert_report_file_a5399c45-2b5d-43fe-8b8b-c41c614c2fbf.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PF68%20PYB-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1941c029-e601-57db-8da4-77ae3b1b387e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PF68 PYB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PF68%20PYB&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'JAGUAR',
'model': 'E-PACE',
'odometer': 66523,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1941c029-e601-57db-8da4-77ae3b1b387e/1941c029-e601-57db-8da4-77ae3b1b387e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39879,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972593/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1941c029-e601-57db-8da4-77ae3b1b387e/1941c029-e601-57db-8da4-77ae3b1b387e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36765,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972598/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1941c029-e601-57db-8da4-77ae3b1b387e/1941c029-e601-57db-8da4-77ae3b1b387e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39274,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972605/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1941c029-e601-57db-8da4-77ae3b1b387e/1941c029-e601-57db-8da4-77ae3b1b387e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37145,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972614/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1941c029-e601-57db-8da4-77ae3b1b387e/1941c029-e601-57db-8da4-77ae3b1b387e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34825,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972622/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1941c029-e601-57db-8da4-77ae3b1b387e/1941c029-e601-57db-8da4-77ae3b1b387e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33515,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972642/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1941c029-e601-57db-8da4-77ae3b1b387e/1941c029-e601-57db-8da4-77ae3b1b387e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75196,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972661/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1941c029-e601-57db-8da4-77ae3b1b387e/1941c029-e601-57db-8da4-77ae3b1b387e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78824,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972674/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1941c029-e601-57db-8da4-77ae3b1b387e/1941c029-e601-57db-8da4-77ae3b1b387e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90235,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972691/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1941c029-e601-57db-8da4-77ae3b1b387e/1941c029-e601-57db-8da4-77ae3b1b387e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67955,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF68PYB/698972712/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'JAGUAR E-PACE 2.0 D150 2WD R-DYNAMIC S Hatchback',
'transmission': 'manual',
'trim': 'D150 2WD R-DYNAMIC S',
'vin': 'SADFB2CN8K1Z47893',
'year': 2018}
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF68%2520PYB%27 HTTP/1.1" 200 None
2026-03-28 22:05:53 [bca.uk] INFO: Saving data for PF68%20PYB: {'created_time': 1774735553.692487, 'last_price_update_time': 1774735553.692498, 'auction_closing_time': 1774864800.0}
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PF68%2520PYB') HTTP/1.1" 204 0
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002768%27 HTTP/1.1" 200 None
2026-03-28 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002768 not downloaded yet
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142961%27 HTTP/1.1" 200 None
2026-03-28 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142961 not downloaded yet
2026-03-28 22:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085016/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ69TFF/42809455?sv=2020-08-04&st=2026-03-28T22%3A05%3A48Z&se=2026-03-28T22%3A30%3A48Z&sr=b&sp=r&sig=E3vyVEVNQt9QGJ6lipDyfIWGUUx355bY1acjAnvJwVM%3D)
2026-03-28 22:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085025/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ69TFF/42809455?sv=2020-08-04&st=2026-03-28T22%3A05%3A48Z&se=2026-03-28T22%3A30%3A48Z&sr=b&sp=r&sig=E3vyVEVNQt9QGJ6lipDyfIWGUUx355bY1acjAnvJwVM%3D)
2026-03-28 22:05:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208519/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EX71JPO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143411%27 HTTP/1.1" 200 None
2026-03-28 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143411 not downloaded yet
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143576%27 HTTP/1.1" 200 None
2026-03-28 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143576 not downloaded yet
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208569%27 HTTP/1.1" 200 None
2026-03-28 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208569 not downloaded yet
2026-03-28 22:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544c9a10>
2026-03-28 22:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567b92e4-538d-5dfd-a509-01ee1c685e60/567b92e4-538d-5dfd-a509-01ee1c685e60_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS69HBC%252F699330707%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330707/600 saved to cache
2026-03-28 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 567b92e4-538d-5dfd-a509-01ee1c685e60
2026-03-28 22:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f9b390>
2026-03-28 22:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0000ca0-cda2-564a-a588-b58706c95283/a0000ca0-cda2-564a-a588-b58706c95283_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ69TFF%252F699084972%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699084972/600 saved to cache
2026-03-28 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0000ca0-cda2-564a-a588-b58706c95283
2026-03-28 22:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547104690>
2026-03-28 22:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567b92e4-538d-5dfd-a509-01ee1c685e60/567b92e4-538d-5dfd-a509-01ee1c685e60_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS69HBC%252F699330714%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330714/600 saved to cache
2026-03-28 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 567b92e4-538d-5dfd-a509-01ee1c685e60
2026-03-28 22:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330722/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS69HBC/42809493?sv=2020-08-04&st=2026-03-28T22%3A05%3A48Z&se=2026-03-28T22%3A30%3A48Z&sr=b&sp=r&sig=RPTbTL6IWpJUqHEI5e6UpRd1kf3yXEufMgKsYj7zUWk%3D)
2026-03-28 22:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330727/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS69HBC/42809493?sv=2020-08-04&st=2026-03-28T22%3A05%3A48Z&se=2026-03-28T22%3A30%3A48Z&sr=b&sp=r&sig=RPTbTL6IWpJUqHEI5e6UpRd1kf3yXEufMgKsYj7zUWk%3D)
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002790%27 HTTP/1.1" 200 None
2026-03-28 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002790 not downloaded yet
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142968%27 HTTP/1.1" 200 None
2026-03-28 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142968 not downloaded yet
2026-03-28 22:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085047/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ69TFF/42809455?sv=2020-08-04&st=2026-03-28T22%3A05%3A48Z&se=2026-03-28T22%3A30%3A48Z&sr=b&sp=r&sig=E3vyVEVNQt9QGJ6lipDyfIWGUUx355bY1acjAnvJwVM%3D)
2026-03-28 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143422%27 HTTP/1.1" 200 None
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143422 not downloaded yet
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143601%27 HTTP/1.1" 200 None
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143601 not downloaded yet
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208599%27 HTTP/1.1" 200 None
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208599 not downloaded yet
2026-03-28 22:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330719/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS69HBC/42809493?sv=2020-08-04&st=2026-03-28T22%3A05%3A48Z&se=2026-03-28T22%3A30%3A48Z&sr=b&sp=r&sig=RPTbTL6IWpJUqHEI5e6UpRd1kf3yXEufMgKsYj7zUWk%3D)
2026-03-28 22:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330732/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS69HBC/42809493?sv=2020-08-04&st=2026-03-28T22%3A05%3A48Z&se=2026-03-28T22%3A30%3A48Z&sr=b&sp=r&sig=RPTbTL6IWpJUqHEI5e6UpRd1kf3yXEufMgKsYj7zUWk%3D)
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002812%27 HTTP/1.1" 200 None
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002812 not downloaded yet
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142973%27 HTTP/1.1" 200 None
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142973 not downloaded yet
2026-03-28 22:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085062/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ69TFF/42809455?sv=2020-08-04&st=2026-03-28T22%3A05%3A48Z&se=2026-03-28T22%3A30%3A48Z&sr=b&sp=r&sig=E3vyVEVNQt9QGJ6lipDyfIWGUUx355bY1acjAnvJwVM%3D)
2026-03-28 22:05:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142947/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DN20ENC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085005/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ69TFF/42809455?sv=2020-08-04&st=2026-03-28T22%3A05%3A48Z&se=2026-03-28T22%3A30%3A48Z&sr=b&sp=r&sig=E3vyVEVNQt9QGJ6lipDyfIWGUUx355bY1acjAnvJwVM%3D)
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143435%27 HTTP/1.1" 200 None
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143435 not downloaded yet
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143615%27 HTTP/1.1" 200 None
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143615 not downloaded yet
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208642%27 HTTP/1.1" 200 None
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208642 not downloaded yet
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002828%27 HTTP/1.1" 200 None
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002828 not downloaded yet
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142979%27 HTTP/1.1" 200 None
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142979 not downloaded yet
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548911d0>
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0000ca0-cda2-564a-a588-b58706c95283/a0000ca0-cda2-564a-a588-b58706c95283_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ69TFF%252F699085016%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085016/600 saved to cache
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0000ca0-cda2-564a-a588-b58706c95283
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54710efd0>
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0000ca0-cda2-564a-a588-b58706c95283/a0000ca0-cda2-564a-a588-b58706c95283_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ69TFF%252F699085025%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085025/600 saved to cache
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0000ca0-cda2-564a-a588-b58706c95283
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fda250>
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567b92e4-538d-5dfd-a509-01ee1c685e60/567b92e4-538d-5dfd-a509-01ee1c685e60_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS69HBC%252F699330722%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330722/600 saved to cache
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 567b92e4-538d-5dfd-a509-01ee1c685e60
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547394350>
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567b92e4-538d-5dfd-a509-01ee1c685e60/567b92e4-538d-5dfd-a509-01ee1c685e60_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS69HBC%252F699330727%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330727/600 saved to cache
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 567b92e4-538d-5dfd-a509-01ee1c685e60
2026-03-28 22:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699084996/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ69TFF/42809455?sv=2020-08-04&st=2026-03-28T22%3A05%3A48Z&se=2026-03-28T22%3A30%3A48Z&sr=b&sp=r&sig=E3vyVEVNQt9QGJ6lipDyfIWGUUx355bY1acjAnvJwVM%3D)
2026-03-28 22:05:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208539/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208539>
2026-03-28 22:05:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002732/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PJ68AYD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085098/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ69TFF/42809455?sv=2020-08-04&st=2026-03-28T22%3A05%3A48Z&se=2026-03-28T22%3A30%3A48Z&sr=b&sp=r&sig=E3vyVEVNQt9QGJ6lipDyfIWGUUx355bY1acjAnvJwVM%3D)
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143450%27 HTTP/1.1" 200 None
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143450 not downloaded yet
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143633%27 HTTP/1.1" 200 None
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143633 not downloaded yet
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208676%27 HTTP/1.1" 200 None
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208676 not downloaded yet
2026-03-28 22:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085082/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ69TFF/42809455?sv=2020-08-04&st=2026-03-28T22%3A05%3A48Z&se=2026-03-28T22%3A30%3A48Z&sr=b&sp=r&sig=E3vyVEVNQt9QGJ6lipDyfIWGUUx355bY1acjAnvJwVM%3D)
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002873%27 HTTP/1.1" 200 None
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002873 not downloaded yet
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142989%27 HTTP/1.1" 200 None
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142989 not downloaded yet
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473134d0>
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0000ca0-cda2-564a-a588-b58706c95283/a0000ca0-cda2-564a-a588-b58706c95283_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ69TFF%252F699085047%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085047/600 saved to cache
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0000ca0-cda2-564a-a588-b58706c95283
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54718f810>
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567b92e4-538d-5dfd-a509-01ee1c685e60/567b92e4-538d-5dfd-a509-01ee1c685e60_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS69HBC%252F699330719%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330719/600 saved to cache
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 567b92e4-538d-5dfd-a509-01ee1c685e60
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55435e350>
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567b92e4-538d-5dfd-a509-01ee1c685e60/567b92e4-538d-5dfd-a509-01ee1c685e60_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS69HBC%252F699330732%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330732/600 saved to cache
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 567b92e4-538d-5dfd-a509-01ee1c685e60
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554842290>
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0000ca0-cda2-564a-a588-b58706c95283/a0000ca0-cda2-564a-a588-b58706c95283_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ69TFF%252F699085062%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085062/600 saved to cache
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0000ca0-cda2-564a-a588-b58706c95283
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547117490>
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0000ca0-cda2-564a-a588-b58706c95283/a0000ca0-cda2-564a-a588-b58706c95283_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ69TFF%252F699085005%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085005/600 saved to cache
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0000ca0-cda2-564a-a588-b58706c95283
2026-03-28 22:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208519/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX71JPO/42805662?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=xA8%2BwPzsdUYGq0awyU%2BCpPk%2BGKY5WK5rDm563xgRFtc%3D)
2026-03-28 22:05:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208560/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208560>
2026-03-28 22:05:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143567/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143567>
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143461%27 HTTP/1.1" 200 None
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143461 not downloaded yet
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143653%27 HTTP/1.1" 200 None
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143653 not downloaded yet
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208701%27 HTTP/1.1" 200 None
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208701 not downloaded yet
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002923%27 HTTP/1.1" 200 None
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002923 not downloaded yet
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142999%27 HTTP/1.1" 200 None
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142999 not downloaded yet
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471f4790>
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0000ca0-cda2-564a-a588-b58706c95283/a0000ca0-cda2-564a-a588-b58706c95283_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ69TFF%252F699084996%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699084996/600 saved to cache
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0000ca0-cda2-564a-a588-b58706c95283
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471f5ed0>
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0000ca0-cda2-564a-a588-b58706c95283/a0000ca0-cda2-564a-a588-b58706c95283_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ69TFF%252F699085098%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085098/600 saved to cache
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a0000ca0-cda2-564a-a588-b58706c95283
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543dc810>
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0000ca0-cda2-564a-a588-b58706c95283/a0000ca0-cda2-564a-a588-b58706c95283_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ69TFF%252F699085082%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085082/600 saved to cache
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a0000ca0-cda2-564a-a588-b58706c95283
2026-03-28 22:05:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208569/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208569>
2026-03-28 22:05:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142968/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142968>
2026-03-28 22:05:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143576/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143576>
2026-03-28 22:05:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002790/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002790>
2026-03-28 22:05:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143411/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143411>
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002947%27 HTTP/1.1" 200 None
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002947 not downloaded yet
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143015%27 HTTP/1.1" 200 None
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143015 not downloaded yet
2026-03-28 22:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142947/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN20ENC/42810973?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=kGUZlxgHDSmh3M8ha1IcDF2bC1%2Bndw%2Fh4Basuy5oHgI%3D)
2026-03-28 22:05:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002812/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002812>
2026-03-28 22:05:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142973/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142973>
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002977%27 HTTP/1.1" 200 None
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002977 not downloaded yet
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143026%27 HTTP/1.1" 200 None
2026-03-28 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143026 not downloaded yet
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554303650>
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b97ea534-9544-5066-9940-a3af577b97fd/b97ea534-9544-5066-9940-a3af577b97fd_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX71JPO%252F699208519%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208519/600 saved to cache
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b97ea534-9544-5066-9940-a3af577b97fd
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208539/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX71JPO/42805662?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=xA8%2BwPzsdUYGq0awyU%2BCpPk%2BGKY5WK5rDm563xgRFtc%3D)
2026-03-28 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002828/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002828>
2026-03-28 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142979/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142979>
2026-03-28 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208642/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208642>
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002732/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ68AYD/42810659?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=cnhjX37xQeAN9fU2XVDm5fPqVx51LCxf4mwO0xB6ZyY%3D)
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b67a90>
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85b056c6-c0d6-5d9f-8894-629a1e21efb8/85b056c6-c0d6-5d9f-8894-629a1e21efb8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN20ENC%252F699142947%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142947/600 saved to cache
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 85b056c6-c0d6-5d9f-8894-629a1e21efb8
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208569/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX71JPO/42805662?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=xA8%2BwPzsdUYGq0awyU%2BCpPk%2BGKY5WK5rDm563xgRFtc%3D)
2026-03-28 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208676/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208676>
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143411/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EP68DWV/42810946?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=1uJdwmrGOIygBj5SYsULEl4Y3gQ8gCcgWMy197GaNm4%3D)
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143576/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE70UFX/42810935?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=d6kzkQBS6qyUOSn%2FKWcXlM7owUfN8r20q1jXHVNaPsQ%3D)
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002790/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ68AYD/42810659?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=cnhjX37xQeAN9fU2XVDm5fPqVx51LCxf4mwO0xB6ZyY%3D)
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5541ffad0>
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b97ea534-9544-5066-9940-a3af577b97fd/b97ea534-9544-5066-9940-a3af577b97fd_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX71JPO%252F699208539%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208539/600 saved to cache
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b97ea534-9544-5066-9940-a3af577b97fd
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142968/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN20ENC/42810973?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=kGUZlxgHDSmh3M8ha1IcDF2bC1%2Bndw%2Fh4Basuy5oHgI%3D)
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208560/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX71JPO/42805662?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=xA8%2BwPzsdUYGq0awyU%2BCpPk%2BGKY5WK5rDm563xgRFtc%3D)
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143567/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE70UFX/42810935?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=d6kzkQBS6qyUOSn%2FKWcXlM7owUfN8r20q1jXHVNaPsQ%3D)
2026-03-28 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699143015/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143015>
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142973/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN20ENC/42810973?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=kGUZlxgHDSmh3M8ha1IcDF2bC1%2Bndw%2Fh4Basuy5oHgI%3D)
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554ba5710>
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d2cdd9b-103e-5d8d-ac18-3bf908918b6c/2d2cdd9b-103e-5d8d-ac18-3bf908918b6c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ68AYD%252F699002732%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002732/600 saved to cache
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d2cdd9b-103e-5d8d-ac18-3bf908918b6c
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002812/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ68AYD/42810659?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=cnhjX37xQeAN9fU2XVDm5fPqVx51LCxf4mwO0xB6ZyY%3D)
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142979/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN20ENC/42810973?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=kGUZlxgHDSmh3M8ha1IcDF2bC1%2Bndw%2Fh4Basuy5oHgI%3D)
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549afb50>
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b97ea534-9544-5066-9940-a3af577b97fd/b97ea534-9544-5066-9940-a3af577b97fd_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX71JPO%252F699208569%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208569/600 saved to cache
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b97ea534-9544-5066-9940-a3af577b97fd
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474785d0>
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0/75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEP68DWV%252F699143411%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143411/600 saved to cache
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5572a4790>
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b/f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE70UFX%252F699143576%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143576/600 saved to cache
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b
2026-03-28 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699143026/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143026>
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002828/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ68AYD/42810659?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=cnhjX37xQeAN9fU2XVDm5fPqVx51LCxf4mwO0xB6ZyY%3D)
2026-03-28 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002977/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002977>
2026-03-28 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002947/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002947>
2026-03-28 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002923/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002923>
2026-03-28 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142999/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142999>
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208642/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX71JPO/42805662?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=xA8%2BwPzsdUYGq0awyU%2BCpPk%2BGKY5WK5rDm563xgRFtc%3D)
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208676/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX71JPO/42805662?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=xA8%2BwPzsdUYGq0awyU%2BCpPk%2BGKY5WK5rDm563xgRFtc%3D)
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547201950>
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d2cdd9b-103e-5d8d-ac18-3bf908918b6c/2d2cdd9b-103e-5d8d-ac18-3bf908918b6c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ68AYD%252F699002790%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002790/600 saved to cache
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2d2cdd9b-103e-5d8d-ac18-3bf908918b6c
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a47710>
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85b056c6-c0d6-5d9f-8894-629a1e21efb8/85b056c6-c0d6-5d9f-8894-629a1e21efb8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN20ENC%252F699142968%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142968/600 saved to cache
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 85b056c6-c0d6-5d9f-8894-629a1e21efb8
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543ea190>
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b97ea534-9544-5066-9940-a3af577b97fd/b97ea534-9544-5066-9940-a3af577b97fd_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX71JPO%252F699208560%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208560/600 saved to cache
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b97ea534-9544-5066-9940-a3af577b97fd
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55727b190>
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b/f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE70UFX%252F699143567%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143567/600 saved to cache
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b41290>
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85b056c6-c0d6-5d9f-8894-629a1e21efb8/85b056c6-c0d6-5d9f-8894-629a1e21efb8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN20ENC%252F699142973%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142973/600 saved to cache
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 85b056c6-c0d6-5d9f-8894-629a1e21efb8
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54739f350>
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d2cdd9b-103e-5d8d-ac18-3bf908918b6c/2d2cdd9b-103e-5d8d-ac18-3bf908918b6c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ68AYD%252F699002812%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002812/600 saved to cache
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2d2cdd9b-103e-5d8d-ac18-3bf908918b6c
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54739dcd0>
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85b056c6-c0d6-5d9f-8894-629a1e21efb8/85b056c6-c0d6-5d9f-8894-629a1e21efb8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN20ENC%252F699142979%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142979/600 saved to cache
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 85b056c6-c0d6-5d9f-8894-629a1e21efb8
2026-03-28 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143461/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143461>
2026-03-28 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142989/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142989>
2026-03-28 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208701/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208701>
2026-03-28 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143653/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143653>
2026-03-28 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002873/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002873>
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699143015/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN20ENC/42810973?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=kGUZlxgHDSmh3M8ha1IcDF2bC1%2Bndw%2Fh4Basuy5oHgI%3D)
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543e8250>
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d2cdd9b-103e-5d8d-ac18-3bf908918b6c/2d2cdd9b-103e-5d8d-ac18-3bf908918b6c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ68AYD%252F699002828%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002828/600 saved to cache
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2d2cdd9b-103e-5d8d-ac18-3bf908918b6c
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543180d0>
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b97ea534-9544-5066-9940-a3af577b97fd/b97ea534-9544-5066-9940-a3af577b97fd_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX71JPO%252F699208642%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208642/600 saved to cache
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b97ea534-9544-5066-9940-a3af577b97fd
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54718e990>
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b97ea534-9544-5066-9940-a3af577b97fd/b97ea534-9544-5066-9940-a3af577b97fd_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX71JPO%252F699208676%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208676/600 saved to cache
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b97ea534-9544-5066-9940-a3af577b97fd
2026-03-28 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143633/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143633>
2026-03-28 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143450/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143450>
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002923/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ68AYD/42810659?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=cnhjX37xQeAN9fU2XVDm5fPqVx51LCxf4mwO0xB6ZyY%3D)
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142999/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN20ENC/42810973?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=kGUZlxgHDSmh3M8ha1IcDF2bC1%2Bndw%2Fh4Basuy5oHgI%3D)
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471cd350>
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85b056c6-c0d6-5d9f-8894-629a1e21efb8/85b056c6-c0d6-5d9f-8894-629a1e21efb8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN20ENC%252F699143015%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699143015/600 saved to cache
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 85b056c6-c0d6-5d9f-8894-629a1e21efb8
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699143026/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN20ENC/42810973?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=kGUZlxgHDSmh3M8ha1IcDF2bC1%2Bndw%2Fh4Basuy5oHgI%3D)
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002947/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ68AYD/42810659?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=cnhjX37xQeAN9fU2XVDm5fPqVx51LCxf4mwO0xB6ZyY%3D)
2026-03-28 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143615/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143615>
2026-03-28 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208599/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208599>
2026-03-28 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143435/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143435>
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554aa5bd0>
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d2cdd9b-103e-5d8d-ac18-3bf908918b6c/2d2cdd9b-103e-5d8d-ac18-3bf908918b6c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ68AYD%252F699002923%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002923/600 saved to cache
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2d2cdd9b-103e-5d8d-ac18-3bf908918b6c
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54739e010>
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85b056c6-c0d6-5d9f-8894-629a1e21efb8/85b056c6-c0d6-5d9f-8894-629a1e21efb8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN20ENC%252F699142999%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142999/600 saved to cache
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 85b056c6-c0d6-5d9f-8894-629a1e21efb8
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143653/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE70UFX/42810935?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=d6kzkQBS6qyUOSn%2FKWcXlM7owUfN8r20q1jXHVNaPsQ%3D)
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208701/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX71JPO/42805662?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=xA8%2BwPzsdUYGq0awyU%2BCpPk%2BGKY5WK5rDm563xgRFtc%3D)
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002977/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ68AYD/42810659?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=cnhjX37xQeAN9fU2XVDm5fPqVx51LCxf4mwO0xB6ZyY%3D)
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002873/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ68AYD/42810659?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=cnhjX37xQeAN9fU2XVDm5fPqVx51LCxf4mwO0xB6ZyY%3D)
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143450/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EP68DWV/42810946?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=1uJdwmrGOIygBj5SYsULEl4Y3gQ8gCcgWMy197GaNm4%3D)
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142989/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN20ENC/42810973?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=kGUZlxgHDSmh3M8ha1IcDF2bC1%2Bndw%2Fh4Basuy5oHgI%3D)
2026-03-28 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143461/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EP68DWV/42810946?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=1uJdwmrGOIygBj5SYsULEl4Y3gQ8gCcgWMy197GaNm4%3D)
2026-03-28 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143601/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143601>
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543e8250>
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85b056c6-c0d6-5d9f-8894-629a1e21efb8/85b056c6-c0d6-5d9f-8894-629a1e21efb8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN20ENC%252F699143026%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699143026/600 saved to cache
2026-03-28 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 85b056c6-c0d6-5d9f-8894-629a1e21efb8
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554aa6350>
2026-03-28 22:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d2cdd9b-103e-5d8d-ac18-3bf908918b6c/2d2cdd9b-103e-5d8d-ac18-3bf908918b6c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ68AYD%252F699002947%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002947/600 saved to cache
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2d2cdd9b-103e-5d8d-ac18-3bf908918b6c
2026-03-28 22:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143615/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE70UFX/42810935?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=d6kzkQBS6qyUOSn%2FKWcXlM7owUfN8r20q1jXHVNaPsQ%3D)
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547606e10>
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b/f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE70UFX%252F699143653%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143653/600 saved to cache
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b
2026-03-28 22:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208599/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX71JPO/42805662?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=xA8%2BwPzsdUYGq0awyU%2BCpPk%2BGKY5WK5rDm563xgRFtc%3D)
2026-03-28 22:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143633/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE70UFX/42810935?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=d6kzkQBS6qyUOSn%2FKWcXlM7owUfN8r20q1jXHVNaPsQ%3D)
2026-03-28 22:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143435/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EP68DWV/42810946?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=1uJdwmrGOIygBj5SYsULEl4Y3gQ8gCcgWMy197GaNm4%3D)
2026-03-28 22:05:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143422/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143422>
2026-03-28 22:05:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143404/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143404>
2026-03-28 22:05:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002768/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002768>
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547749450>
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b97ea534-9544-5066-9940-a3af577b97fd/b97ea534-9544-5066-9940-a3af577b97fd_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX71JPO%252F699208701%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208701/600 saved to cache
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b97ea534-9544-5066-9940-a3af577b97fd
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471a1a50>
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d2cdd9b-103e-5d8d-ac18-3bf908918b6c/2d2cdd9b-103e-5d8d-ac18-3bf908918b6c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ68AYD%252F699002977%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002977/600 saved to cache
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2d2cdd9b-103e-5d8d-ac18-3bf908918b6c
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554379c10>
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d2cdd9b-103e-5d8d-ac18-3bf908918b6c/2d2cdd9b-103e-5d8d-ac18-3bf908918b6c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ68AYD%252F699002873%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002873/600 saved to cache
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2d2cdd9b-103e-5d8d-ac18-3bf908918b6c
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55437ab50>
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0/75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEP68DWV%252F699143450%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143450/600 saved to cache
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b662d0>
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85b056c6-c0d6-5d9f-8894-629a1e21efb8/85b056c6-c0d6-5d9f-8894-629a1e21efb8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN20ENC%252F699142989%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142989/600 saved to cache
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 85b056c6-c0d6-5d9f-8894-629a1e21efb8
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55435fbd0>
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0/75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEP68DWV%252F699143461%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143461/600 saved to cache
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0
2026-03-28 22:05:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142961/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142961>
2026-03-28 22:05:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142955/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142955>
2026-03-28 22:05:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208549/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208549>
2026-03-28 22:05:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143538/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143538>
2026-03-28 22:05:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002748/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002748>
2026-03-28 22:05:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143398/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143398>
2026-03-28 22:05:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143556/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143556>
2026-03-28 22:05:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208532/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208532>
2026-03-28 22:05:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143392/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143392>
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554317c10>
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b/f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE70UFX%252F699143615%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143615/600 saved to cache
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542902d0>
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b97ea534-9544-5066-9940-a3af577b97fd/b97ea534-9544-5066-9940-a3af577b97fd_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX71JPO%252F699208599%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208599/600 saved to cache
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b97ea534-9544-5066-9940-a3af577b97fd
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b07210>
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b/f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE70UFX%252F699143633%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143633/600 saved to cache
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b401d0>
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0/75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEP68DWV%252F699143435%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143435/600 saved to cache
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0
2026-03-28 22:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143601/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE70UFX/42810935?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=d6kzkQBS6qyUOSn%2FKWcXlM7owUfN8r20q1jXHVNaPsQ%3D)
2026-03-28 22:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002768/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ68AYD/42810659?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=cnhjX37xQeAN9fU2XVDm5fPqVx51LCxf4mwO0xB6ZyY%3D)
2026-03-28 22:05:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143525/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143525>
2026-03-28 22:05:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143383/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143383>
2026-03-28 22:05:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143516/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FE70UFX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142961/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN20ENC/42810973?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=kGUZlxgHDSmh3M8ha1IcDF2bC1%2Bndw%2Fh4Basuy5oHgI%3D)
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547761550>
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b/f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE70UFX%252F699143601%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143601/600 saved to cache
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b
2026-03-28 22:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143422/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EP68DWV/42810946?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=1uJdwmrGOIygBj5SYsULEl4Y3gQ8gCcgWMy197GaNm4%3D)
2026-03-28 22:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142955/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN20ENC/42810973?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=kGUZlxgHDSmh3M8ha1IcDF2bC1%2Bndw%2Fh4Basuy5oHgI%3D)
2026-03-28 22:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208532/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX71JPO/42805662?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=xA8%2BwPzsdUYGq0awyU%2BCpPk%2BGKY5WK5rDm563xgRFtc%3D)
2026-03-28 22:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143556/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE70UFX/42810935?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=d6kzkQBS6qyUOSn%2FKWcXlM7owUfN8r20q1jXHVNaPsQ%3D)
2026-03-28 22:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002748/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ68AYD/42810659?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=cnhjX37xQeAN9fU2XVDm5fPqVx51LCxf4mwO0xB6ZyY%3D)
2026-03-28 22:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143404/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EP68DWV/42810946?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=1uJdwmrGOIygBj5SYsULEl4Y3gQ8gCcgWMy197GaNm4%3D)
2026-03-28 22:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143392/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EP68DWV/42810946?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=1uJdwmrGOIygBj5SYsULEl4Y3gQ8gCcgWMy197GaNm4%3D)
2026-03-28 22:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143398/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EP68DWV/42810946?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=1uJdwmrGOIygBj5SYsULEl4Y3gQ8gCcgWMy197GaNm4%3D)
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472c1cd0>
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d2cdd9b-103e-5d8d-ac18-3bf908918b6c/2d2cdd9b-103e-5d8d-ac18-3bf908918b6c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ68AYD%252F699002768%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002768/600 saved to cache
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2d2cdd9b-103e-5d8d-ac18-3bf908918b6c
2026-03-28 22:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143538/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE70UFX/42810935?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=d6kzkQBS6qyUOSn%2FKWcXlM7owUfN8r20q1jXHVNaPsQ%3D)
2026-03-28 22:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143383/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EP68DWV/42810946?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=1uJdwmrGOIygBj5SYsULEl4Y3gQ8gCcgWMy197GaNm4%3D)
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471f59d0>
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85b056c6-c0d6-5d9f-8894-629a1e21efb8/85b056c6-c0d6-5d9f-8894-629a1e21efb8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN20ENC%252F699142961%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142961/600 saved to cache
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 85b056c6-c0d6-5d9f-8894-629a1e21efb8
2026-03-28 22:05:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330710/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330710>
2026-03-28 22:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143516/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE70UFX/42810935?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=d6kzkQBS6qyUOSn%2FKWcXlM7owUfN8r20q1jXHVNaPsQ%3D)
2026-03-28 22:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143525/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE70UFX/42810935?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=d6kzkQBS6qyUOSn%2FKWcXlM7owUfN8r20q1jXHVNaPsQ%3D)
2026-03-28 22:05:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143375/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EP68DWV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208549/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX71JPO/42805662?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=xA8%2BwPzsdUYGq0awyU%2BCpPk%2BGKY5WK5rDm563xgRFtc%3D)
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549acc50>
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0/75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEP68DWV%252F699143422%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143422/600 saved to cache
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555ca47d0>
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85b056c6-c0d6-5d9f-8894-629a1e21efb8/85b056c6-c0d6-5d9f-8894-629a1e21efb8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN20ENC%252F699142955%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142955/600 saved to cache
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 85b056c6-c0d6-5d9f-8894-629a1e21efb8
2026-03-28 22:05:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 85b056c6-c0d6-5d9f-8894-629a1e21efb8, skipping ID generation
2026-03-28 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 85b056c6-c0d6-5d9f-8894-629a1e21efb8 sending to next pipeline
2026-03-28 22:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 85b056c6-c0d6-5d9f-8894-629a1e21efb8, identifier: DN20%20ENC
2026-03-28 22:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5578cf890>
2026-03-28 22:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b97ea534-9544-5066-9940-a3af577b97fd/b97ea534-9544-5066-9940-a3af577b97fd_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX71JPO%252F699208532%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208532/600 saved to cache
2026-03-28 22:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b97ea534-9544-5066-9940-a3af577b97fd
2026-03-28 22:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554317650>
2026-03-28 22:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b/f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE70UFX%252F699143556%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143556/600 saved to cache
2026-03-28 22:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b
2026-03-28 22:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556faf250>
2026-03-28 22:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d2cdd9b-103e-5d8d-ac18-3bf908918b6c/2d2cdd9b-103e-5d8d-ac18-3bf908918b6c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ68AYD%252F699002748%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002748/600 saved to cache
2026-03-28 22:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2d2cdd9b-103e-5d8d-ac18-3bf908918b6c
2026-03-28 22:05:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d2cdd9b-103e-5d8d-ac18-3bf908918b6c, skipping ID generation
2026-03-28 22:05:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d2cdd9b-103e-5d8d-ac18-3bf908918b6c sending to next pipeline
2026-03-28 22:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2d2cdd9b-103e-5d8d-ac18-3bf908918b6c, identifier: PJ68%20AYD
2026-03-28 22:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 85b056c6-c0d6-5d9f-8894-629a1e21efb8 with identifier: DN20%20ENC
2026-03-28 22:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 85b056c6-c0d6-5d9f-8894-629a1e21efb8 with identifier: DN20%20ENC
2026-03-28 22:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 85b056c6-c0d6-5d9f-8894-629a1e21efb8 with identifier: DN20%20ENC to the API
2026-03-28 22:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142955/600>
{'auction_title': '',
'c_o_2_emission_value': 196,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85b056c6-c0d6-5d9f-8894-629a1e21efb8/85b056c6-c0d6-5d9f-8894-629a1e21efb8_expert_report_file_b7702a61-9eed-4249-83bc-24a8a19ae02a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DN20%20ENC-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.7L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '85b056c6-c0d6-5d9f-8894-629a1e21efb8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DN20 ENC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DN20%20ENC&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'NISSAN',
'model': 'X-TRAIL',
'odometer': 20919,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85b056c6-c0d6-5d9f-8894-629a1e21efb8/85b056c6-c0d6-5d9f-8894-629a1e21efb8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53487,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142947/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85b056c6-c0d6-5d9f-8894-629a1e21efb8/85b056c6-c0d6-5d9f-8894-629a1e21efb8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48752,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142955/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85b056c6-c0d6-5d9f-8894-629a1e21efb8/85b056c6-c0d6-5d9f-8894-629a1e21efb8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48275,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142961/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85b056c6-c0d6-5d9f-8894-629a1e21efb8/85b056c6-c0d6-5d9f-8894-629a1e21efb8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50127,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142968/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85b056c6-c0d6-5d9f-8894-629a1e21efb8/85b056c6-c0d6-5d9f-8894-629a1e21efb8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48383,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142973/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85b056c6-c0d6-5d9f-8894-629a1e21efb8/85b056c6-c0d6-5d9f-8894-629a1e21efb8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45174,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142979/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85b056c6-c0d6-5d9f-8894-629a1e21efb8/85b056c6-c0d6-5d9f-8894-629a1e21efb8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87670,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142989/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85b056c6-c0d6-5d9f-8894-629a1e21efb8/85b056c6-c0d6-5d9f-8894-629a1e21efb8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72623,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699142999/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85b056c6-c0d6-5d9f-8894-629a1e21efb8/85b056c6-c0d6-5d9f-8894-629a1e21efb8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86432,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699143015/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85b056c6-c0d6-5d9f-8894-629a1e21efb8/85b056c6-c0d6-5d9f-8894-629a1e21efb8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68722,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN20ENC/699143026/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'NISSAN X-TRAIL 1.7 DCI 150 TEKNA (7ST) StationWagon',
'transmission': 'automatic',
'trim': 'DCI 150 TEKNA (7ST)',
'vin': 'JN1JHAT32U0021203',
'year': 2020}
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN20%2520ENC%27 HTTP/1.1" 200 None
2026-03-28 22:05:58 [bca.uk] INFO: Saving data for DN20%20ENC: {'created_time': 1774735558.078619, 'last_price_update_time': 1774735558.07863, 'auction_closing_time': 1774864800.0}
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DN20%2520ENC') HTTP/1.1" 204 0
2026-03-28 22:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2d2cdd9b-103e-5d8d-ac18-3bf908918b6c with identifier: PJ68%20AYD
2026-03-28 22:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2d2cdd9b-103e-5d8d-ac18-3bf908918b6c with identifier: PJ68%20AYD
2026-03-28 22:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2d2cdd9b-103e-5d8d-ac18-3bf908918b6c with identifier: PJ68%20AYD to the API
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002748/600>
{'auction_title': '',
'c_o_2_emission_value': 174,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d2cdd9b-103e-5d8d-ac18-3bf908918b6c/2d2cdd9b-103e-5d8d-ac18-3bf908918b6c_expert_report_file_9660c0d8-2c76-4178-a2d2-a605c66e0865.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ68%20AYD-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2d2cdd9b-103e-5d8d-ac18-3bf908918b6c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PJ68 AYD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PJ68%20AYD&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 52561,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d2cdd9b-103e-5d8d-ac18-3bf908918b6c/2d2cdd9b-103e-5d8d-ac18-3bf908918b6c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42642,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002732/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d2cdd9b-103e-5d8d-ac18-3bf908918b6c/2d2cdd9b-103e-5d8d-ac18-3bf908918b6c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42187,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002748/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d2cdd9b-103e-5d8d-ac18-3bf908918b6c/2d2cdd9b-103e-5d8d-ac18-3bf908918b6c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41707,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002768/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d2cdd9b-103e-5d8d-ac18-3bf908918b6c/2d2cdd9b-103e-5d8d-ac18-3bf908918b6c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43289,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002790/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d2cdd9b-103e-5d8d-ac18-3bf908918b6c/2d2cdd9b-103e-5d8d-ac18-3bf908918b6c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39018,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002812/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d2cdd9b-103e-5d8d-ac18-3bf908918b6c/2d2cdd9b-103e-5d8d-ac18-3bf908918b6c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37388,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002828/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d2cdd9b-103e-5d8d-ac18-3bf908918b6c/2d2cdd9b-103e-5d8d-ac18-3bf908918b6c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77335,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002873/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d2cdd9b-103e-5d8d-ac18-3bf908918b6c/2d2cdd9b-103e-5d8d-ac18-3bf908918b6c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90500,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002923/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d2cdd9b-103e-5d8d-ac18-3bf908918b6c/2d2cdd9b-103e-5d8d-ac18-3bf908918b6c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90895,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002947/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d2cdd9b-103e-5d8d-ac18-3bf908918b6c/2d2cdd9b-103e-5d8d-ac18-3bf908918b6c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78328,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68AYD/699002977/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'KIA SPORTAGE 1.6 T GDI AWD GT-LINE S DCT StationWagon',
'transmission': 'automatic',
'trim': 'T GDI AWD GT-LINE S DCT',
'vin': 'U5YPK816WKL642477',
'year': 2018}
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ68%2520AYD%27 HTTP/1.1" 200 None
2026-03-28 22:05:58 [bca.uk] INFO: Saving data for PJ68%20AYD: {'created_time': 1774735558.488572, 'last_price_update_time': 1774735558.488584, 'auction_closing_time': 1774778400.0}
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PJ68%2520AYD') HTTP/1.1" 204 0
2026-03-28 22:05:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699084986/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699084986>
2026-03-28 22:05:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330703/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330703>
2026-03-28 22:05:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330700/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330700>
2026-03-28 22:05:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176592/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176592>
2026-03-28 22:05:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145665/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145665>
2026-03-28 22:05:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176568/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176568>
2026-03-28 22:05:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981035/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GJ20UMA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ14PYU/42810573?sv=2020-08-04&st=2026-03-28T22%3A05%3A56Z&se=2026-03-28T22%3A30%3A56Z&sr=b&sp=r&sig=tkEo323ohrihOZXVnqm5FOYri5pOdaZiZLNiiyp2Vog%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EJ14%20PYU-GB>
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b41190>
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0/75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEP68DWV%252F699143404%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143404/600 saved to cache
2026-03-28 22:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a46ad0>
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0/75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEP68DWV%252F699143392%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143392/600 saved to cache
2026-03-28 22:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547762650>
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0/75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEP68DWV%252F699143398%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143398/600 saved to cache
2026-03-28 22:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a47310>
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b/f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE70UFX%252F699143538%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143538/600 saved to cache
2026-03-28 22:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549ac690>
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0/75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEP68DWV%252F699143383%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143383/600 saved to cache
2026-03-28 22:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a44ed0>
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b/f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE70UFX%252F699143516%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143516/600 saved to cache
2026-03-28 22:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54739d7d0>
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b/f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE70UFX%252F699143525%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143525/600 saved to cache
2026-03-28 22:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b
2026-03-28 22:05:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b, skipping ID generation
2026-03-28 22:05:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b sending to next pipeline
2026-03-28 22:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b, identifier: FE70%20UFX
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b40310>
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b97ea534-9544-5066-9940-a3af577b97fd/b97ea534-9544-5066-9940-a3af577b97fd_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX71JPO%252F699208549%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208549/600 saved to cache
2026-03-28 22:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b97ea534-9544-5066-9940-a3af577b97fd
2026-03-28 22:05:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b97ea534-9544-5066-9940-a3af577b97fd, skipping ID generation
2026-03-28 22:05:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b97ea534-9544-5066-9940-a3af577b97fd sending to next pipeline
2026-03-28 22:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b97ea534-9544-5066-9940-a3af577b97fd, identifier: EX71%20JPO
2026-03-28 22:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b with identifier: FE70%20UFX
2026-03-28 22:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b with identifier: FE70%20UFX
2026-03-28 22:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b with identifier: FE70%20UFX to the API
2026-03-28 22:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143525/600>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b/f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b_expert_report_file_84856b06-7296-493e-8b38-44d41ce4d732.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FE70%20UFX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FE70 UFX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FE70%20UFX&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'TOYOTA',
'model': 'COROLLA',
'odometer': 41735,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b/f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48544,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143516/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b/f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45185,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143525/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b/f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46951,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143538/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b/f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48622,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143556/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b/f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45070,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143567/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b/f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42989,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143576/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b/f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81275,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143601/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b/f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62014,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143615/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b/f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70210,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143633/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b/f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59523,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE70UFX/699143653/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'TOYOTA COROLLA 2.0 VVT-I 184 HYBRID GR-SPORT Hatchback',
'transmission': 'automatic',
'trim': 'VVT-I 184 HYBRID GR-SPORT',
'vin': 'SB1K53BEX0E053087',
'year': 2020}
2026-03-28 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE70%2520UFX%27 HTTP/1.1" 200 None
2026-03-28 22:05:59 [bca.uk] INFO: Saving data for FE70%20UFX: {'created_time': 1774735559.408309, 'last_price_update_time': 1774735559.408321, 'auction_closing_time': 1774864800.0}
2026-03-28 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FE70%2520UFX') HTTP/1.1" 204 0
2026-03-28 22:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b97ea534-9544-5066-9940-a3af577b97fd with identifier: EX71%20JPO
2026-03-28 22:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b97ea534-9544-5066-9940-a3af577b97fd with identifier: EX71%20JPO
2026-03-28 22:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b97ea534-9544-5066-9940-a3af577b97fd with identifier: EX71%20JPO to the API
2026-03-28 22:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:05:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208549/600>
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b97ea534-9544-5066-9940-a3af577b97fd/b97ea534-9544-5066-9940-a3af577b97fd_expert_report_file_a0f1cd6e-b23f-469f-aeba-2f48306e4012.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EX71%20JPO-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b97ea534-9544-5066-9940-a3af577b97fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EX71 JPO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EX71%20JPO&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'HYUNDAI',
'model': 'I20',
'odometer': 19095,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b97ea534-9544-5066-9940-a3af577b97fd/b97ea534-9544-5066-9940-a3af577b97fd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42347,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208519/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b97ea534-9544-5066-9940-a3af577b97fd/b97ea534-9544-5066-9940-a3af577b97fd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41009,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208532/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b97ea534-9544-5066-9940-a3af577b97fd/b97ea534-9544-5066-9940-a3af577b97fd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38644,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208539/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b97ea534-9544-5066-9940-a3af577b97fd/b97ea534-9544-5066-9940-a3af577b97fd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38416,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208549/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b97ea534-9544-5066-9940-a3af577b97fd/b97ea534-9544-5066-9940-a3af577b97fd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37997,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208560/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b97ea534-9544-5066-9940-a3af577b97fd/b97ea534-9544-5066-9940-a3af577b97fd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37663,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208569/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b97ea534-9544-5066-9940-a3af577b97fd/b97ea534-9544-5066-9940-a3af577b97fd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90101,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208599/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b97ea534-9544-5066-9940-a3af577b97fd/b97ea534-9544-5066-9940-a3af577b97fd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82093,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208642/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b97ea534-9544-5066-9940-a3af577b97fd/b97ea534-9544-5066-9940-a3af577b97fd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88859,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208676/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b97ea534-9544-5066-9940-a3af577b97fd/b97ea534-9544-5066-9940-a3af577b97fd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72254,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX71JPO/699208701/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'HYUNDAI I20 1.0 T-GDI 100 ELEMENT Hatchback',
'transmission': 'manual',
'trim': 'T-GDI 100 ELEMENT',
'vin': 'NLHBN51GLNZ105553',
'year': 2022}
2026-03-28 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX71%2520JPO%27 HTTP/1.1" 200 None
2026-03-28 22:05:59 [bca.uk] INFO: Saving data for EX71%20JPO: {'created_time': 1774735559.799245, 'last_price_update_time': 1774735559.799254, 'auction_closing_time': 1774864800.0}
2026-03-28 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EX71%2520JPO') HTTP/1.1" 204 0
2026-03-28 22:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143375/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EP68DWV/42810946?sv=2020-08-04&st=2026-03-28T22%3A05%3A50Z&se=2026-03-28T22%3A30%3A50Z&sr=b&sp=r&sig=1uJdwmrGOIygBj5SYsULEl4Y3gQ8gCcgWMy197GaNm4%3D)
2026-03-28 22:05:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176556/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176556>
2026-03-28 22:05:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK73EWD/42804333?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=5M4SgAmptrCJ8i0ARGkLnrB6V3wMXNdNGY6VCvEo%2F%2FI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK73%20EWD-GB>
2026-03-28 22:05:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176543/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YD13TWN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:05:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE19UGD/42807906?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=PVNSmCdj4lqVo33gqsXVrCQnpHCUCgw%2FIRQ0Qxai5qw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CE19%20UGD-GB>
2026-03-28 22:05:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN22SLU/42804593?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=hhNBBoBPvxsGjwiVsOUff1izuJYcAqLpIDtsYgB2%2FIY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CN22%20SLU-GB>
2026-03-28 22:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330710/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS69HBC/42809493?sv=2020-08-04&st=2026-03-28T22%3A05%3A48Z&se=2026-03-28T22%3A30%3A48Z&sr=b&sp=r&sig=RPTbTL6IWpJUqHEI5e6UpRd1kf3yXEufMgKsYj7zUWk%3D)
2026-03-28 22:05:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV67VJU/42810955?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=pcdQ%2FQprBD1I89Z22aQT%2Fy%2FecVGPDfQATBl8G%2BxCxUw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV67%20VJU-GB>
2026-03-28 22:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176568/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD13TWN/42806211?sv=2020-08-04&st=2026-03-28T22%3A05%3A28Z&se=2026-03-28T22%3A30%3A28Z&sr=b&sp=r&sig=wRfwJDLlJXXhiZvL3VXojvZD0PIHcruLftI3SeGjEFo%3D)
2026-03-28 22:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981035/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ20UMA/42810780?sv=2020-08-04&st=2026-03-28T22%3A05%3A32Z&se=2026-03-28T22%3A30%3A32Z&sr=b&sp=r&sig=bOMtVseDP5%2B4q3gO7UJt%2FRZXlewTKJ%2F8pF1iERt4wLA%3D)
2026-03-28 22:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145665/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML09TVX/42810920?sv=2020-08-04&st=2026-03-28T22%3A05%3A29Z&se=2026-03-28T22%3A30%3A29Z&sr=b&sp=r&sig=3CS5OP6y37ZBf1km95kjXxQgZGTyyd1Q098%2Fto%2FWbZ0%3D)
2026-03-28 22:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330703/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS69HBC/42809493?sv=2020-08-04&st=2026-03-28T22%3A05%3A48Z&se=2026-03-28T22%3A30%3A48Z&sr=b&sp=r&sig=RPTbTL6IWpJUqHEI5e6UpRd1kf3yXEufMgKsYj7zUWk%3D)
2026-03-28 22:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176592/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD13TWN/42806211?sv=2020-08-04&st=2026-03-28T22%3A05%3A28Z&se=2026-03-28T22%3A30%3A28Z&sr=b&sp=r&sig=wRfwJDLlJXXhiZvL3VXojvZD0PIHcruLftI3SeGjEFo%3D)
2026-03-28 22:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330700/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS69HBC/42809493?sv=2020-08-04&st=2026-03-28T22%3A05%3A48Z&se=2026-03-28T22%3A30%3A48Z&sr=b&sp=r&sig=RPTbTL6IWpJUqHEI5e6UpRd1kf3yXEufMgKsYj7zUWk%3D)
2026-03-28 22:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547392e10>
2026-03-28 22:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0/75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEP68DWV%252F699143375%252F600') HTTP/1.1" 204 0
2026-03-28 22:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143375/600 saved to cache
2026-03-28 22:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0
2026-03-28 22:05:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0, skipping ID generation
2026-03-28 22:05:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0 sending to next pipeline
2026-03-28 22:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0, identifier: EP68%20DWV
2026-03-28 22:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0 with identifier: EP68%20DWV
2026-03-28 22:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0 with identifier: EP68%20DWV
2026-03-28 22:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0 with identifier: EP68%20DWV to the API
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143375/600>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0/75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0_expert_report_file_362a99e8-239e-48e6-804f-0fd609419f22.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EP68%20DWV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EP68 DWV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EP68%20DWV&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'ECOSPORT',
'odometer': 14097,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0/75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48947,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143375/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0/75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45819,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143383/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0/75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44697,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143392/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0/75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46070,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143398/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0/75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48598,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143404/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0/75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46719,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143411/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0/75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84058,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143422/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0/75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64404,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143435/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0/75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77101,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143450/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0/75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70846,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EP68DWV/699143461/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD ECOSPORT 1.0 E/B 125 TITANIUM StationWagon',
'transmission': 'manual',
'trim': 'E/B 125 TITANIUM',
'vin': 'WF01XXERK1JG71135',
'year': 2019}
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EP68%2520DWV%27 HTTP/1.1" 200 None
2026-03-28 22:06:00 [bca.uk] INFO: Saving data for EP68%20DWV: {'created_time': 1774735560.47573, 'last_price_update_time': 1774735560.475742, 'auction_closing_time': 1774864800.0}
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EP68%2520DWV') HTTP/1.1" 204 0
2026-03-28 22:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176543/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD13TWN/42806211?sv=2020-08-04&st=2026-03-28T22%3A05%3A28Z&se=2026-03-28T22%3A30%3A28Z&sr=b&sp=r&sig=wRfwJDLlJXXhiZvL3VXojvZD0PIHcruLftI3SeGjEFo%3D)
2026-03-28 22:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176556/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD13TWN/42806211?sv=2020-08-04&st=2026-03-28T22%3A05%3A28Z&se=2026-03-28T22%3A30%3A28Z&sr=b&sp=r&sig=wRfwJDLlJXXhiZvL3VXojvZD0PIHcruLftI3SeGjEFo%3D)
2026-03-28 22:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699084986/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ69TFF/42809455?sv=2020-08-04&st=2026-03-28T22%3A05%3A48Z&se=2026-03-28T22%3A30%3A48Z&sr=b&sp=r&sig=E3vyVEVNQt9QGJ6lipDyfIWGUUx355bY1acjAnvJwVM%3D)
2026-03-28 22:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN22SLU/42804593?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=hhNBBoBPvxsGjwiVsOUff1izuJYcAqLpIDtsYgB2%2FIY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV67VJU/42810955?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=pcdQ%2FQprBD1I89Z22aQT%2Fy%2FecVGPDfQATBl8G%2BxCxUw%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK73EWD/42804333?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=5M4SgAmptrCJ8i0ARGkLnrB6V3wMXNdNGY6VCvEo%2F%2FI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55496ae50>
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567b92e4-538d-5dfd-a509-01ee1c685e60/567b92e4-538d-5dfd-a509-01ee1c685e60_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS69HBC%252F699330710%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330710/600 saved to cache
2026-03-28 22:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 567b92e4-538d-5dfd-a509-01ee1c685e60
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547748e90>
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08149aa9-acd8-5621-afc9-de796506b5b4/08149aa9-acd8-5621-afc9-de796506b5b4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD13TWN%252F699176568%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176568/600 saved to cache
2026-03-28 22:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08149aa9-acd8-5621-afc9-de796506b5b4
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473cd1d0>
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_182b028b-defa-51b3-b97c-bb87ff17eb7b/182b028b-defa-51b3-b97c-bb87ff17eb7b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ20UMA%252F698981035%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981035/600 saved to cache
2026-03-28 22:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 182b028b-defa-51b3-b97c-bb87ff17eb7b
2026-03-28 22:06:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 182b028b-defa-51b3-b97c-bb87ff17eb7b, skipping ID generation
2026-03-28 22:06:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 182b028b-defa-51b3-b97c-bb87ff17eb7b sending to next pipeline
2026-03-28 22:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 182b028b-defa-51b3-b97c-bb87ff17eb7b, identifier: GJ20%20UMA
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554937450>
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d1bd1b-e75f-5786-8613-977c6a06c247/79d1bd1b-e75f-5786-8613-977c6a06c247_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML09TVX%252F699145665%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145665/600 saved to cache
2026-03-28 22:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79d1bd1b-e75f-5786-8613-977c6a06c247
2026-03-28 22:06:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79d1bd1b-e75f-5786-8613-977c6a06c247, skipping ID generation
2026-03-28 22:06:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79d1bd1b-e75f-5786-8613-977c6a06c247 sending to next pipeline
2026-03-28 22:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 79d1bd1b-e75f-5786-8613-977c6a06c247, identifier: ML09%20TVX
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55489b690>
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567b92e4-538d-5dfd-a509-01ee1c685e60/567b92e4-538d-5dfd-a509-01ee1c685e60_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS69HBC%252F699330703%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330703/600 saved to cache
2026-03-28 22:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 567b92e4-538d-5dfd-a509-01ee1c685e60
2026-03-28 22:06:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54774a810>
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08149aa9-acd8-5621-afc9-de796506b5b4/08149aa9-acd8-5621-afc9-de796506b5b4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD13TWN%252F699176592%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176592/600 saved to cache
2026-03-28 22:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08149aa9-acd8-5621-afc9-de796506b5b4
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b43350>
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567b92e4-538d-5dfd-a509-01ee1c685e60/567b92e4-538d-5dfd-a509-01ee1c685e60_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS69HBC%252F699330700%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330700/600 saved to cache
2026-03-28 22:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 567b92e4-538d-5dfd-a509-01ee1c685e60
2026-03-28 22:06:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 567b92e4-538d-5dfd-a509-01ee1c685e60, skipping ID generation
2026-03-28 22:06:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 567b92e4-538d-5dfd-a509-01ee1c685e60 sending to next pipeline
2026-03-28 22:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 567b92e4-538d-5dfd-a509-01ee1c685e60, identifier: KS69%20HBC
2026-03-28 22:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ14PYU/42810573?sv=2020-08-04&st=2026-03-28T22%3A05%3A56Z&se=2026-03-28T22%3A30%3A56Z&sr=b&sp=r&sig=tkEo323ohrihOZXVnqm5FOYri5pOdaZiZLNiiyp2Vog%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE19UGD/42807906?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=PVNSmCdj4lqVo33gqsXVrCQnpHCUCgw%2FIRQ0Qxai5qw%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 182b028b-defa-51b3-b97c-bb87ff17eb7b with identifier: GJ20%20UMA
2026-03-28 22:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 182b028b-defa-51b3-b97c-bb87ff17eb7b with identifier: GJ20%20UMA
2026-03-28 22:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 182b028b-defa-51b3-b97c-bb87ff17eb7b with identifier: GJ20%20UMA to the API
2026-03-28 22:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981035/600>
{'auction_title': '',
'c_o_2_emission_value': 85,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182b028b-defa-51b3-b97c-bb87ff17eb7b/182b028b-defa-51b3-b97c-bb87ff17eb7b_expert_report_file_94692ad0-8cdb-48c9-8539-672bdbbaee28.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ20%20UMA-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '182b028b-defa-51b3-b97c-bb87ff17eb7b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ20 UMA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ20%20UMA&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'CITROEN',
'model': 'C1',
'odometer': 36374,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182b028b-defa-51b3-b97c-bb87ff17eb7b/182b028b-defa-51b3-b97c-bb87ff17eb7b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46286,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981035/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182b028b-defa-51b3-b97c-bb87ff17eb7b/182b028b-defa-51b3-b97c-bb87ff17eb7b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45240,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981059/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182b028b-defa-51b3-b97c-bb87ff17eb7b/182b028b-defa-51b3-b97c-bb87ff17eb7b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43424,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981081/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182b028b-defa-51b3-b97c-bb87ff17eb7b/182b028b-defa-51b3-b97c-bb87ff17eb7b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40964,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981100/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182b028b-defa-51b3-b97c-bb87ff17eb7b/182b028b-defa-51b3-b97c-bb87ff17eb7b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39324,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981128/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182b028b-defa-51b3-b97c-bb87ff17eb7b/182b028b-defa-51b3-b97c-bb87ff17eb7b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38833,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981144/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182b028b-defa-51b3-b97c-bb87ff17eb7b/182b028b-defa-51b3-b97c-bb87ff17eb7b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92814,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981176/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182b028b-defa-51b3-b97c-bb87ff17eb7b/182b028b-defa-51b3-b97c-bb87ff17eb7b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70811,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981209/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182b028b-defa-51b3-b97c-bb87ff17eb7b/182b028b-defa-51b3-b97c-bb87ff17eb7b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97794,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981252/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182b028b-defa-51b3-b97c-bb87ff17eb7b/182b028b-defa-51b3-b97c-bb87ff17eb7b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83841,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ20UMA/698981291/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'CITROEN C1 1.0 VTI 72 FLAIR Hatchback',
'transmission': 'manual',
'trim': 'VTI 72 FLAIR',
'vin': 'VF7PSCFB7KR537644',
'year': 2020}
2026-03-28 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ20%2520UMA%27 HTTP/1.1" 200 None
2026-03-28 22:06:01 [bca.uk] INFO: Saving data for GJ20%20UMA: {'created_time': 1774735561.565668, 'last_price_update_time': 1774735561.56568, 'auction_closing_time': 1774864800.0}
2026-03-28 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ20%2520UMA') HTTP/1.1" 204 0
2026-03-28 22:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 79d1bd1b-e75f-5786-8613-977c6a06c247 with identifier: ML09%20TVX
2026-03-28 22:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 79d1bd1b-e75f-5786-8613-977c6a06c247 with identifier: ML09%20TVX
2026-03-28 22:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 79d1bd1b-e75f-5786-8613-977c6a06c247 with identifier: ML09%20TVX to the API
2026-03-28 22:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145665/600>
{'auction_title': '',
'c_o_2_emission_value': 179,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d1bd1b-e75f-5786-8613-977c6a06c247/79d1bd1b-e75f-5786-8613-977c6a06c247_expert_report_file_e4a87ddb-e28e-48f9-8f5b-8e8606f29ec7.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ML09%20TVX-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '79d1bd1b-e75f-5786-8613-977c6a06c247',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ML09 TVX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ML09%20TVX&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'JAGUAR',
'model': 'XF',
'odometer': 93372,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d1bd1b-e75f-5786-8613-977c6a06c247/79d1bd1b-e75f-5786-8613-977c6a06c247_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48021,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145660/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d1bd1b-e75f-5786-8613-977c6a06c247/79d1bd1b-e75f-5786-8613-977c6a06c247_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46053,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145665/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d1bd1b-e75f-5786-8613-977c6a06c247/79d1bd1b-e75f-5786-8613-977c6a06c247_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43660,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145671/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d1bd1b-e75f-5786-8613-977c6a06c247/79d1bd1b-e75f-5786-8613-977c6a06c247_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46346,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145679/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d1bd1b-e75f-5786-8613-977c6a06c247/79d1bd1b-e75f-5786-8613-977c6a06c247_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45146,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145686/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d1bd1b-e75f-5786-8613-977c6a06c247/79d1bd1b-e75f-5786-8613-977c6a06c247_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40484,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145694/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d1bd1b-e75f-5786-8613-977c6a06c247/79d1bd1b-e75f-5786-8613-977c6a06c247_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81437,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145705/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d1bd1b-e75f-5786-8613-977c6a06c247/79d1bd1b-e75f-5786-8613-977c6a06c247_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86307,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145719/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d1bd1b-e75f-5786-8613-977c6a06c247/79d1bd1b-e75f-5786-8613-977c6a06c247_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95725,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145730/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d1bd1b-e75f-5786-8613-977c6a06c247/79d1bd1b-e75f-5786-8613-977c6a06c247_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67156,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML09TVX/699145743/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'JAGUAR XF 3.0 D V6 240 LUXURY Saloon',
'transmission': 'automatic',
'trim': 'D V6 240 LUXURY',
'vin': 'SAJAC0525AKR49010',
'year': 2009}
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML09%2520TVX%27 HTTP/1.1" 200 None
2026-03-28 22:06:02 [bca.uk] INFO: Saving data for ML09%20TVX: {'created_time': 1774735562.059099, 'last_price_update_time': 1774735562.059111, 'auction_closing_time': 1774864800.0}
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ML09%2520TVX') HTTP/1.1" 204 0
2026-03-28 22:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 567b92e4-538d-5dfd-a509-01ee1c685e60 with identifier: KS69%20HBC
2026-03-28 22:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 567b92e4-538d-5dfd-a509-01ee1c685e60 with identifier: KS69%20HBC
2026-03-28 22:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 567b92e4-538d-5dfd-a509-01ee1c685e60 with identifier: KS69%20HBC to the API
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330700/600>
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567b92e4-538d-5dfd-a509-01ee1c685e60/567b92e4-538d-5dfd-a509-01ee1c685e60_expert_report_file_85875d39-97ba-43e4-b63a-031c437498be.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KS69%20HBC-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '567b92e4-538d-5dfd-a509-01ee1c685e60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KS69 HBC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KS69%20HBC&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 98690,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567b92e4-538d-5dfd-a509-01ee1c685e60/567b92e4-538d-5dfd-a509-01ee1c685e60_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45903,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330696/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567b92e4-538d-5dfd-a509-01ee1c685e60/567b92e4-538d-5dfd-a509-01ee1c685e60_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45398,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330700/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567b92e4-538d-5dfd-a509-01ee1c685e60/567b92e4-538d-5dfd-a509-01ee1c685e60_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41585,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330703/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567b92e4-538d-5dfd-a509-01ee1c685e60/567b92e4-538d-5dfd-a509-01ee1c685e60_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40146,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330707/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567b92e4-538d-5dfd-a509-01ee1c685e60/567b92e4-538d-5dfd-a509-01ee1c685e60_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38371,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330710/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567b92e4-538d-5dfd-a509-01ee1c685e60/567b92e4-538d-5dfd-a509-01ee1c685e60_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38978,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330714/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567b92e4-538d-5dfd-a509-01ee1c685e60/567b92e4-538d-5dfd-a509-01ee1c685e60_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68904,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330719/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567b92e4-538d-5dfd-a509-01ee1c685e60/567b92e4-538d-5dfd-a509-01ee1c685e60_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65543,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330722/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567b92e4-538d-5dfd-a509-01ee1c685e60/567b92e4-538d-5dfd-a509-01ee1c685e60_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100749,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330727/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567b92e4-538d-5dfd-a509-01ee1c685e60/567b92e4-538d-5dfd-a509-01ee1c685e60_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73999,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS69HBC/699330732/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.4 90 GRIFFIN Hatchback',
'transmission': 'manual',
'trim': '90 GRIFFIN',
'vin': 'W0V0XEP68K4508415',
'year': 2019}
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS69%2520HBC%27 HTTP/1.1" 200 None
2026-03-28 22:06:02 [bca.uk] INFO: Saving data for KS69%20HBC: {'created_time': 1774735562.45809, 'last_price_update_time': 1774735562.4581, 'auction_closing_time': 1774864800.0}
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KS69%2520HBC') HTTP/1.1" 204 0
2026-03-28 22:06:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976273/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976273>
2026-03-28 22:06:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV18FLW/42810997?sv=2020-08-04&st=2026-03-28T22%3A06%3A00Z&se=2026-03-28T22%3A31%3A00Z&sr=b&sp=r&sig=SGW%2Bfk4wNUPe96eq0MmJHlKteRFOQ3%2BV8WGM5O5WczE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LV18%20FLW-GB>
2026-03-28 22:06:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV60BVR/42810790?sv=2020-08-04&st=2026-03-28T22%3A06%3A00Z&se=2026-03-28T22%3A31%3A00Z&sr=b&sp=r&sig=GMzmKOCsLt6CgM899XlsNZHP3Kky1BS5HKw%2FJfd%2B9QU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV60%20BVR-GB>
2026-03-28 22:06:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010836/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010836>
2026-03-28 22:06:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976233/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976233>
2026-03-28 22:06:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY06VPF/42810794?sv=2020-08-04&st=2026-03-28T22%3A06%3A01Z&se=2026-03-28T22%3A31%3A01Z&sr=b&sp=r&sig=SQx%2F2I7rxj%2Buge5rNrhJlhbH0k5DNdXPQnRujp2mymc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HY06%20VPF-GB>
2026-03-28 22:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54747ad90>
2026-03-28 22:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08149aa9-acd8-5621-afc9-de796506b5b4/08149aa9-acd8-5621-afc9-de796506b5b4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD13TWN%252F699176543%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176543/600 saved to cache
2026-03-28 22:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08149aa9-acd8-5621-afc9-de796506b5b4
2026-03-28 22:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471ccf50>
2026-03-28 22:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08149aa9-acd8-5621-afc9-de796506b5b4/08149aa9-acd8-5621-afc9-de796506b5b4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD13TWN%252F699176556%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176556/600 saved to cache
2026-03-28 22:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08149aa9-acd8-5621-afc9-de796506b5b4
2026-03-28 22:06:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08149aa9-acd8-5621-afc9-de796506b5b4, skipping ID generation
2026-03-28 22:06:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08149aa9-acd8-5621-afc9-de796506b5b4 sending to next pipeline
2026-03-28 22:06:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 08149aa9-acd8-5621-afc9-de796506b5b4, identifier: YD13%20TWN
2026-03-28 22:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477cc6d0>
2026-03-28 22:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0000ca0-cda2-564a-a588-b58706c95283/a0000ca0-cda2-564a-a588-b58706c95283_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ69TFF%252F699084986%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699084986/600 saved to cache
2026-03-28 22:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0000ca0-cda2-564a-a588-b58706c95283
2026-03-28 22:06:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0000ca0-cda2-564a-a588-b58706c95283, skipping ID generation
2026-03-28 22:06:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0000ca0-cda2-564a-a588-b58706c95283 sending to next pipeline
2026-03-28 22:06:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a0000ca0-cda2-564a-a588-b58706c95283, identifier: EJ69%20TFF
2026-03-28 22:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474bb710>
2026-03-28 22:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b95ec648-e27a-5a47-b460-f09e07adbbeb/b95ec648-e27a-5a47-b460-f09e07adbbeb_expert_report_file_9ab6a484-ec04-4179-80fd-72f9b2eb2762.pdf HTTP/1.1" 201 0
2026-03-28 22:06:02 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b95ec648-e27a-5a47-b460-f09e07adbbeb
2026-03-28 22:06:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b95ec648-e27a-5a47-b460-f09e07adbbeb, skipping ID generation
2026-03-28 22:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b95ec648-e27a-5a47-b460-f09e07adbbeb
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCN22SLU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CN22SLU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477cead0>
2026-03-28 22:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68511f88-68fc-5ac1-befe-453b6775c3b3/68511f88-68fc-5ac1-befe-453b6775c3b3_expert_report_file_5d9df9f2-fb35-4933-ad9e-836ba009696b.pdf HTTP/1.1" 201 0
2026-03-28 22:06:02 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 68511f88-68fc-5ac1-befe-453b6775c3b3
2026-03-28 22:06:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68511f88-68fc-5ac1-befe-453b6775c3b3, skipping ID generation
2026-03-28 22:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 68511f88-68fc-5ac1-befe-453b6775c3b3
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DOV67VJU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OV67VJU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5476e7890>
2026-03-28 22:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e39c955-50ed-58e2-b150-dec2ff78b99f/8e39c955-50ed-58e2-b150-dec2ff78b99f_expert_report_file_b03704b2-79e4-4e86-bb20-1dc6ba0d6942.pdf HTTP/1.1" 201 0
2026-03-28 22:06:02 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8e39c955-50ed-58e2-b150-dec2ff78b99f
2026-03-28 22:06:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e39c955-50ed-58e2-b150-dec2ff78b99f, skipping ID generation
2026-03-28 22:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e39c955-50ed-58e2-b150-dec2ff78b99f
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHK73EWD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HK73EWD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 08149aa9-acd8-5621-afc9-de796506b5b4 with identifier: YD13%20TWN
2026-03-28 22:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 08149aa9-acd8-5621-afc9-de796506b5b4 with identifier: YD13%20TWN
2026-03-28 22:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 08149aa9-acd8-5621-afc9-de796506b5b4 with identifier: YD13%20TWN to the API
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176556/600>
{'auction_title': '',
'c_o_2_emission_value': 174,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08149aa9-acd8-5621-afc9-de796506b5b4/08149aa9-acd8-5621-afc9-de796506b5b4_expert_report_file_cc4531de-4ddf-42af-85e8-0a538aa00418.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD13%20TWN-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '08149aa9-acd8-5621-afc9-de796506b5b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YD13 TWN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YD13%20TWN&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 110158,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08149aa9-acd8-5621-afc9-de796506b5b4/08149aa9-acd8-5621-afc9-de796506b5b4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42416,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176543/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08149aa9-acd8-5621-afc9-de796506b5b4/08149aa9-acd8-5621-afc9-de796506b5b4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41116,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176550/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08149aa9-acd8-5621-afc9-de796506b5b4/08149aa9-acd8-5621-afc9-de796506b5b4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38750,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176556/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08149aa9-acd8-5621-afc9-de796506b5b4/08149aa9-acd8-5621-afc9-de796506b5b4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36852,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176562/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08149aa9-acd8-5621-afc9-de796506b5b4/08149aa9-acd8-5621-afc9-de796506b5b4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36841,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176568/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08149aa9-acd8-5621-afc9-de796506b5b4/08149aa9-acd8-5621-afc9-de796506b5b4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37483,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176575/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08149aa9-acd8-5621-afc9-de796506b5b4/08149aa9-acd8-5621-afc9-de796506b5b4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50090,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176584/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08149aa9-acd8-5621-afc9-de796506b5b4/08149aa9-acd8-5621-afc9-de796506b5b4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77688,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176592/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08149aa9-acd8-5621-afc9-de796506b5b4/08149aa9-acd8-5621-afc9-de796506b5b4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84758,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176601/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08149aa9-acd8-5621-afc9-de796506b5b4/08149aa9-acd8-5621-afc9-de796506b5b4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69259,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD13TWN/699176610/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.2 SD4 4WD PURE Hatchback',
'transmission': 'automatic',
'trim': 'SD4 4WD PURE',
'vin': 'SALVA2AE2DH764862',
'year': 2013}
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD13%2520TWN%27 HTTP/1.1" 200 None
2026-03-28 22:06:03 [bca.uk] INFO: Saving data for YD13%20TWN: {'created_time': 1774735563.330268, 'last_price_update_time': 1774735563.330281, 'auction_closing_time': 1774864800.0}
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YD13%2520TWN') HTTP/1.1" 204 0
2026-03-28 22:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a0000ca0-cda2-564a-a588-b58706c95283 with identifier: EJ69%20TFF
2026-03-28 22:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a0000ca0-cda2-564a-a588-b58706c95283 with identifier: EJ69%20TFF
2026-03-28 22:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a0000ca0-cda2-564a-a588-b58706c95283 with identifier: EJ69%20TFF to the API
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699084986/600>
{'auction_title': '',
'c_o_2_emission_value': 96,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0000ca0-cda2-564a-a588-b58706c95283/a0000ca0-cda2-564a-a588-b58706c95283_expert_report_file_751445b6-6112-4cd7-b6b5-fe0c7535bcd5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EJ69%20TFF-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a0000ca0-cda2-564a-a588-b58706c95283',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EJ69 TFF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EJ69%20TFF&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 59551,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0000ca0-cda2-564a-a588-b58706c95283/a0000ca0-cda2-564a-a588-b58706c95283_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43143,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699084972/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0000ca0-cda2-564a-a588-b58706c95283/a0000ca0-cda2-564a-a588-b58706c95283_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41174,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699084986/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0000ca0-cda2-564a-a588-b58706c95283/a0000ca0-cda2-564a-a588-b58706c95283_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39291,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699084996/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0000ca0-cda2-564a-a588-b58706c95283/a0000ca0-cda2-564a-a588-b58706c95283_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37045,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085005/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0000ca0-cda2-564a-a588-b58706c95283/a0000ca0-cda2-564a-a588-b58706c95283_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36629,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085016/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0000ca0-cda2-564a-a588-b58706c95283/a0000ca0-cda2-564a-a588-b58706c95283_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37629,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085025/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0000ca0-cda2-564a-a588-b58706c95283/a0000ca0-cda2-564a-a588-b58706c95283_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55840,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085047/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0000ca0-cda2-564a-a588-b58706c95283/a0000ca0-cda2-564a-a588-b58706c95283_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58165,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085062/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0000ca0-cda2-564a-a588-b58706c95283/a0000ca0-cda2-564a-a588-b58706c95283_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67934,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085082/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0000ca0-cda2-564a-a588-b58706c95283/a0000ca0-cda2-564a-a588-b58706c95283_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56226,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ69TFF/699085098/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 125 ST-LINE ED. Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 ST-LINE ED.',
'vin': 'WF0JXXGAHJKM13690',
'year': 2019}
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ69%2520TFF%27 HTTP/1.1" 200 None
2026-03-28 22:06:03 [bca.uk] INFO: Saving data for EJ69%20TFF: {'created_time': 1774735563.72918, 'last_price_update_time': 1774735563.729191, 'auction_closing_time': 1774864800.0}
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EJ69%2520TFF') HTTP/1.1" 204 0
2026-03-28 22:06:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM20TSZ/42810665?sv=2020-08-04&st=2026-03-28T22%3A06%3A02Z&se=2026-03-28T22%3A31%3A02Z&sr=b&sp=r&sig=ftaAijuPkq7ydQllJHk65YeNmNsW07AOMLqm%2B%2BdmuxI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM20%20TSZ-GB>
2026-03-28 22:06:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253486/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253486>
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188468%27 HTTP/1.1" 200 None
2026-03-28 22:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188468 not downloaded yet
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146011%27 HTTP/1.1" 200 None
2026-03-28 22:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146011 not downloaded yet
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158104%27 HTTP/1.1" 200 None
2026-03-28 22:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158104 not downloaded yet
2026-03-28 22:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55422d810>
2026-03-28 22:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2faac3c-f66f-5c6b-825e-332b835cca02/c2faac3c-f66f-5c6b-825e-332b835cca02_expert_report_file_a021ff63-ed4b-43e8-a3eb-822b6956630f.pdf HTTP/1.1" 201 0
2026-03-28 22:06:03 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c2faac3c-f66f-5c6b-825e-332b835cca02
2026-03-28 22:06:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2faac3c-f66f-5c6b-825e-332b835cca02, skipping ID generation
2026-03-28 22:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c2faac3c-f66f-5c6b-825e-332b835cca02
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEJ14PYU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EJ14PYU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554883750>
2026-03-28 22:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2785a6e-33af-5eba-b84f-311143aa78be/e2785a6e-33af-5eba-b84f-311143aa78be_expert_report_file_f5271fbc-7e73-419e-a8c0-3c90a6ce55d5.pdf HTTP/1.1" 201 0
2026-03-28 22:06:03 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e2785a6e-33af-5eba-b84f-311143aa78be
2026-03-28 22:06:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2785a6e-33af-5eba-b84f-311143aa78be, skipping ID generation
2026-03-28 22:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e2785a6e-33af-5eba-b84f-311143aa78be
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCE19UGD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CE19UGD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976203/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976203>
2026-03-28 22:06:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010809/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010809>
2026-03-28 22:06:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT70DMF/42810730?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=Cj70IayWn1fkSTExGRHSsxoWyNODHjl4jZATJrTuBHI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HT70%20DMF-GB>
2026-03-28 22:06:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253476/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253476>
2026-03-28 22:06:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176143/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LO62FPD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA18XPV/42810838?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=6qf9M7QUJwwcCEWDDFA2bz6RBkIbS81BmjR8La%2BNZQI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RA18%20XPV-GB>
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188478%27 HTTP/1.1" 200 None
2026-03-28 22:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188478 not downloaded yet
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146020%27 HTTP/1.1" 200 None
2026-03-28 22:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146020 not downloaded yet
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158108%27 HTTP/1.1" 200 None
2026-03-28 22:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158108 not downloaded yet
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994385%27 HTTP/1.1" 200 None
2026-03-28 22:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994385 not downloaded yet
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208282%27 HTTP/1.1" 200 None
2026-03-28 22:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208282 not downloaded yet
2026-03-28 22:06:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253466/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253466>
2026-03-28 22:06:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN18OGS/42810862?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=KQgq7w1lB0i8NJ%2FYl2aQsZ9dYLPzJqvNwFp8%2FU7W%2FrI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KN18%20OGS-GB>
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188484%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188484 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146025%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146025 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158113%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158113 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994404%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994404 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208292%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208292 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188493%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188493 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146032%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146032 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158116%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158116 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994415%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994415 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208302%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208302 not downloaded yet
2026-03-28 22:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976273/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MW21AXB/42810470?sv=2020-08-04&st=2026-03-28T22%3A05%3A20Z&se=2026-03-28T22%3A30%3A20Z&sr=b&sp=r&sig=%2BrUdlzqIxAeDMjwos9mDVGiRE12qe2ahKjkgj9P6mZg%3D)
2026-03-28 22:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010836/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ10XBR/42810460?sv=2020-08-04&st=2026-03-28T22%3A05%3A21Z&se=2026-03-28T22%3A30%3A21Z&sr=b&sp=r&sig=Omxs4vBf8IL8wES3JqTd9z%2FqnN52Fjw%2BOfzPET2vDTk%3D)
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188500%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188500 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146039%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146039 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158122%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158122 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994428%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994428 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208311%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208311 not downloaded yet
2026-03-28 22:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976233/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MW21AXB/42810470?sv=2020-08-04&st=2026-03-28T22%3A05%3A20Z&se=2026-03-28T22%3A30%3A20Z&sr=b&sp=r&sig=%2BrUdlzqIxAeDMjwos9mDVGiRE12qe2ahKjkgj9P6mZg%3D)
2026-03-28 22:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV60BVR/42810790?sv=2020-08-04&st=2026-03-28T22%3A06%3A00Z&se=2026-03-28T22%3A31%3A00Z&sr=b&sp=r&sig=GMzmKOCsLt6CgM899XlsNZHP3Kky1BS5HKw%2FJfd%2B9QU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV18FLW/42810997?sv=2020-08-04&st=2026-03-28T22%3A06%3A00Z&se=2026-03-28T22%3A31%3A00Z&sr=b&sp=r&sig=SGW%2Bfk4wNUPe96eq0MmJHlKteRFOQ3%2BV8WGM5O5WczE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188514%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188514 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146051%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146051 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158138%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158138 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994454%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994454 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208316%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208316 not downloaded yet
2026-03-28 22:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253486/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK65LPO/42809710?sv=2020-08-04&st=2026-03-28T22%3A05%3A20Z&se=2026-03-28T22%3A30%3A20Z&sr=b&sp=r&sig=oYxianEWP158PMpIdI%2Bc0WAWDjGi9DwdgesR7rPTi%2Bg%3D)
2026-03-28 22:06:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55485ad50>
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec532b91-2d62-5ebd-830b-087067e8ed90/ec532b91-2d62-5ebd-830b-087067e8ed90_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMW21AXB%252F698976273%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976273/600 saved to cache
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ec532b91-2d62-5ebd-830b-087067e8ed90
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557644690>
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_976f1540-41c9-5853-a520-2191352412f3/976f1540-41c9-5853-a520-2191352412f3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ10XBR%252F699010836%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010836/600 saved to cache
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 976f1540-41c9-5853-a520-2191352412f3
2026-03-28 22:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176143/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO62FPD/42810887?sv=2020-08-04&st=2026-03-28T22%3A05%3A24Z&se=2026-03-28T22%3A30%3A24Z&sr=b&sp=r&sig=P8NCpVvkz1uu7oEXsd9E3ohiNsPp4GVfqPmDLbXubx8%3D)
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188526%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188526 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146059%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146059 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158151%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158151 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994481%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994481 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208333%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208333 not downloaded yet
2026-03-28 22:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM20TSZ/42810665?sv=2020-08-04&st=2026-03-28T22%3A06%3A02Z&se=2026-03-28T22%3A31%3A02Z&sr=b&sp=r&sig=ftaAijuPkq7ydQllJHk65YeNmNsW07AOMLqm%2B%2BdmuxI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA18XPV/42810838?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=6qf9M7QUJwwcCEWDDFA2bz6RBkIbS81BmjR8La%2BNZQI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253476/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK65LPO/42809710?sv=2020-08-04&st=2026-03-28T22%3A05%3A20Z&se=2026-03-28T22%3A30%3A20Z&sr=b&sp=r&sig=oYxianEWP158PMpIdI%2Bc0WAWDjGi9DwdgesR7rPTi%2Bg%3D)
2026-03-28 22:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010809/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ10XBR/42810460?sv=2020-08-04&st=2026-03-28T22%3A05%3A21Z&se=2026-03-28T22%3A30%3A21Z&sr=b&sp=r&sig=Omxs4vBf8IL8wES3JqTd9z%2FqnN52Fjw%2BOfzPET2vDTk%3D)
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188548%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188548 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146070%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146070 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158163%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158163 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994514%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994514 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208351%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208351 not downloaded yet
2026-03-28 22:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY06VPF/42810794?sv=2020-08-04&st=2026-03-28T22%3A06%3A01Z&se=2026-03-28T22%3A31%3A01Z&sr=b&sp=r&sig=SQx%2F2I7rxj%2Buge5rNrhJlhbH0k5DNdXPQnRujp2mymc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976203/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MW21AXB/42810470?sv=2020-08-04&st=2026-03-28T22%3A05%3A20Z&se=2026-03-28T22%3A30%3A20Z&sr=b&sp=r&sig=%2BrUdlzqIxAeDMjwos9mDVGiRE12qe2ahKjkgj9P6mZg%3D)
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188557%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188557 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146080%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146080 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158174%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158174 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994541%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994541 not downloaded yet
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208370%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208370 not downloaded yet
2026-03-28 22:06:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547312b90>
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec532b91-2d62-5ebd-830b-087067e8ed90/ec532b91-2d62-5ebd-830b-087067e8ed90_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMW21AXB%252F698976233%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976233/600 saved to cache
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ec532b91-2d62-5ebd-830b-087067e8ed90
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55496b890>
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4d23d94-cc98-52e5-b2e4-244cf1ddd01e/f4d23d94-cc98-52e5-b2e4-244cf1ddd01e_expert_report_file_c55219e7-68b7-4d4a-bf7d-122dbd5b9cd5.pdf HTTP/1.1" 201 0
2026-03-28 22:06:04 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f4d23d94-cc98-52e5-b2e4-244cf1ddd01e
2026-03-28 22:06:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f4d23d94-cc98-52e5-b2e4-244cf1ddd01e, skipping ID generation
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item f4d23d94-cc98-52e5-b2e4-244cf1ddd01e
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DOV60BVR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OV60BVR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549ad1d0>
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0f6191-0680-5ec4-9f99-776551675a24/3b0f6191-0680-5ec4-9f99-776551675a24_expert_report_file_81d39c61-0185-47a4-a830-ad2da9a04075.pdf HTTP/1.1" 201 0
2026-03-28 22:06:04 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3b0f6191-0680-5ec4-9f99-776551675a24
2026-03-28 22:06:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b0f6191-0680-5ec4-9f99-776551675a24, skipping ID generation
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b0f6191-0680-5ec4-9f99-776551675a24
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLV18FLW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LV18FLW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547318c10>
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a373065-9147-5214-8a56-d55636e4875e/7a373065-9147-5214-8a56-d55636e4875e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK65LPO%252F699253486%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253486/600 saved to cache
2026-03-28 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7a373065-9147-5214-8a56-d55636e4875e
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549f11d0>
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33f95c1b-3436-504d-8243-b3c29aca56a3/33f95c1b-3436-504d-8243-b3c29aca56a3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO62FPD%252F699176143%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176143/600 saved to cache
2026-03-28 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33f95c1b-3436-504d-8243-b3c29aca56a3
2026-03-28 22:06:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33f95c1b-3436-504d-8243-b3c29aca56a3, skipping ID generation
2026-03-28 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33f95c1b-3436-504d-8243-b3c29aca56a3 sending to next pipeline
2026-03-28 22:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 33f95c1b-3436-504d-8243-b3c29aca56a3, identifier: LO62%20FPD
2026-03-28 22:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253466/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK65LPO/42809710?sv=2020-08-04&st=2026-03-28T22%3A05%3A20Z&se=2026-03-28T22%3A30%3A20Z&sr=b&sp=r&sig=oYxianEWP158PMpIdI%2Bc0WAWDjGi9DwdgesR7rPTi%2Bg%3D)
2026-03-28 22:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 33f95c1b-3436-504d-8243-b3c29aca56a3 with identifier: LO62%20FPD
2026-03-28 22:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 33f95c1b-3436-504d-8243-b3c29aca56a3 with identifier: LO62%20FPD
2026-03-28 22:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 33f95c1b-3436-504d-8243-b3c29aca56a3 with identifier: LO62%20FPD to the API
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176143/600>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33f95c1b-3436-504d-8243-b3c29aca56a3/33f95c1b-3436-504d-8243-b3c29aca56a3_expert_report_file_c463be0a-6b1a-4e2d-9b73-2846f2771508.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LO62%20FPD-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '33f95c1b-3436-504d-8243-b3c29aca56a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LO62 FPD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LO62%20FPD&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'FORD',
'model': 'MONDEO',
'odometer': 38085,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33f95c1b-3436-504d-8243-b3c29aca56a3/33f95c1b-3436-504d-8243-b3c29aca56a3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44896,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176143/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33f95c1b-3436-504d-8243-b3c29aca56a3/33f95c1b-3436-504d-8243-b3c29aca56a3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43130,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176153/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33f95c1b-3436-504d-8243-b3c29aca56a3/33f95c1b-3436-504d-8243-b3c29aca56a3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41049,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176163/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33f95c1b-3436-504d-8243-b3c29aca56a3/33f95c1b-3436-504d-8243-b3c29aca56a3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41305,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176173/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33f95c1b-3436-504d-8243-b3c29aca56a3/33f95c1b-3436-504d-8243-b3c29aca56a3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38194,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176185/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33f95c1b-3436-504d-8243-b3c29aca56a3/33f95c1b-3436-504d-8243-b3c29aca56a3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35229,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176199/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33f95c1b-3436-504d-8243-b3c29aca56a3/33f95c1b-3436-504d-8243-b3c29aca56a3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66343,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176216/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33f95c1b-3436-504d-8243-b3c29aca56a3/33f95c1b-3436-504d-8243-b3c29aca56a3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64763,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176232/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33f95c1b-3436-504d-8243-b3c29aca56a3/33f95c1b-3436-504d-8243-b3c29aca56a3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75924,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176252/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33f95c1b-3436-504d-8243-b3c29aca56a3/33f95c1b-3436-504d-8243-b3c29aca56a3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78178,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO62FPD/699176267/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD MONDEO 2.0 TDCI 163 TITANIUM P/SHIFT Hatchback',
'transmission': 'automatic',
'trim': 'TDCI 163 TITANIUM P/SHIFT',
'vin': 'WF0EXXGBBECD31663',
'year': 2012}
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO62%2520FPD%27 HTTP/1.1" 200 None
2026-03-28 22:06:05 [bca.uk] INFO: Saving data for LO62%20FPD: {'created_time': 1774735565.590045, 'last_price_update_time': 1774735565.590054, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LO62%2520FPD') HTTP/1.1" 204 0
2026-03-28 22:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT70DMF/42810730?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=Cj70IayWn1fkSTExGRHSsxoWyNODHjl4jZATJrTuBHI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208302/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208302>
2026-03-28 22:06:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208292/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208292>
2026-03-28 22:06:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994415/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994415>
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994575%27 HTTP/1.1" 200 None
2026-03-28 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994575 not downloaded yet
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208389%27 HTTP/1.1" 200 None
2026-03-28 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208389 not downloaded yet
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993527%27 HTTP/1.1" 200 None
2026-03-28 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993527 not downloaded yet
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023417%27 HTTP/1.1" 200 None
2026-03-28 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023417 not downloaded yet
2026-03-28 22:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54778e690>
2026-03-28 22:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c73d75d1-bd0a-5743-8d24-444e4cdb7552/c73d75d1-bd0a-5743-8d24-444e4cdb7552_expert_report_file_2b3889a8-4748-4555-8c8b-703dd3db3c89.pdf HTTP/1.1" 201 0
2026-03-28 22:06:05 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c73d75d1-bd0a-5743-8d24-444e4cdb7552
2026-03-28 22:06:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c73d75d1-bd0a-5743-8d24-444e4cdb7552, skipping ID generation
2026-03-28 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c73d75d1-bd0a-5743-8d24-444e4cdb7552
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKM20TSZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KM20TSZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473df810>
2026-03-28 22:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc46c333-9727-5d8d-ab5c-b3d4cb03ad24/cc46c333-9727-5d8d-ab5c-b3d4cb03ad24_expert_report_file_a0c8f35c-b95d-4f5d-9265-5af78ab0e39c.pdf HTTP/1.1" 201 0
2026-03-28 22:06:05 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cc46c333-9727-5d8d-ab5c-b3d4cb03ad24
2026-03-28 22:06:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc46c333-9727-5d8d-ab5c-b3d4cb03ad24, skipping ID generation
2026-03-28 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc46c333-9727-5d8d-ab5c-b3d4cb03ad24
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRA18XPV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RA18XPV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547104610>
2026-03-28 22:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a373065-9147-5214-8a56-d55636e4875e/7a373065-9147-5214-8a56-d55636e4875e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK65LPO%252F699253476%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253476/600 saved to cache
2026-03-28 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7a373065-9147-5214-8a56-d55636e4875e
2026-03-28 22:06:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208311/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208311>
2026-03-28 22:06:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994428/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994428>
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993536%27 HTTP/1.1" 200 None
2026-03-28 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993536 not downloaded yet
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023430%27 HTTP/1.1" 200 None
2026-03-28 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023430 not downloaded yet
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970551%27 HTTP/1.1" 200 None
2026-03-28 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970551 not downloaded yet
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146116%27 HTTP/1.1" 200 None
2026-03-28 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146116 not downloaded yet
2026-03-28 22:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN18OGS/42810862?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=KQgq7w1lB0i8NJ%2FYl2aQsZ9dYLPzJqvNwFp8%2FU7W%2FrI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5476e4250>
2026-03-28 22:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_976f1540-41c9-5853-a520-2191352412f3/976f1540-41c9-5853-a520-2191352412f3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ10XBR%252F699010809%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010809/600 saved to cache
2026-03-28 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 976f1540-41c9-5853-a520-2191352412f3
2026-03-28 22:06:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 976f1540-41c9-5853-a520-2191352412f3, skipping ID generation
2026-03-28 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 976f1540-41c9-5853-a520-2191352412f3 sending to next pipeline
2026-03-28 22:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 976f1540-41c9-5853-a520-2191352412f3, identifier: AJ10%20XBR
2026-03-28 22:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477cfb10>
2026-03-28 22:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4d4397f-82ae-5f65-add6-f530f9d672f0/b4d4397f-82ae-5f65-add6-f530f9d672f0_expert_report_file_d4f8fc37-7cc5-4e1f-ab61-ad09c7654bd7.pdf HTTP/1.1" 201 0
2026-03-28 22:06:06 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b4d4397f-82ae-5f65-add6-f530f9d672f0
2026-03-28 22:06:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4d4397f-82ae-5f65-add6-f530f9d672f0, skipping ID generation
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item b4d4397f-82ae-5f65-add6-f530f9d672f0
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHY06VPF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HY06VPF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554848f10>
2026-03-28 22:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec532b91-2d62-5ebd-830b-087067e8ed90/ec532b91-2d62-5ebd-830b-087067e8ed90_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMW21AXB%252F698976203%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976203/600 saved to cache
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ec532b91-2d62-5ebd-830b-087067e8ed90
2026-03-28 22:06:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554407f10>
2026-03-28 22:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a373065-9147-5214-8a56-d55636e4875e/7a373065-9147-5214-8a56-d55636e4875e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK65LPO%252F699253466%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253466/600 saved to cache
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7a373065-9147-5214-8a56-d55636e4875e
2026-03-28 22:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f96210>
2026-03-28 22:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_357d0336-8e2f-5d0b-a0f0-a805d9cf3c16/357d0336-8e2f-5d0b-a0f0-a805d9cf3c16_expert_report_file_34b8f270-089f-44cc-83c8-6296b9561c8d.pdf HTTP/1.1" 201 0
2026-03-28 22:06:06 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16
2026-03-28 22:06:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16, skipping ID generation
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHT70DMF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HT70DMF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994454/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994454>
2026-03-28 22:06:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208316/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208316>
2026-03-28 22:06:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146051/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146051>
2026-03-28 22:06:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208333/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208333>
2026-03-28 22:06:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208351/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208351>
2026-03-28 22:06:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158122/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158122>
2026-03-28 22:06:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158138/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158138>
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993545%27 HTTP/1.1" 200 None
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993545 not downloaded yet
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023444%27 HTTP/1.1" 200 None
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023444 not downloaded yet
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970562%27 HTTP/1.1" 200 None
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970562 not downloaded yet
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146125%27 HTTP/1.1" 200 None
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146125 not downloaded yet
2026-03-28 22:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 976f1540-41c9-5853-a520-2191352412f3 with identifier: AJ10%20XBR
2026-03-28 22:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 976f1540-41c9-5853-a520-2191352412f3 with identifier: AJ10%20XBR
2026-03-28 22:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 976f1540-41c9-5853-a520-2191352412f3 with identifier: AJ10%20XBR to the API
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010809/600>
{'auction_title': '',
'c_o_2_emission_value': 145,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976f1540-41c9-5853-a520-2191352412f3/976f1540-41c9-5853-a520-2191352412f3_expert_report_file_4d15f4e4-e58b-4bc2-b660-fa8acac376e3.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AJ10%20XBR-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.9L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '976f1540-41c9-5853-a520-2191352412f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AJ10 XBR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AJ10%20XBR&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'RENAULT',
'model': 'SCENIC',
'odometer': 118484,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976f1540-41c9-5853-a520-2191352412f3/976f1540-41c9-5853-a520-2191352412f3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44433,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010723/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976f1540-41c9-5853-a520-2191352412f3/976f1540-41c9-5853-a520-2191352412f3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43784,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010742/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976f1540-41c9-5853-a520-2191352412f3/976f1540-41c9-5853-a520-2191352412f3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41196,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010762/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976f1540-41c9-5853-a520-2191352412f3/976f1540-41c9-5853-a520-2191352412f3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39995,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010783/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976f1540-41c9-5853-a520-2191352412f3/976f1540-41c9-5853-a520-2191352412f3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39153,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010809/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976f1540-41c9-5853-a520-2191352412f3/976f1540-41c9-5853-a520-2191352412f3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39858,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010836/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976f1540-41c9-5853-a520-2191352412f3/976f1540-41c9-5853-a520-2191352412f3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69091,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010873/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976f1540-41c9-5853-a520-2191352412f3/976f1540-41c9-5853-a520-2191352412f3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64528,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010907/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976f1540-41c9-5853-a520-2191352412f3/976f1540-41c9-5853-a520-2191352412f3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100593,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010930/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976f1540-41c9-5853-a520-2191352412f3/976f1540-41c9-5853-a520-2191352412f3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78631,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10XBR/699010958/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'RENAULT SCENIC 1.9 DCI 130 PRIVILEGE TOM TOM MPV',
'transmission': 'manual',
'trim': 'DCI 130 PRIVILEGE TOM TOM',
'vin': 'VF1JZ0N0643392220',
'year': 2010}
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ10%2520XBR%27 HTTP/1.1" 200 None
2026-03-28 22:06:06 [bca.uk] INFO: Saving data for AJ10%20XBR: {'created_time': 1774735566.680968, 'last_price_update_time': 1774735566.680979, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AJ10%2520XBR') HTTP/1.1" 204 0
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975195%27 HTTP/1.1" 200 None
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975195 not downloaded yet
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970543%27 HTTP/1.1" 200 None
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970543 not downloaded yet
2026-03-28 22:06:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994514/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994514>
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993554%27 HTTP/1.1" 200 None
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993554 not downloaded yet
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023457%27 HTTP/1.1" 200 None
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023457 not downloaded yet
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970575%27 HTTP/1.1" 200 None
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970575 not downloaded yet
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146132%27 HTTP/1.1" 200 None
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146132 not downloaded yet
2026-03-28 22:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55729b450>
2026-03-28 22:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34529131-3f38-544f-80da-657c8bd2604d/34529131-3f38-544f-80da-657c8bd2604d_expert_report_file_5e0f0f78-92ec-4337-a797-745e78463693.pdf HTTP/1.1" 201 0
2026-03-28 22:06:06 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 34529131-3f38-544f-80da-657c8bd2604d
2026-03-28 22:06:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34529131-3f38-544f-80da-657c8bd2604d, skipping ID generation
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 34529131-3f38-544f-80da-657c8bd2604d
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKN18OGS-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KN18OGS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975196%27 HTTP/1.1" 200 None
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975196 not downloaded yet
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970554%27 HTTP/1.1" 200 None
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970554 not downloaded yet
2026-03-28 22:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208292/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE19UGD/42807906?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=PVNSmCdj4lqVo33gqsXVrCQnpHCUCgw%2FIRQ0Qxai5qw%3D)
2026-03-28 22:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208302/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE19UGD/42807906?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=PVNSmCdj4lqVo33gqsXVrCQnpHCUCgw%2FIRQ0Qxai5qw%3D)
2026-03-28 22:06:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993518/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OV60BVR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023405/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LV18FLW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994428/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ14PYU/42810573?sv=2020-08-04&st=2026-03-28T22%3A05%3A56Z&se=2026-03-28T22%3A30%3A56Z&sr=b&sp=r&sig=tkEo323ohrihOZXVnqm5FOYri5pOdaZiZLNiiyp2Vog%3D)
2026-03-28 22:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208311/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE19UGD/42807906?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=PVNSmCdj4lqVo33gqsXVrCQnpHCUCgw%2FIRQ0Qxai5qw%3D)
2026-03-28 22:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994415/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ14PYU/42810573?sv=2020-08-04&st=2026-03-28T22%3A05%3A56Z&se=2026-03-28T22%3A30%3A56Z&sr=b&sp=r&sig=tkEo323ohrihOZXVnqm5FOYri5pOdaZiZLNiiyp2Vog%3D)
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993563%27 HTTP/1.1" 200 None
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993563 not downloaded yet
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023472%27 HTTP/1.1" 200 None
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023472 not downloaded yet
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970592%27 HTTP/1.1" 200 None
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970592 not downloaded yet
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146139%27 HTTP/1.1" 200 None
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146139 not downloaded yet
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144755%27 HTTP/1.1" 200 None
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144755 not downloaded yet
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975198%27 HTTP/1.1" 200 None
2026-03-28 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975198 not downloaded yet
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970568%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970568 not downloaded yet
2026-03-28 22:06:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146112/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RA18XPV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993572%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993572 not downloaded yet
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023491%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023491 not downloaded yet
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970608%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970608 not downloaded yet
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146147%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146147 not downloaded yet
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144766%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144766 not downloaded yet
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975199%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975199 not downloaded yet
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970585%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970585 not downloaded yet
2026-03-28 22:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208316/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE19UGD/42807906?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=PVNSmCdj4lqVo33gqsXVrCQnpHCUCgw%2FIRQ0Qxai5qw%3D)
2026-03-28 22:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994454/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ14PYU/42810573?sv=2020-08-04&st=2026-03-28T22%3A05%3A56Z&se=2026-03-28T22%3A30%3A56Z&sr=b&sp=r&sig=tkEo323ohrihOZXVnqm5FOYri5pOdaZiZLNiiyp2Vog%3D)
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993581%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993581 not downloaded yet
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023514%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023514 not downloaded yet
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970621%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970621 not downloaded yet
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146154%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146154 not downloaded yet
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144768%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144768 not downloaded yet
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54738cb50>
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2785a6e-33af-5eba-b84f-311143aa78be/e2785a6e-33af-5eba-b84f-311143aa78be_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE19UGD%252F699208292%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208292/600 saved to cache
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2785a6e-33af-5eba-b84f-311143aa78be
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547600550>
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2785a6e-33af-5eba-b84f-311143aa78be/e2785a6e-33af-5eba-b84f-311143aa78be_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE19UGD%252F699208302%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208302/600 saved to cache
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2785a6e-33af-5eba-b84f-311143aa78be
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55729a610>
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2faac3c-f66f-5c6b-825e-332b835cca02/c2faac3c-f66f-5c6b-825e-332b835cca02_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ14PYU%252F698994428%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994428/600 saved to cache
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c2faac3c-f66f-5c6b-825e-332b835cca02
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547105ad0>
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2785a6e-33af-5eba-b84f-311143aa78be/e2785a6e-33af-5eba-b84f-311143aa78be_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE19UGD%252F699208311%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208311/600 saved to cache
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2785a6e-33af-5eba-b84f-311143aa78be
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554345b90>
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2faac3c-f66f-5c6b-825e-332b835cca02/c2faac3c-f66f-5c6b-825e-332b835cca02_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ14PYU%252F698994415%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994415/600 saved to cache
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c2faac3c-f66f-5c6b-825e-332b835cca02
2026-03-28 22:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158122/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK73EWD/42804333?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=5M4SgAmptrCJ8i0ARGkLnrB6V3wMXNdNGY6VCvEo%2F%2FI%3D)
2026-03-28 22:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208333/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE19UGD/42807906?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=PVNSmCdj4lqVo33gqsXVrCQnpHCUCgw%2FIRQ0Qxai5qw%3D)
2026-03-28 22:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146051/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV67VJU/42810955?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=pcdQ%2FQprBD1I89Z22aQT%2Fy%2FecVGPDfQATBl8G%2BxCxUw%3D)
2026-03-28 22:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158138/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK73EWD/42804333?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=5M4SgAmptrCJ8i0ARGkLnrB6V3wMXNdNGY6VCvEo%2F%2FI%3D)
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975200%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975200 not downloaded yet
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970601%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970601 not downloaded yet
2026-03-28 22:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208351/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE19UGD/42807906?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=PVNSmCdj4lqVo33gqsXVrCQnpHCUCgw%2FIRQ0Qxai5qw%3D)
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993592%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993592 not downloaded yet
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023540%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023540 not downloaded yet
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970636%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970636 not downloaded yet
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146161%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146161 not downloaded yet
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144775%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144775 not downloaded yet
2026-03-28 22:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994514/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ14PYU/42810573?sv=2020-08-04&st=2026-03-28T22%3A05%3A56Z&se=2026-03-28T22%3A30%3A56Z&sr=b&sp=r&sig=tkEo323ohrihOZXVnqm5FOYri5pOdaZiZLNiiyp2Vog%3D)
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975202%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975202 not downloaded yet
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970619%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970619 not downloaded yet
2026-03-28 22:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023405/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV18FLW/42810997?sv=2020-08-04&st=2026-03-28T22%3A06%3A00Z&se=2026-03-28T22%3A31%3A00Z&sr=b&sp=r&sig=SGW%2Bfk4wNUPe96eq0MmJHlKteRFOQ3%2BV8WGM5O5WczE%3D)
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023560%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023560 not downloaded yet
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970650%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970650 not downloaded yet
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146170%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146170 not downloaded yet
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144781%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144781 not downloaded yet
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975205%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975205 not downloaded yet
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970631%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970631 not downloaded yet
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554293510>
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2785a6e-33af-5eba-b84f-311143aa78be/e2785a6e-33af-5eba-b84f-311143aa78be_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE19UGD%252F699208316%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208316/600 saved to cache
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e2785a6e-33af-5eba-b84f-311143aa78be
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554824910>
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2faac3c-f66f-5c6b-825e-332b835cca02/c2faac3c-f66f-5c6b-825e-332b835cca02_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ14PYU%252F698994454%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994454/600 saved to cache
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c2faac3c-f66f-5c6b-825e-332b835cca02
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554286e50>
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e39c955-50ed-58e2-b150-dec2ff78b99f/8e39c955-50ed-58e2-b150-dec2ff78b99f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK73EWD%252F699158122%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158122/600 saved to cache
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e39c955-50ed-58e2-b150-dec2ff78b99f
2026-03-28 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554316090>
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2785a6e-33af-5eba-b84f-311143aa78be/e2785a6e-33af-5eba-b84f-311143aa78be_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE19UGD%252F699208333%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208333/600 saved to cache
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e2785a6e-33af-5eba-b84f-311143aa78be
2026-03-28 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547762a10>
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68511f88-68fc-5ac1-befe-453b6775c3b3/68511f88-68fc-5ac1-befe-453b6775c3b3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV67VJU%252F699146051%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146051/600 saved to cache
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 68511f88-68fc-5ac1-befe-453b6775c3b3
2026-03-28 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55435fd10>
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e39c955-50ed-58e2-b150-dec2ff78b99f/8e39c955-50ed-58e2-b150-dec2ff78b99f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK73EWD%252F699158138%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158138/600 saved to cache
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e39c955-50ed-58e2-b150-dec2ff78b99f
2026-03-28 22:06:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023457/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023457>
2026-03-28 22:06:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146132/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146132>
2026-03-28 22:06:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970575/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970575>
2026-03-28 22:06:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993554/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993554>
2026-03-28 22:06:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144750/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KN18OGS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146112/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA18XPV/42810838?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=6qf9M7QUJwwcCEWDDFA2bz6RBkIbS81BmjR8La%2BNZQI%3D)
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970668%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970668 not downloaded yet
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146182%27 HTTP/1.1" 200 None
2026-03-28 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146182 not downloaded yet
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144790%27 HTTP/1.1" 200 None
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144790 not downloaded yet
2026-03-28 22:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993518/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV60BVR/42810790?sv=2020-08-04&st=2026-03-28T22%3A06%3A00Z&se=2026-03-28T22%3A31%3A00Z&sr=b&sp=r&sig=GMzmKOCsLt6CgM899XlsNZHP3Kky1BS5HKw%2FJfd%2B9QU%3D)
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975217%27 HTTP/1.1" 200 None
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975217 not downloaded yet
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970654%27 HTTP/1.1" 200 None
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970654 not downloaded yet
2026-03-28 22:06:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547763710>
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2785a6e-33af-5eba-b84f-311143aa78be/e2785a6e-33af-5eba-b84f-311143aa78be_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE19UGD%252F699208351%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208351/600 saved to cache
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e2785a6e-33af-5eba-b84f-311143aa78be
2026-03-28 22:06:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548c45d0>
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2faac3c-f66f-5c6b-825e-332b835cca02/c2faac3c-f66f-5c6b-825e-332b835cca02_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ14PYU%252F698994514%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994514/600 saved to cache
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c2faac3c-f66f-5c6b-825e-332b835cca02
2026-03-28 22:06:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144766/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144766>
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144802%27 HTTP/1.1" 200 None
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144802 not downloaded yet
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970669%27 HTTP/1.1" 200 None
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970669 not downloaded yet
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543822d0>
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0f6191-0680-5ec4-9f99-776551675a24/3b0f6191-0680-5ec4-9f99-776551675a24_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV18FLW%252F699023405%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023405/600 saved to cache
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b0f6191-0680-5ec4-9f99-776551675a24
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144812%27 HTTP/1.1" 200 None
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144812 not downloaded yet
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473cd2d0>
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc46c333-9727-5d8d-ab5c-b3d4cb03ad24/cc46c333-9727-5d8d-ab5c-b3d4cb03ad24_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA18XPV%252F699146112%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146112/600 saved to cache
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc46c333-9727-5d8d-ab5c-b3d4cb03ad24
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547763150>
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4d23d94-cc98-52e5-b2e4-244cf1ddd01e/f4d23d94-cc98-52e5-b2e4-244cf1ddd01e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV60BVR%252F698993518%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993518/600 saved to cache
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f4d23d94-cc98-52e5-b2e4-244cf1ddd01e
2026-03-28 22:06:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023514/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023514>
2026-03-28 22:06:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146147/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146147>
2026-03-28 22:06:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146154/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146154>
2026-03-28 22:06:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144768/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144768>
2026-03-28 22:06:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993581/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993581>
2026-03-28 22:06:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970621/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970621>
2026-03-28 22:06:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970601/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970601>
2026-03-28 22:06:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970619/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970619>
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144820%27 HTTP/1.1" 200 None
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144820 not downloaded yet
2026-03-28 22:06:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975205/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975205>
2026-03-28 22:06:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970631/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970631>
2026-03-28 22:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023457/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV18FLW/42810997?sv=2020-08-04&st=2026-03-28T22%3A06%3A00Z&se=2026-03-28T22%3A31%3A00Z&sr=b&sp=r&sig=SGW%2Bfk4wNUPe96eq0MmJHlKteRFOQ3%2BV8WGM5O5WczE%3D)
2026-03-28 22:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970575/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM20TSZ/42810665?sv=2020-08-04&st=2026-03-28T22%3A06%3A02Z&se=2026-03-28T22%3A31%3A02Z&sr=b&sp=r&sig=ftaAijuPkq7ydQllJHk65YeNmNsW07AOMLqm%2B%2BdmuxI%3D)
2026-03-28 22:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144750/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN18OGS/42810862?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=KQgq7w1lB0i8NJ%2FYl2aQsZ9dYLPzJqvNwFp8%2FU7W%2FrI%3D)
2026-03-28 22:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144766/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN18OGS/42810862?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=KQgq7w1lB0i8NJ%2FYl2aQsZ9dYLPzJqvNwFp8%2FU7W%2FrI%3D)
2026-03-28 22:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993554/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV60BVR/42810790?sv=2020-08-04&st=2026-03-28T22%3A06%3A00Z&se=2026-03-28T22%3A31%3A00Z&sr=b&sp=r&sig=GMzmKOCsLt6CgM899XlsNZHP3Kky1BS5HKw%2FJfd%2B9QU%3D)
2026-03-28 22:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144768/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN18OGS/42810862?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=KQgq7w1lB0i8NJ%2FYl2aQsZ9dYLPzJqvNwFp8%2FU7W%2FrI%3D)
2026-03-28 22:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970621/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM20TSZ/42810665?sv=2020-08-04&st=2026-03-28T22%3A06%3A02Z&se=2026-03-28T22%3A31%3A02Z&sr=b&sp=r&sig=ftaAijuPkq7ydQllJHk65YeNmNsW07AOMLqm%2B%2BdmuxI%3D)
2026-03-28 22:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993581/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV60BVR/42810790?sv=2020-08-04&st=2026-03-28T22%3A06%3A00Z&se=2026-03-28T22%3A31%3A00Z&sr=b&sp=r&sig=GMzmKOCsLt6CgM899XlsNZHP3Kky1BS5HKw%2FJfd%2B9QU%3D)
2026-03-28 22:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146132/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA18XPV/42810838?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=6qf9M7QUJwwcCEWDDFA2bz6RBkIbS81BmjR8La%2BNZQI%3D)
2026-03-28 22:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023514/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV18FLW/42810997?sv=2020-08-04&st=2026-03-28T22%3A06%3A00Z&se=2026-03-28T22%3A31%3A00Z&sr=b&sp=r&sig=SGW%2Bfk4wNUPe96eq0MmJHlKteRFOQ3%2BV8WGM5O5WczE%3D)
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554954dd0>
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0f6191-0680-5ec4-9f99-776551675a24/3b0f6191-0680-5ec4-9f99-776551675a24_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV18FLW%252F699023457%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023457/600 saved to cache
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b0f6191-0680-5ec4-9f99-776551675a24
2026-03-28 22:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970601/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT70DMF/42810730?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=Cj70IayWn1fkSTExGRHSsxoWyNODHjl4jZATJrTuBHI%3D)
2026-03-28 22:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146147/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA18XPV/42810838?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=6qf9M7QUJwwcCEWDDFA2bz6RBkIbS81BmjR8La%2BNZQI%3D)
2026-03-28 22:06:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144820/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144820>
2026-03-28 22:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146154/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA18XPV/42810838?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=6qf9M7QUJwwcCEWDDFA2bz6RBkIbS81BmjR8La%2BNZQI%3D)
2026-03-28 22:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970631/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT70DMF/42810730?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=Cj70IayWn1fkSTExGRHSsxoWyNODHjl4jZATJrTuBHI%3D)
2026-03-28 22:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970619/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT70DMF/42810730?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=Cj70IayWn1fkSTExGRHSsxoWyNODHjl4jZATJrTuBHI%3D)
2026-03-28 22:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975205/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY06VPF/42810794?sv=2020-08-04&st=2026-03-28T22%3A06%3A01Z&se=2026-03-28T22%3A31%3A01Z&sr=b&sp=r&sig=SQx%2F2I7rxj%2Buge5rNrhJlhbH0k5DNdXPQnRujp2mymc%3D)
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543a4c10>
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c73d75d1-bd0a-5743-8d24-444e4cdb7552/c73d75d1-bd0a-5743-8d24-444e4cdb7552_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM20TSZ%252F698970575%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970575/600 saved to cache
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c73d75d1-bd0a-5743-8d24-444e4cdb7552
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547343dd0>
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34529131-3f38-544f-80da-657c8bd2604d/34529131-3f38-544f-80da-657c8bd2604d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN18OGS%252F699144750%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144750/600 saved to cache
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 34529131-3f38-544f-80da-657c8bd2604d
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549f0290>
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34529131-3f38-544f-80da-657c8bd2604d/34529131-3f38-544f-80da-657c8bd2604d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN18OGS%252F699144766%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144766/600 saved to cache
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 34529131-3f38-544f-80da-657c8bd2604d
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547316550>
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4d23d94-cc98-52e5-b2e4-244cf1ddd01e/f4d23d94-cc98-52e5-b2e4-244cf1ddd01e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV60BVR%252F698993554%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993554/600 saved to cache
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f4d23d94-cc98-52e5-b2e4-244cf1ddd01e
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547107f90>
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34529131-3f38-544f-80da-657c8bd2604d/34529131-3f38-544f-80da-657c8bd2604d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN18OGS%252F699144768%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144768/600 saved to cache
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 34529131-3f38-544f-80da-657c8bd2604d
2026-03-28 22:06:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554892890>
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c73d75d1-bd0a-5743-8d24-444e4cdb7552/c73d75d1-bd0a-5743-8d24-444e4cdb7552_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM20TSZ%252F698970621%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970621/600 saved to cache
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c73d75d1-bd0a-5743-8d24-444e4cdb7552
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54777f610>
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4d23d94-cc98-52e5-b2e4-244cf1ddd01e/f4d23d94-cc98-52e5-b2e4-244cf1ddd01e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV60BVR%252F698993581%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993581/600 saved to cache
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f4d23d94-cc98-52e5-b2e4-244cf1ddd01e
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547315cd0>
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc46c333-9727-5d8d-ab5c-b3d4cb03ad24/cc46c333-9727-5d8d-ab5c-b3d4cb03ad24_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA18XPV%252F699146132%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146132/600 saved to cache
2026-03-28 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cc46c333-9727-5d8d-ab5c-b3d4cb03ad24
2026-03-28 22:06:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55456ee10>
2026-03-28 22:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0f6191-0680-5ec4-9f99-776551675a24/3b0f6191-0680-5ec4-9f99-776551675a24_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV18FLW%252F699023514%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023514/600 saved to cache
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b0f6191-0680-5ec4-9f99-776551675a24
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144812/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144812>
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970669/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970669>
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970654/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970654>
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144802/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144802>
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547137d90>
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_357d0336-8e2f-5d0b-a0f0-a805d9cf3c16/357d0336-8e2f-5d0b-a0f0-a805d9cf3c16_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT70DMF%252F698970601%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970601/600 saved to cache
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554ae3790>
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc46c333-9727-5d8d-ab5c-b3d4cb03ad24/cc46c333-9727-5d8d-ab5c-b3d4cb03ad24_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA18XPV%252F699146147%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146147/600 saved to cache
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cc46c333-9727-5d8d-ab5c-b3d4cb03ad24
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473ded90>
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc46c333-9727-5d8d-ab5c-b3d4cb03ad24/cc46c333-9727-5d8d-ab5c-b3d4cb03ad24_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA18XPV%252F699146154%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146154/600 saved to cache
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cc46c333-9727-5d8d-ab5c-b3d4cb03ad24
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fa8f10>
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_357d0336-8e2f-5d0b-a0f0-a805d9cf3c16/357d0336-8e2f-5d0b-a0f0-a805d9cf3c16_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT70DMF%252F698970631%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970631/600 saved to cache
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542303d0>
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_357d0336-8e2f-5d0b-a0f0-a805d9cf3c16/357d0336-8e2f-5d0b-a0f0-a805d9cf3c16_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT70DMF%252F698970619%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970619/600 saved to cache
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fc6c50>
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4d4397f-82ae-5f65-add6-f530f9d672f0/b4d4397f-82ae-5f65-add6-f530f9d672f0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY06VPF%252F698975205%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975205/600 saved to cache
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b4d4397f-82ae-5f65-add6-f530f9d672f0
2026-03-28 22:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144820/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN18OGS/42810862?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=KQgq7w1lB0i8NJ%2FYl2aQsZ9dYLPzJqvNwFp8%2FU7W%2FrI%3D)
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146182/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146182>
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970668/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970668>
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144790/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144790>
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146170/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146170>
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144781/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144781>
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975217/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975217>
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970650/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970650>
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144775/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144775>
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023560/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023560>
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146161/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146161>
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975202/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975202>
2026-03-28 22:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144812/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN18OGS/42810862?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=KQgq7w1lB0i8NJ%2FYl2aQsZ9dYLPzJqvNwFp8%2FU7W%2FrI%3D)
2026-03-28 22:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970654/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT70DMF/42810730?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=Cj70IayWn1fkSTExGRHSsxoWyNODHjl4jZATJrTuBHI%3D)
2026-03-28 22:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144802/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN18OGS/42810862?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=KQgq7w1lB0i8NJ%2FYl2aQsZ9dYLPzJqvNwFp8%2FU7W%2FrI%3D)
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55496b510>
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34529131-3f38-544f-80da-657c8bd2604d/34529131-3f38-544f-80da-657c8bd2604d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN18OGS%252F699144820%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144820/600 saved to cache
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 34529131-3f38-544f-80da-657c8bd2604d
2026-03-28 22:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970669/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT70DMF/42810730?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=Cj70IayWn1fkSTExGRHSsxoWyNODHjl4jZATJrTuBHI%3D)
2026-03-28 22:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144781/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN18OGS/42810862?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=KQgq7w1lB0i8NJ%2FYl2aQsZ9dYLPzJqvNwFp8%2FU7W%2FrI%3D)
2026-03-28 22:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970650/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM20TSZ/42810665?sv=2020-08-04&st=2026-03-28T22%3A06%3A02Z&se=2026-03-28T22%3A31%3A02Z&sr=b&sp=r&sig=ftaAijuPkq7ydQllJHk65YeNmNsW07AOMLqm%2B%2BdmuxI%3D)
2026-03-28 22:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146170/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA18XPV/42810838?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=6qf9M7QUJwwcCEWDDFA2bz6RBkIbS81BmjR8La%2BNZQI%3D)
2026-03-28 22:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144790/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN18OGS/42810862?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=KQgq7w1lB0i8NJ%2FYl2aQsZ9dYLPzJqvNwFp8%2FU7W%2FrI%3D)
2026-03-28 22:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975217/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY06VPF/42810794?sv=2020-08-04&st=2026-03-28T22%3A06%3A01Z&se=2026-03-28T22%3A31%3A01Z&sr=b&sp=r&sig=SQx%2F2I7rxj%2Buge5rNrhJlhbH0k5DNdXPQnRujp2mymc%3D)
2026-03-28 22:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146182/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA18XPV/42810838?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=6qf9M7QUJwwcCEWDDFA2bz6RBkIbS81BmjR8La%2BNZQI%3D)
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543e0ad0>
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34529131-3f38-544f-80da-657c8bd2604d/34529131-3f38-544f-80da-657c8bd2604d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN18OGS%252F699144812%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144812/600 saved to cache
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 34529131-3f38-544f-80da-657c8bd2604d
2026-03-28 22:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144775/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN18OGS/42810862?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=KQgq7w1lB0i8NJ%2FYl2aQsZ9dYLPzJqvNwFp8%2FU7W%2FrI%3D)
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970636/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970636>
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547c6d10>
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_357d0336-8e2f-5d0b-a0f0-a805d9cf3c16/357d0336-8e2f-5d0b-a0f0-a805d9cf3c16_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT70DMF%252F698970654%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970654/600 saved to cache
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023540/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023540>
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993592/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993592>
2026-03-28 22:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970668/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM20TSZ/42810665?sv=2020-08-04&st=2026-03-28T22%3A06%3A02Z&se=2026-03-28T22%3A31%3A02Z&sr=b&sp=r&sig=ftaAijuPkq7ydQllJHk65YeNmNsW07AOMLqm%2B%2BdmuxI%3D)
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474453d0>
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34529131-3f38-544f-80da-657c8bd2604d/34529131-3f38-544f-80da-657c8bd2604d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN18OGS%252F699144802%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144802/600 saved to cache
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 34529131-3f38-544f-80da-657c8bd2604d
2026-03-28 22:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146161/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA18XPV/42810838?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=6qf9M7QUJwwcCEWDDFA2bz6RBkIbS81BmjR8La%2BNZQI%3D)
2026-03-28 22:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023560/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV18FLW/42810997?sv=2020-08-04&st=2026-03-28T22%3A06%3A00Z&se=2026-03-28T22%3A31%3A00Z&sr=b&sp=r&sig=SGW%2Bfk4wNUPe96eq0MmJHlKteRFOQ3%2BV8WGM5O5WczE%3D)
2026-03-28 22:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975202/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY06VPF/42810794?sv=2020-08-04&st=2026-03-28T22%3A06%3A01Z&se=2026-03-28T22%3A31%3A01Z&sr=b&sp=r&sig=SQx%2F2I7rxj%2Buge5rNrhJlhbH0k5DNdXPQnRujp2mymc%3D)
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547151650>
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_357d0336-8e2f-5d0b-a0f0-a805d9cf3c16/357d0336-8e2f-5d0b-a0f0-a805d9cf3c16_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT70DMF%252F698970669%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970669/600 saved to cache
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547788b90>
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34529131-3f38-544f-80da-657c8bd2604d/34529131-3f38-544f-80da-657c8bd2604d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN18OGS%252F699144781%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144781/600 saved to cache
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 34529131-3f38-544f-80da-657c8bd2604d
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471b2ad0>
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c73d75d1-bd0a-5743-8d24-444e4cdb7552/c73d75d1-bd0a-5743-8d24-444e4cdb7552_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM20TSZ%252F698970650%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970650/600 saved to cache
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c73d75d1-bd0a-5743-8d24-444e4cdb7552
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547445350>
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc46c333-9727-5d8d-ab5c-b3d4cb03ad24/cc46c333-9727-5d8d-ab5c-b3d4cb03ad24_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA18XPV%252F699146170%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146170/600 saved to cache
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cc46c333-9727-5d8d-ab5c-b3d4cb03ad24
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471b2190>
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34529131-3f38-544f-80da-657c8bd2604d/34529131-3f38-544f-80da-657c8bd2604d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN18OGS%252F699144790%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144790/600 saved to cache
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 34529131-3f38-544f-80da-657c8bd2604d
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471364d0>
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4d4397f-82ae-5f65-add6-f530f9d672f0/b4d4397f-82ae-5f65-add6-f530f9d672f0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY06VPF%252F698975217%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975217/600 saved to cache
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b4d4397f-82ae-5f65-add6-f530f9d672f0
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55496a250>
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc46c333-9727-5d8d-ab5c-b3d4cb03ad24/cc46c333-9727-5d8d-ab5c-b3d4cb03ad24_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA18XPV%252F699146182%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146182/600 saved to cache
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cc46c333-9727-5d8d-ab5c-b3d4cb03ad24
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975200/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975200>
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970585/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970585>
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023491/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023491>
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975199/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975199>
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993572/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993572>
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970568/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970568>
2026-03-28 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970608/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970608>
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547265f90>
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34529131-3f38-544f-80da-657c8bd2604d/34529131-3f38-544f-80da-657c8bd2604d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN18OGS%252F699144775%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144775/600 saved to cache
2026-03-28 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 34529131-3f38-544f-80da-657c8bd2604d
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55435c1d0>
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c73d75d1-bd0a-5743-8d24-444e4cdb7552/c73d75d1-bd0a-5743-8d24-444e4cdb7552_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM20TSZ%252F698970668%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970668/600 saved to cache
2026-03-28 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c73d75d1-bd0a-5743-8d24-444e4cdb7552
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554274a10>
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc46c333-9727-5d8d-ab5c-b3d4cb03ad24/cc46c333-9727-5d8d-ab5c-b3d4cb03ad24_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA18XPV%252F699146161%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146161/600 saved to cache
2026-03-28 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cc46c333-9727-5d8d-ab5c-b3d4cb03ad24
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54724af50>
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0f6191-0680-5ec4-9f99-776551675a24/3b0f6191-0680-5ec4-9f99-776551675a24_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV18FLW%252F699023560%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023560/600 saved to cache
2026-03-28 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b0f6191-0680-5ec4-9f99-776551675a24
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554275010>
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4d4397f-82ae-5f65-add6-f530f9d672f0/b4d4397f-82ae-5f65-add6-f530f9d672f0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY06VPF%252F698975202%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975202/600 saved to cache
2026-03-28 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b4d4397f-82ae-5f65-add6-f530f9d672f0
2026-03-28 22:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975198/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975198>
2026-03-28 22:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146139/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146139>
2026-03-28 22:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144755/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144755>
2026-03-28 22:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970592/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970592>
2026-03-28 22:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023472/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023472>
2026-03-28 22:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023540/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV18FLW/42810997?sv=2020-08-04&st=2026-03-28T22%3A06%3A00Z&se=2026-03-28T22%3A31%3A00Z&sr=b&sp=r&sig=SGW%2Bfk4wNUPe96eq0MmJHlKteRFOQ3%2BV8WGM5O5WczE%3D)
2026-03-28 22:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970636/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM20TSZ/42810665?sv=2020-08-04&st=2026-03-28T22%3A06%3A02Z&se=2026-03-28T22%3A31%3A02Z&sr=b&sp=r&sig=ftaAijuPkq7ydQllJHk65YeNmNsW07AOMLqm%2B%2BdmuxI%3D)
2026-03-28 22:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993592/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV60BVR/42810790?sv=2020-08-04&st=2026-03-28T22%3A06%3A00Z&se=2026-03-28T22%3A31%3A00Z&sr=b&sp=r&sig=GMzmKOCsLt6CgM899XlsNZHP3Kky1BS5HKw%2FJfd%2B9QU%3D)
2026-03-28 22:06:10 [scrapy.extensions.logstats] INFO: Crawled 200 pages (at 39 pages/min), scraped 276 items (at 47 items/min)
2026-03-28 22:06:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 191MiB
2026-03-28 22:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993563/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993563>
2026-03-28 22:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970608/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM20TSZ/42810665?sv=2020-08-04&st=2026-03-28T22%3A06%3A02Z&se=2026-03-28T22%3A31%3A02Z&sr=b&sp=r&sig=ftaAijuPkq7ydQllJHk65YeNmNsW07AOMLqm%2B%2BdmuxI%3D)
2026-03-28 22:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023491/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV18FLW/42810997?sv=2020-08-04&st=2026-03-28T22%3A06%3A00Z&se=2026-03-28T22%3A31%3A00Z&sr=b&sp=r&sig=SGW%2Bfk4wNUPe96eq0MmJHlKteRFOQ3%2BV8WGM5O5WczE%3D)
2026-03-28 22:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970568/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT70DMF/42810730?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=Cj70IayWn1fkSTExGRHSsxoWyNODHjl4jZATJrTuBHI%3D)
2026-03-28 22:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993572/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV60BVR/42810790?sv=2020-08-04&st=2026-03-28T22%3A06%3A00Z&se=2026-03-28T22%3A31%3A00Z&sr=b&sp=r&sig=GMzmKOCsLt6CgM899XlsNZHP3Kky1BS5HKw%2FJfd%2B9QU%3D)
2026-03-28 22:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970585/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT70DMF/42810730?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=Cj70IayWn1fkSTExGRHSsxoWyNODHjl4jZATJrTuBHI%3D)
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f9a8d0>
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0f6191-0680-5ec4-9f99-776551675a24/3b0f6191-0680-5ec4-9f99-776551675a24_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV18FLW%252F699023540%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023540/600 saved to cache
2026-03-28 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b0f6191-0680-5ec4-9f99-776551675a24
2026-03-28 22:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144755/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN18OGS/42810862?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=KQgq7w1lB0i8NJ%2FYl2aQsZ9dYLPzJqvNwFp8%2FU7W%2FrI%3D)
2026-03-28 22:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975200/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY06VPF/42810794?sv=2020-08-04&st=2026-03-28T22%3A06%3A01Z&se=2026-03-28T22%3A31%3A01Z&sr=b&sp=r&sig=SQx%2F2I7rxj%2Buge5rNrhJlhbH0k5DNdXPQnRujp2mymc%3D)
2026-03-28 22:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970592/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM20TSZ/42810665?sv=2020-08-04&st=2026-03-28T22%3A06%3A02Z&se=2026-03-28T22%3A31%3A02Z&sr=b&sp=r&sig=ftaAijuPkq7ydQllJHk65YeNmNsW07AOMLqm%2B%2BdmuxI%3D)
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547255bd0>
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c73d75d1-bd0a-5743-8d24-444e4cdb7552/c73d75d1-bd0a-5743-8d24-444e4cdb7552_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM20TSZ%252F698970636%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970636/600 saved to cache
2026-03-28 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c73d75d1-bd0a-5743-8d24-444e4cdb7552
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554382f50>
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4d23d94-cc98-52e5-b2e4-244cf1ddd01e/f4d23d94-cc98-52e5-b2e4-244cf1ddd01e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV60BVR%252F698993592%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993592/600 saved to cache
2026-03-28 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f4d23d94-cc98-52e5-b2e4-244cf1ddd01e
2026-03-28 22:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975198/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY06VPF/42810794?sv=2020-08-04&st=2026-03-28T22%3A06%3A01Z&se=2026-03-28T22%3A31%3A01Z&sr=b&sp=r&sig=SQx%2F2I7rxj%2Buge5rNrhJlhbH0k5DNdXPQnRujp2mymc%3D)
2026-03-28 22:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975199/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY06VPF/42810794?sv=2020-08-04&st=2026-03-28T22%3A06%3A01Z&se=2026-03-28T22%3A31%3A01Z&sr=b&sp=r&sig=SQx%2F2I7rxj%2Buge5rNrhJlhbH0k5DNdXPQnRujp2mymc%3D)
2026-03-28 22:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970554/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970554>
2026-03-28 22:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146139/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA18XPV/42810838?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=6qf9M7QUJwwcCEWDDFA2bz6RBkIbS81BmjR8La%2BNZQI%3D)
2026-03-28 22:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023472/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV18FLW/42810997?sv=2020-08-04&st=2026-03-28T22%3A06%3A00Z&se=2026-03-28T22%3A31%3A00Z&sr=b&sp=r&sig=SGW%2Bfk4wNUPe96eq0MmJHlKteRFOQ3%2BV8WGM5O5WczE%3D)
2026-03-28 22:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970543/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970543>
2026-03-28 22:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975196/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975196>
2026-03-28 22:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975195/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975195>
2026-03-28 22:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993545/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993545>
2026-03-28 22:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146125/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146125>
2026-03-28 22:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970562/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970562>
2026-03-28 22:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023444/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023444>
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547620ad0>
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c73d75d1-bd0a-5743-8d24-444e4cdb7552/c73d75d1-bd0a-5743-8d24-444e4cdb7552_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM20TSZ%252F698970608%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970608/600 saved to cache
2026-03-28 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c73d75d1-bd0a-5743-8d24-444e4cdb7552
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547104c10>
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0f6191-0680-5ec4-9f99-776551675a24/3b0f6191-0680-5ec4-9f99-776551675a24_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV18FLW%252F699023491%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023491/600 saved to cache
2026-03-28 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b0f6191-0680-5ec4-9f99-776551675a24
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b06210>
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_357d0336-8e2f-5d0b-a0f0-a805d9cf3c16/357d0336-8e2f-5d0b-a0f0-a805d9cf3c16_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT70DMF%252F698970568%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970568/600 saved to cache
2026-03-28 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547310c10>
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4d23d94-cc98-52e5-b2e4-244cf1ddd01e/f4d23d94-cc98-52e5-b2e4-244cf1ddd01e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV60BVR%252F698993572%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993572/600 saved to cache
2026-03-28 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f4d23d94-cc98-52e5-b2e4-244cf1ddd01e
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b05750>
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_357d0336-8e2f-5d0b-a0f0-a805d9cf3c16/357d0336-8e2f-5d0b-a0f0-a805d9cf3c16_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT70DMF%252F698970585%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970585/600 saved to cache
2026-03-28 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473cf6d0>
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34529131-3f38-544f-80da-657c8bd2604d/34529131-3f38-544f-80da-657c8bd2604d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN18OGS%252F699144755%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144755/600 saved to cache
2026-03-28 22:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 34529131-3f38-544f-80da-657c8bd2604d
2026-03-28 22:06:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34529131-3f38-544f-80da-657c8bd2604d, skipping ID generation
2026-03-28 22:06:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 34529131-3f38-544f-80da-657c8bd2604d sending to next pipeline
2026-03-28 22:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 34529131-3f38-544f-80da-657c8bd2604d, identifier: KN18%20OGS
2026-03-28 22:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fa9fd0>
2026-03-28 22:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4d4397f-82ae-5f65-add6-f530f9d672f0/b4d4397f-82ae-5f65-add6-f530f9d672f0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY06VPF%252F698975200%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975200/600 saved to cache
2026-03-28 22:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b4d4397f-82ae-5f65-add6-f530f9d672f0
2026-03-28 22:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55729c550>
2026-03-28 22:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c73d75d1-bd0a-5743-8d24-444e4cdb7552/c73d75d1-bd0a-5743-8d24-444e4cdb7552_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM20TSZ%252F698970592%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970592/600 saved to cache
2026-03-28 22:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c73d75d1-bd0a-5743-8d24-444e4cdb7552
2026-03-28 22:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 34529131-3f38-544f-80da-657c8bd2604d with identifier: KN18%20OGS
2026-03-28 22:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 34529131-3f38-544f-80da-657c8bd2604d with identifier: KN18%20OGS
2026-03-28 22:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 34529131-3f38-544f-80da-657c8bd2604d with identifier: KN18%20OGS to the API
2026-03-28 22:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144755/600>
{'auction_title': '',
'c_o_2_emission_value': 180,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34529131-3f38-544f-80da-657c8bd2604d/34529131-3f38-544f-80da-657c8bd2604d_expert_report_file_5e0f0f78-92ec-4337-a797-745e78463693.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KN18%20OGS-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '34529131-3f38-544f-80da-657c8bd2604d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KN18 OGS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KN18%20OGS&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VOLKSWAGEN',
'model': 'TOUAREG',
'odometer': 58349,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34529131-3f38-544f-80da-657c8bd2604d/34529131-3f38-544f-80da-657c8bd2604d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52093,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144750/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34529131-3f38-544f-80da-657c8bd2604d/34529131-3f38-544f-80da-657c8bd2604d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48082,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144755/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34529131-3f38-544f-80da-657c8bd2604d/34529131-3f38-544f-80da-657c8bd2604d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46131,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144766/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34529131-3f38-544f-80da-657c8bd2604d/34529131-3f38-544f-80da-657c8bd2604d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50228,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144768/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34529131-3f38-544f-80da-657c8bd2604d/34529131-3f38-544f-80da-657c8bd2604d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47300,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144775/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34529131-3f38-544f-80da-657c8bd2604d/34529131-3f38-544f-80da-657c8bd2604d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42273,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144781/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34529131-3f38-544f-80da-657c8bd2604d/34529131-3f38-544f-80da-657c8bd2604d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98138,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144790/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34529131-3f38-544f-80da-657c8bd2604d/34529131-3f38-544f-80da-657c8bd2604d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73901,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144802/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34529131-3f38-544f-80da-657c8bd2604d/34529131-3f38-544f-80da-657c8bd2604d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90445,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144812/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34529131-3f38-544f-80da-657c8bd2604d/34529131-3f38-544f-80da-657c8bd2604d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63117,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN18OGS/699144820/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TOUAREG 3.0 V6 TDI 262 BMT R LINE TIP StationWagon',
'transmission': 'manual',
'trim': 'V6 TDI 262 BMT R LINE TIP',
'vin': 'WVGZZZ7PZJD014740',
'year': 2018}
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN18%2520OGS%27 HTTP/1.1" 200 None
2026-03-28 22:06:12 [bca.uk] INFO: Saving data for KN18%20OGS: {'created_time': 1774735572.071822, 'last_price_update_time': 1774735572.071832, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KN18%2520OGS') HTTP/1.1" 204 0
2026-03-28 22:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993563/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV60BVR/42810790?sv=2020-08-04&st=2026-03-28T22%3A06%3A00Z&se=2026-03-28T22%3A31%3A00Z&sr=b&sp=r&sig=GMzmKOCsLt6CgM899XlsNZHP3Kky1BS5HKw%2FJfd%2B9QU%3D)
2026-03-28 22:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970554/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT70DMF/42810730?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=Cj70IayWn1fkSTExGRHSsxoWyNODHjl4jZATJrTuBHI%3D)
2026-03-28 22:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146116/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146116>
2026-03-28 22:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970551/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970551>
2026-03-28 22:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993536/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993536>
2026-03-28 22:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975193/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HY06VPF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970535/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HT70DMF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023430/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023430>
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554891310>
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4d4397f-82ae-5f65-add6-f530f9d672f0/b4d4397f-82ae-5f65-add6-f530f9d672f0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY06VPF%252F698975198%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975198/600 saved to cache
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b4d4397f-82ae-5f65-add6-f530f9d672f0
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542e2dd0>
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4d4397f-82ae-5f65-add6-f530f9d672f0/b4d4397f-82ae-5f65-add6-f530f9d672f0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY06VPF%252F698975199%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975199/600 saved to cache
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b4d4397f-82ae-5f65-add6-f530f9d672f0
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547c6c10>
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc46c333-9727-5d8d-ab5c-b3d4cb03ad24/cc46c333-9727-5d8d-ab5c-b3d4cb03ad24_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA18XPV%252F699146139%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146139/600 saved to cache
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cc46c333-9727-5d8d-ab5c-b3d4cb03ad24
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55422f150>
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0f6191-0680-5ec4-9f99-776551675a24/3b0f6191-0680-5ec4-9f99-776551675a24_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV18FLW%252F699023472%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023472/600 saved to cache
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b0f6191-0680-5ec4-9f99-776551675a24
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a61110>
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4d23d94-cc98-52e5-b2e4-244cf1ddd01e/f4d23d94-cc98-52e5-b2e4-244cf1ddd01e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV60BVR%252F698993563%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993563/600 saved to cache
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f4d23d94-cc98-52e5-b2e4-244cf1ddd01e
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fa9fd0>
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_357d0336-8e2f-5d0b-a0f0-a805d9cf3c16/357d0336-8e2f-5d0b-a0f0-a805d9cf3c16_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT70DMF%252F698970554%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970554/600 saved to cache
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16
2026-03-28 22:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023444/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV18FLW/42810997?sv=2020-08-04&st=2026-03-28T22%3A06%3A00Z&se=2026-03-28T22%3A31%3A00Z&sr=b&sp=r&sig=SGW%2Bfk4wNUPe96eq0MmJHlKteRFOQ3%2BV8WGM5O5WczE%3D)
2026-03-28 22:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970530/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KM20TSZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970543/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT70DMF/42810730?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=Cj70IayWn1fkSTExGRHSsxoWyNODHjl4jZATJrTuBHI%3D)
2026-03-28 22:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970562/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM20TSZ/42810665?sv=2020-08-04&st=2026-03-28T22%3A06%3A02Z&se=2026-03-28T22%3A31%3A02Z&sr=b&sp=r&sig=ftaAijuPkq7ydQllJHk65YeNmNsW07AOMLqm%2B%2BdmuxI%3D)
2026-03-28 22:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146125/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA18XPV/42810838?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=6qf9M7QUJwwcCEWDDFA2bz6RBkIbS81BmjR8La%2BNZQI%3D)
2026-03-28 22:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975195/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY06VPF/42810794?sv=2020-08-04&st=2026-03-28T22%3A06%3A01Z&se=2026-03-28T22%3A31%3A01Z&sr=b&sp=r&sig=SQx%2F2I7rxj%2Buge5rNrhJlhbH0k5DNdXPQnRujp2mymc%3D)
2026-03-28 22:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023430/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV18FLW/42810997?sv=2020-08-04&st=2026-03-28T22%3A06%3A00Z&se=2026-03-28T22%3A31%3A00Z&sr=b&sp=r&sig=SGW%2Bfk4wNUPe96eq0MmJHlKteRFOQ3%2BV8WGM5O5WczE%3D)
2026-03-28 22:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970551/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM20TSZ/42810665?sv=2020-08-04&st=2026-03-28T22%3A06%3A02Z&se=2026-03-28T22%3A31%3A02Z&sr=b&sp=r&sig=ftaAijuPkq7ydQllJHk65YeNmNsW07AOMLqm%2B%2BdmuxI%3D)
2026-03-28 22:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970535/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT70DMF/42810730?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=Cj70IayWn1fkSTExGRHSsxoWyNODHjl4jZATJrTuBHI%3D)
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556f47bd0>
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0f6191-0680-5ec4-9f99-776551675a24/3b0f6191-0680-5ec4-9f99-776551675a24_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV18FLW%252F699023444%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023444/600 saved to cache
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b0f6191-0680-5ec4-9f99-776551675a24
2026-03-28 22:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993536/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV60BVR/42810790?sv=2020-08-04&st=2026-03-28T22%3A06%3A00Z&se=2026-03-28T22%3A31%3A00Z&sr=b&sp=r&sig=GMzmKOCsLt6CgM899XlsNZHP3Kky1BS5HKw%2FJfd%2B9QU%3D)
2026-03-28 22:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975193/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY06VPF/42810794?sv=2020-08-04&st=2026-03-28T22%3A06%3A01Z&se=2026-03-28T22%3A31%3A01Z&sr=b&sp=r&sig=SQx%2F2I7rxj%2Buge5rNrhJlhbH0k5DNdXPQnRujp2mymc%3D)
2026-03-28 22:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146116/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RA18XPV/42810838?sv=2020-08-04&st=2026-03-28T22%3A06%3A03Z&se=2026-03-28T22%3A31%3A03Z&sr=b&sp=r&sig=6qf9M7QUJwwcCEWDDFA2bz6RBkIbS81BmjR8La%2BNZQI%3D)
2026-03-28 22:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975196/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY06VPF/42810794?sv=2020-08-04&st=2026-03-28T22%3A06%3A01Z&se=2026-03-28T22%3A31%3A01Z&sr=b&sp=r&sig=SQx%2F2I7rxj%2Buge5rNrhJlhbH0k5DNdXPQnRujp2mymc%3D)
2026-03-28 22:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993545/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV60BVR/42810790?sv=2020-08-04&st=2026-03-28T22%3A06%3A00Z&se=2026-03-28T22%3A31%3A00Z&sr=b&sp=r&sig=GMzmKOCsLt6CgM899XlsNZHP3Kky1BS5HKw%2FJfd%2B9QU%3D)
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547612110>
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_357d0336-8e2f-5d0b-a0f0-a805d9cf3c16/357d0336-8e2f-5d0b-a0f0-a805d9cf3c16_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT70DMF%252F698970543%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970543/600 saved to cache
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16
2026-03-28 22:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993527/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993527>
2026-03-28 22:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023417/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023417>
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556fdc7d0>
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c73d75d1-bd0a-5743-8d24-444e4cdb7552/c73d75d1-bd0a-5743-8d24-444e4cdb7552_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM20TSZ%252F698970562%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970562/600 saved to cache
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c73d75d1-bd0a-5743-8d24-444e4cdb7552
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547203e50>
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc46c333-9727-5d8d-ab5c-b3d4cb03ad24/cc46c333-9727-5d8d-ab5c-b3d4cb03ad24_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA18XPV%252F699146125%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146125/600 saved to cache
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cc46c333-9727-5d8d-ab5c-b3d4cb03ad24
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a62550>
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4d4397f-82ae-5f65-add6-f530f9d672f0/b4d4397f-82ae-5f65-add6-f530f9d672f0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY06VPF%252F698975195%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975195/600 saved to cache
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b4d4397f-82ae-5f65-add6-f530f9d672f0
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54738e890>
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0f6191-0680-5ec4-9f99-776551675a24/3b0f6191-0680-5ec4-9f99-776551675a24_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV18FLW%252F699023430%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023430/600 saved to cache
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b0f6191-0680-5ec4-9f99-776551675a24
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554319fd0>
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c73d75d1-bd0a-5743-8d24-444e4cdb7552/c73d75d1-bd0a-5743-8d24-444e4cdb7552_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM20TSZ%252F698970551%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970551/600 saved to cache
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c73d75d1-bd0a-5743-8d24-444e4cdb7552
2026-03-28 22:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970530/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM20TSZ/42810665?sv=2020-08-04&st=2026-03-28T22%3A06%3A02Z&se=2026-03-28T22%3A31%3A02Z&sr=b&sp=r&sig=ftaAijuPkq7ydQllJHk65YeNmNsW07AOMLqm%2B%2BdmuxI%3D)
2026-03-28 22:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208389/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208389>
2026-03-28 22:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158174/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158174>
2026-03-28 22:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994575/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994575>
2026-03-28 22:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208370/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208370>
2026-03-28 22:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146080/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146080>
2026-03-28 22:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994541/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994541>
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547314d10>
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_357d0336-8e2f-5d0b-a0f0-a805d9cf3c16/357d0336-8e2f-5d0b-a0f0-a805d9cf3c16_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT70DMF%252F698970535%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970535/600 saved to cache
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16
2026-03-28 22:06:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16, skipping ID generation
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16 sending to next pipeline
2026-03-28 22:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16, identifier: HT70%20DMF
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557f9ae50>
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4d23d94-cc98-52e5-b2e4-244cf1ddd01e/f4d23d94-cc98-52e5-b2e4-244cf1ddd01e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV60BVR%252F698993536%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993536/600 saved to cache
2026-03-28 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f4d23d94-cc98-52e5-b2e4-244cf1ddd01e
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473617d0>
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4d4397f-82ae-5f65-add6-f530f9d672f0/b4d4397f-82ae-5f65-add6-f530f9d672f0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY06VPF%252F698975193%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975193/600 saved to cache
2026-03-28 22:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4d4397f-82ae-5f65-add6-f530f9d672f0
2026-03-28 22:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554404c50>
2026-03-28 22:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc46c333-9727-5d8d-ab5c-b3d4cb03ad24/cc46c333-9727-5d8d-ab5c-b3d4cb03ad24_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRA18XPV%252F699146116%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146116/600 saved to cache
2026-03-28 22:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cc46c333-9727-5d8d-ab5c-b3d4cb03ad24
2026-03-28 22:06:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc46c333-9727-5d8d-ab5c-b3d4cb03ad24, skipping ID generation
2026-03-28 22:06:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc46c333-9727-5d8d-ab5c-b3d4cb03ad24 sending to next pipeline
2026-03-28 22:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cc46c333-9727-5d8d-ab5c-b3d4cb03ad24, identifier: RA18%20XPV
2026-03-28 22:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547361310>
2026-03-28 22:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4d4397f-82ae-5f65-add6-f530f9d672f0/b4d4397f-82ae-5f65-add6-f530f9d672f0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY06VPF%252F698975196%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975196/600 saved to cache
2026-03-28 22:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b4d4397f-82ae-5f65-add6-f530f9d672f0
2026-03-28 22:06:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4d4397f-82ae-5f65-add6-f530f9d672f0, skipping ID generation
2026-03-28 22:06:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4d4397f-82ae-5f65-add6-f530f9d672f0 sending to next pipeline
2026-03-28 22:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b4d4397f-82ae-5f65-add6-f530f9d672f0, identifier: HY06%20VPF
2026-03-28 22:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554987190>
2026-03-28 22:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4d23d94-cc98-52e5-b2e4-244cf1ddd01e/f4d23d94-cc98-52e5-b2e4-244cf1ddd01e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV60BVR%252F698993545%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993545/600 saved to cache
2026-03-28 22:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f4d23d94-cc98-52e5-b2e4-244cf1ddd01e
2026-03-28 22:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16 with identifier: HT70%20DMF
2026-03-28 22:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16 with identifier: HT70%20DMF
2026-03-28 22:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16 with identifier: HT70%20DMF to the API
2026-03-28 22:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970535/600>
{'auction_title': '',
'c_o_2_emission_value': 177,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357d0336-8e2f-5d0b-a0f0-a805d9cf3c16/357d0336-8e2f-5d0b-a0f0-a805d9cf3c16_expert_report_file_34b8f270-089f-44cc-83c8-6296b9561c8d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HT70%20DMF-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '357d0336-8e2f-5d0b-a0f0-a805d9cf3c16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HT70 DMF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HT70%20DMF&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MG MOTOR UK',
'model': 'HS',
'odometer': 34482,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357d0336-8e2f-5d0b-a0f0-a805d9cf3c16/357d0336-8e2f-5d0b-a0f0-a805d9cf3c16_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43049,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970535/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357d0336-8e2f-5d0b-a0f0-a805d9cf3c16/357d0336-8e2f-5d0b-a0f0-a805d9cf3c16_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40890,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970543/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357d0336-8e2f-5d0b-a0f0-a805d9cf3c16/357d0336-8e2f-5d0b-a0f0-a805d9cf3c16_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40171,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970554/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357d0336-8e2f-5d0b-a0f0-a805d9cf3c16/357d0336-8e2f-5d0b-a0f0-a805d9cf3c16_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38158,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970568/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357d0336-8e2f-5d0b-a0f0-a805d9cf3c16/357d0336-8e2f-5d0b-a0f0-a805d9cf3c16_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35995,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970585/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357d0336-8e2f-5d0b-a0f0-a805d9cf3c16/357d0336-8e2f-5d0b-a0f0-a805d9cf3c16_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35705,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970601/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357d0336-8e2f-5d0b-a0f0-a805d9cf3c16/357d0336-8e2f-5d0b-a0f0-a805d9cf3c16_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80205,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970619/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357d0336-8e2f-5d0b-a0f0-a805d9cf3c16/357d0336-8e2f-5d0b-a0f0-a805d9cf3c16_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65199,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970631/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357d0336-8e2f-5d0b-a0f0-a805d9cf3c16/357d0336-8e2f-5d0b-a0f0-a805d9cf3c16_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74344,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970654/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_357d0336-8e2f-5d0b-a0f0-a805d9cf3c16/357d0336-8e2f-5d0b-a0f0-a805d9cf3c16_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75590,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT70DMF/698970669/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'MG MOTOR UK HS 1.5 TGI EXCITE DCT Hatchback',
'transmission': 'automatic',
'trim': 'TGI EXCITE DCT',
'vin': 'SDPA2BBFDLN027624',
'year': 2021}
2026-03-28 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT70%2520DMF%27 HTTP/1.1" 200 None
2026-03-28 22:06:13 [bca.uk] INFO: Saving data for HT70%20DMF: {'created_time': 1774735573.696981, 'last_price_update_time': 1774735573.696992, 'auction_closing_time': 1774864800.0}
2026-03-28 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HT70%2520DMF') HTTP/1.1" 204 0
2026-03-28 22:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cc46c333-9727-5d8d-ab5c-b3d4cb03ad24 with identifier: RA18%20XPV
2026-03-28 22:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cc46c333-9727-5d8d-ab5c-b3d4cb03ad24 with identifier: RA18%20XPV
2026-03-28 22:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cc46c333-9727-5d8d-ab5c-b3d4cb03ad24 with identifier: RA18%20XPV to the API
2026-03-28 22:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146116/600>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc46c333-9727-5d8d-ab5c-b3d4cb03ad24/cc46c333-9727-5d8d-ab5c-b3d4cb03ad24_expert_report_file_a0c8f35c-b95d-4f5d-9265-5af78ab0e39c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RA18%20XPV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'cc46c333-9727-5d8d-ab5c-b3d4cb03ad24',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RA18 XPV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RA18%20XPV&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'B-MAX',
'odometer': 64632,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc46c333-9727-5d8d-ab5c-b3d4cb03ad24/cc46c333-9727-5d8d-ab5c-b3d4cb03ad24_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46308,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146112/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc46c333-9727-5d8d-ab5c-b3d4cb03ad24/cc46c333-9727-5d8d-ab5c-b3d4cb03ad24_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44377,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146116/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc46c333-9727-5d8d-ab5c-b3d4cb03ad24/cc46c333-9727-5d8d-ab5c-b3d4cb03ad24_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46159,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146125/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc46c333-9727-5d8d-ab5c-b3d4cb03ad24/cc46c333-9727-5d8d-ab5c-b3d4cb03ad24_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47898,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146132/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc46c333-9727-5d8d-ab5c-b3d4cb03ad24/cc46c333-9727-5d8d-ab5c-b3d4cb03ad24_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47046,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146139/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc46c333-9727-5d8d-ab5c-b3d4cb03ad24/cc46c333-9727-5d8d-ab5c-b3d4cb03ad24_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44921,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146147/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc46c333-9727-5d8d-ab5c-b3d4cb03ad24/cc46c333-9727-5d8d-ab5c-b3d4cb03ad24_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79179,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146154/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc46c333-9727-5d8d-ab5c-b3d4cb03ad24/cc46c333-9727-5d8d-ab5c-b3d4cb03ad24_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80214,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146161/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc46c333-9727-5d8d-ab5c-b3d4cb03ad24/cc46c333-9727-5d8d-ab5c-b3d4cb03ad24_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84111,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146170/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc46c333-9727-5d8d-ab5c-b3d4cb03ad24/cc46c333-9727-5d8d-ab5c-b3d4cb03ad24_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85759,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA18XPV/699146182/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FORD B-MAX 1.0 E/B 125 ZETEC MPV',
'transmission': 'manual',
'trim': 'E/B 125 ZETEC',
'vin': 'WF0KXXERJKHA88998',
'year': 2018}
2026-03-28 22:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA18%2520XPV%27 HTTP/1.1" 200 None
2026-03-28 22:06:14 [bca.uk] INFO: Saving data for RA18%20XPV: {'created_time': 1774735574.096113, 'last_price_update_time': 1774735574.096125, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RA18%2520XPV') HTTP/1.1" 204 0
2026-03-28 22:06:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b4d4397f-82ae-5f65-add6-f530f9d672f0 with identifier: HY06%20VPF
2026-03-28 22:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b4d4397f-82ae-5f65-add6-f530f9d672f0 with identifier: HY06%20VPF
2026-03-28 22:06:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b4d4397f-82ae-5f65-add6-f530f9d672f0 with identifier: HY06%20VPF to the API
2026-03-28 22:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975196/600>
{'auction_title': '',
'c_o_2_emission_value': 187,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4d4397f-82ae-5f65-add6-f530f9d672f0/b4d4397f-82ae-5f65-add6-f530f9d672f0_expert_report_file_d4f8fc37-7cc5-4e1f-ab61-ad09c7654bd7.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HY06%20VPF-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b4d4397f-82ae-5f65-add6-f530f9d672f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HY06 VPF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HY06%20VPF&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VAUXHALL',
'model': 'ZAFIRA',
'odometer': 74934,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4d4397f-82ae-5f65-add6-f530f9d672f0/b4d4397f-82ae-5f65-add6-f530f9d672f0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192792,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975193/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4d4397f-82ae-5f65-add6-f530f9d672f0/b4d4397f-82ae-5f65-add6-f530f9d672f0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201187,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975195/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4d4397f-82ae-5f65-add6-f530f9d672f0/b4d4397f-82ae-5f65-add6-f530f9d672f0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198257,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975196/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4d4397f-82ae-5f65-add6-f530f9d672f0/b4d4397f-82ae-5f65-add6-f530f9d672f0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189167,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975198/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4d4397f-82ae-5f65-add6-f530f9d672f0/b4d4397f-82ae-5f65-add6-f530f9d672f0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189788,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975199/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4d4397f-82ae-5f65-add6-f530f9d672f0/b4d4397f-82ae-5f65-add6-f530f9d672f0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 149122,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975200/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4d4397f-82ae-5f65-add6-f530f9d672f0/b4d4397f-82ae-5f65-add6-f530f9d672f0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 167835,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975202/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4d4397f-82ae-5f65-add6-f530f9d672f0/b4d4397f-82ae-5f65-add6-f530f9d672f0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 169826,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975205/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4d4397f-82ae-5f65-add6-f530f9d672f0/b4d4397f-82ae-5f65-add6-f530f9d672f0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151994,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY06VPF/698975217/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'VAUXHALL ZAFIRA 1.8 DESIGN MPV',
'transmission': 'manual',
'trim': 'DESIGN',
'vin': 'W0L0AHM7562130474',
'year': 2006}
2026-03-28 22:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY06%2520VPF%27 HTTP/1.1" 200 None
2026-03-28 22:06:14 [bca.uk] INFO: Saving data for HY06%20VPF: {'created_time': 1774735574.535692, 'last_price_update_time': 1774735574.535704, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HY06%2520VPF') HTTP/1.1" 204 0
2026-03-28 22:06:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188557/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188557>
2026-03-28 22:06:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994481/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994481>
2026-03-28 22:06:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146070/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146070>
2026-03-28 22:06:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158163/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158163>
2026-03-28 22:06:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188548/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188548>
2026-03-28 22:06:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158151/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158151>
2026-03-28 22:06:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146059/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146059>
2026-03-28 22:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993527/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV60BVR/42810790?sv=2020-08-04&st=2026-03-28T22%3A06%3A00Z&se=2026-03-28T22%3A31%3A00Z&sr=b&sp=r&sig=GMzmKOCsLt6CgM899XlsNZHP3Kky1BS5HKw%2FJfd%2B9QU%3D)
2026-03-28 22:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474e3190>
2026-03-28 22:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c73d75d1-bd0a-5743-8d24-444e4cdb7552/c73d75d1-bd0a-5743-8d24-444e4cdb7552_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM20TSZ%252F698970530%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970530/600 saved to cache
2026-03-28 22:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c73d75d1-bd0a-5743-8d24-444e4cdb7552
2026-03-28 22:06:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c73d75d1-bd0a-5743-8d24-444e4cdb7552, skipping ID generation
2026-03-28 22:06:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c73d75d1-bd0a-5743-8d24-444e4cdb7552 sending to next pipeline
2026-03-28 22:06:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c73d75d1-bd0a-5743-8d24-444e4cdb7552, identifier: KM20%20TSZ
2026-03-28 22:06:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c73d75d1-bd0a-5743-8d24-444e4cdb7552 with identifier: KM20%20TSZ
2026-03-28 22:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c73d75d1-bd0a-5743-8d24-444e4cdb7552 with identifier: KM20%20TSZ
2026-03-28 22:06:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c73d75d1-bd0a-5743-8d24-444e4cdb7552 with identifier: KM20%20TSZ to the API
2026-03-28 22:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970530/600>
{'auction_title': '',
'c_o_2_emission_value': 127,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c73d75d1-bd0a-5743-8d24-444e4cdb7552/c73d75d1-bd0a-5743-8d24-444e4cdb7552_expert_report_file_2b3889a8-4748-4555-8c8b-703dd3db3c89.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM20%20TSZ-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c73d75d1-bd0a-5743-8d24-444e4cdb7552',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KM20 TSZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KM20%20TSZ&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'E220 D',
'odometer': 68391,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c73d75d1-bd0a-5743-8d24-444e4cdb7552/c73d75d1-bd0a-5743-8d24-444e4cdb7552_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50748,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970530/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c73d75d1-bd0a-5743-8d24-444e4cdb7552/c73d75d1-bd0a-5743-8d24-444e4cdb7552_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46950,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970551/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c73d75d1-bd0a-5743-8d24-444e4cdb7552/c73d75d1-bd0a-5743-8d24-444e4cdb7552_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45579,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970562/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c73d75d1-bd0a-5743-8d24-444e4cdb7552/c73d75d1-bd0a-5743-8d24-444e4cdb7552_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42788,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970575/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c73d75d1-bd0a-5743-8d24-444e4cdb7552/c73d75d1-bd0a-5743-8d24-444e4cdb7552_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36766,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970592/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c73d75d1-bd0a-5743-8d24-444e4cdb7552/c73d75d1-bd0a-5743-8d24-444e4cdb7552_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35520,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970608/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c73d75d1-bd0a-5743-8d24-444e4cdb7552/c73d75d1-bd0a-5743-8d24-444e4cdb7552_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90148,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970621/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c73d75d1-bd0a-5743-8d24-444e4cdb7552/c73d75d1-bd0a-5743-8d24-444e4cdb7552_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78585,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970636/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c73d75d1-bd0a-5743-8d24-444e4cdb7552/c73d75d1-bd0a-5743-8d24-444e4cdb7552_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88387,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970650/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c73d75d1-bd0a-5743-8d24-444e4cdb7552/c73d75d1-bd0a-5743-8d24-444e4cdb7552_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77508,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM20TSZ/698970668/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ E220 D 2.0 AMG LINE NIGHT ED.PREM.PLUS 9G Saloon',
'transmission': 'manual',
'trim': 'AMG LINE NIGHT ED.PREM.PLUS 9G',
'vin': 'W1K2130042A817018',
'year': 2020}
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM20%2520TSZ%27 HTTP/1.1" 200 None
2026-03-28 22:06:15 [bca.uk] INFO: Saving data for KM20%20TSZ: {'created_time': 1774735575.102501, 'last_price_update_time': 1774735575.102511, 'auction_closing_time': 1774864800.0}
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KM20%2520TSZ') HTTP/1.1" 204 0
2026-03-28 22:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023417/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV18FLW/42810997?sv=2020-08-04&st=2026-03-28T22%3A06%3A00Z&se=2026-03-28T22%3A31%3A00Z&sr=b&sp=r&sig=SGW%2Bfk4wNUPe96eq0MmJHlKteRFOQ3%2BV8WGM5O5WczE%3D)
2026-03-28 22:06:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188526/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188526>
2026-03-28 22:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208370/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE19UGD/42807906?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=PVNSmCdj4lqVo33gqsXVrCQnpHCUCgw%2FIRQ0Qxai5qw%3D)
2026-03-28 22:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994541/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ14PYU/42810573?sv=2020-08-04&st=2026-03-28T22%3A05%3A56Z&se=2026-03-28T22%3A30%3A56Z&sr=b&sp=r&sig=tkEo323ohrihOZXVnqm5FOYri5pOdaZiZLNiiyp2Vog%3D)
2026-03-28 22:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146080/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV67VJU/42810955?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=pcdQ%2FQprBD1I89Z22aQT%2Fy%2FecVGPDfQATBl8G%2BxCxUw%3D)
2026-03-28 22:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158174/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK73EWD/42804333?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=5M4SgAmptrCJ8i0ARGkLnrB6V3wMXNdNGY6VCvEo%2F%2FI%3D)
2026-03-28 22:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994575/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ14PYU/42810573?sv=2020-08-04&st=2026-03-28T22%3A05%3A56Z&se=2026-03-28T22%3A30%3A56Z&sr=b&sp=r&sig=tkEo323ohrihOZXVnqm5FOYri5pOdaZiZLNiiyp2Vog%3D)
2026-03-28 22:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208389/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE19UGD/42807906?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=PVNSmCdj4lqVo33gqsXVrCQnpHCUCgw%2FIRQ0Qxai5qw%3D)
2026-03-28 22:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549fc910>
2026-03-28 22:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4d23d94-cc98-52e5-b2e4-244cf1ddd01e/f4d23d94-cc98-52e5-b2e4-244cf1ddd01e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV60BVR%252F698993527%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993527/600 saved to cache
2026-03-28 22:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f4d23d94-cc98-52e5-b2e4-244cf1ddd01e
2026-03-28 22:06:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f4d23d94-cc98-52e5-b2e4-244cf1ddd01e, skipping ID generation
2026-03-28 22:06:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f4d23d94-cc98-52e5-b2e4-244cf1ddd01e sending to next pipeline
2026-03-28 22:06:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f4d23d94-cc98-52e5-b2e4-244cf1ddd01e, identifier: OV60%20BVR
2026-03-28 22:06:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f4d23d94-cc98-52e5-b2e4-244cf1ddd01e with identifier: OV60%20BVR
2026-03-28 22:06:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f4d23d94-cc98-52e5-b2e4-244cf1ddd01e with identifier: OV60%20BVR
2026-03-28 22:06:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f4d23d94-cc98-52e5-b2e4-244cf1ddd01e with identifier: OV60%20BVR to the API
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993527/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4d23d94-cc98-52e5-b2e4-244cf1ddd01e/f4d23d94-cc98-52e5-b2e4-244cf1ddd01e_expert_report_file_c55219e7-68b7-4d4a-bf7d-122dbd5b9cd5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV60%20BVR-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f4d23d94-cc98-52e5-b2e4-244cf1ddd01e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OV60 BVR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OV60%20BVR&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 78709,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4d23d94-cc98-52e5-b2e4-244cf1ddd01e/f4d23d94-cc98-52e5-b2e4-244cf1ddd01e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 203231,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993518/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4d23d94-cc98-52e5-b2e4-244cf1ddd01e/f4d23d94-cc98-52e5-b2e4-244cf1ddd01e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196726,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993527/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4d23d94-cc98-52e5-b2e4-244cf1ddd01e/f4d23d94-cc98-52e5-b2e4-244cf1ddd01e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188955,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993536/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4d23d94-cc98-52e5-b2e4-244cf1ddd01e/f4d23d94-cc98-52e5-b2e4-244cf1ddd01e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189754,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993545/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4d23d94-cc98-52e5-b2e4-244cf1ddd01e/f4d23d94-cc98-52e5-b2e4-244cf1ddd01e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 162295,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993554/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4d23d94-cc98-52e5-b2e4-244cf1ddd01e/f4d23d94-cc98-52e5-b2e4-244cf1ddd01e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 135037,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993563/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4d23d94-cc98-52e5-b2e4-244cf1ddd01e/f4d23d94-cc98-52e5-b2e4-244cf1ddd01e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156171,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993572/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4d23d94-cc98-52e5-b2e4-244cf1ddd01e/f4d23d94-cc98-52e5-b2e4-244cf1ddd01e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152525,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993581/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4d23d94-cc98-52e5-b2e4-244cf1ddd01e/f4d23d94-cc98-52e5-b2e4-244cf1ddd01e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 165282,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV60BVR/698993592/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'RENAULT CLIO 1.2 16V EXTREME Hatchback',
'transmission': 'manual',
'trim': '16V EXTREME',
'vin': 'VF1CR1J0H44176163',
'year': 2010}
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV60%2520BVR%27 HTTP/1.1" 200 None
2026-03-28 22:06:15 [bca.uk] INFO: Saving data for OV60%20BVR: {'created_time': 1774735575.652918, 'last_price_update_time': 1774735575.652929, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OV60%2520BVR') HTTP/1.1" 204 0
2026-03-28 22:06:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188514/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188514>
2026-03-28 22:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146059/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV67VJU/42810955?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=pcdQ%2FQprBD1I89Z22aQT%2Fy%2FecVGPDfQATBl8G%2BxCxUw%3D)
2026-03-28 22:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188548/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN22SLU/42804593?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=hhNBBoBPvxsGjwiVsOUff1izuJYcAqLpIDtsYgB2%2FIY%3D)
2026-03-28 22:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146070/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV67VJU/42810955?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=pcdQ%2FQprBD1I89Z22aQT%2Fy%2FecVGPDfQATBl8G%2BxCxUw%3D)
2026-03-28 22:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158163/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK73EWD/42804333?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=5M4SgAmptrCJ8i0ARGkLnrB6V3wMXNdNGY6VCvEo%2F%2FI%3D)
2026-03-28 22:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188557/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN22SLU/42804593?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=hhNBBoBPvxsGjwiVsOUff1izuJYcAqLpIDtsYgB2%2FIY%3D)
2026-03-28 22:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994481/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ14PYU/42810573?sv=2020-08-04&st=2026-03-28T22%3A05%3A56Z&se=2026-03-28T22%3A30%3A56Z&sr=b&sp=r&sig=tkEo323ohrihOZXVnqm5FOYri5pOdaZiZLNiiyp2Vog%3D)
2026-03-28 22:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158151/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK73EWD/42804333?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=5M4SgAmptrCJ8i0ARGkLnrB6V3wMXNdNGY6VCvEo%2F%2FI%3D)
2026-03-28 22:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fa8f10>
2026-03-28 22:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0f6191-0680-5ec4-9f99-776551675a24/3b0f6191-0680-5ec4-9f99-776551675a24_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV18FLW%252F699023417%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023417/600 saved to cache
2026-03-28 22:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b0f6191-0680-5ec4-9f99-776551675a24
2026-03-28 22:06:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b0f6191-0680-5ec4-9f99-776551675a24, skipping ID generation
2026-03-28 22:06:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b0f6191-0680-5ec4-9f99-776551675a24 sending to next pipeline
2026-03-28 22:06:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3b0f6191-0680-5ec4-9f99-776551675a24, identifier: LV18%20FLW
2026-03-28 22:06:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547451bd0>
2026-03-28 22:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2785a6e-33af-5eba-b84f-311143aa78be/e2785a6e-33af-5eba-b84f-311143aa78be_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE19UGD%252F699208370%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208370/600 saved to cache
2026-03-28 22:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e2785a6e-33af-5eba-b84f-311143aa78be
2026-03-28 22:06:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54777fe10>
2026-03-28 22:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2faac3c-f66f-5c6b-825e-332b835cca02/c2faac3c-f66f-5c6b-825e-332b835cca02_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ14PYU%252F698994541%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994541/600 saved to cache
2026-03-28 22:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c2faac3c-f66f-5c6b-825e-332b835cca02
2026-03-28 22:06:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547453110>
2026-03-28 22:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68511f88-68fc-5ac1-befe-453b6775c3b3/68511f88-68fc-5ac1-befe-453b6775c3b3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV67VJU%252F699146080%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146080/600 saved to cache
2026-03-28 22:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 68511f88-68fc-5ac1-befe-453b6775c3b3
2026-03-28 22:06:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55729e050>
2026-03-28 22:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e39c955-50ed-58e2-b150-dec2ff78b99f/8e39c955-50ed-58e2-b150-dec2ff78b99f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK73EWD%252F699158174%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158174/600 saved to cache
2026-03-28 22:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e39c955-50ed-58e2-b150-dec2ff78b99f
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547343b10>
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2faac3c-f66f-5c6b-825e-332b835cca02/c2faac3c-f66f-5c6b-825e-332b835cca02_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ14PYU%252F698994575%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994575/600 saved to cache
2026-03-28 22:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c2faac3c-f66f-5c6b-825e-332b835cca02
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474e2090>
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2785a6e-33af-5eba-b84f-311143aa78be/e2785a6e-33af-5eba-b84f-311143aa78be_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE19UGD%252F699208389%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208389/600 saved to cache
2026-03-28 22:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e2785a6e-33af-5eba-b84f-311143aa78be
2026-03-28 22:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3b0f6191-0680-5ec4-9f99-776551675a24 with identifier: LV18%20FLW
2026-03-28 22:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3b0f6191-0680-5ec4-9f99-776551675a24 with identifier: LV18%20FLW
2026-03-28 22:06:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3b0f6191-0680-5ec4-9f99-776551675a24 with identifier: LV18%20FLW to the API
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023417/600>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0f6191-0680-5ec4-9f99-776551675a24/3b0f6191-0680-5ec4-9f99-776551675a24_expert_report_file_81d39c61-0185-47a4-a830-ad2da9a04075.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LV18%20FLW-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3b0f6191-0680-5ec4-9f99-776551675a24',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LV18 FLW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LV18%20FLW&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'HYUNDAI',
'model': 'I10',
'odometer': 1806,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0f6191-0680-5ec4-9f99-776551675a24/3b0f6191-0680-5ec4-9f99-776551675a24_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42353,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023405/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0f6191-0680-5ec4-9f99-776551675a24/3b0f6191-0680-5ec4-9f99-776551675a24_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41333,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023417/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0f6191-0680-5ec4-9f99-776551675a24/3b0f6191-0680-5ec4-9f99-776551675a24_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41332,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023430/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0f6191-0680-5ec4-9f99-776551675a24/3b0f6191-0680-5ec4-9f99-776551675a24_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38472,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023444/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0f6191-0680-5ec4-9f99-776551675a24/3b0f6191-0680-5ec4-9f99-776551675a24_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37606,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023457/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0f6191-0680-5ec4-9f99-776551675a24/3b0f6191-0680-5ec4-9f99-776551675a24_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38889,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023472/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0f6191-0680-5ec4-9f99-776551675a24/3b0f6191-0680-5ec4-9f99-776551675a24_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80146,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023491/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0f6191-0680-5ec4-9f99-776551675a24/3b0f6191-0680-5ec4-9f99-776551675a24_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58322,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023514/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0f6191-0680-5ec4-9f99-776551675a24/3b0f6191-0680-5ec4-9f99-776551675a24_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74206,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023540/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0f6191-0680-5ec4-9f99-776551675a24/3b0f6191-0680-5ec4-9f99-776551675a24_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72423,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV18FLW/699023560/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'HYUNDAI I10 1.0 S Hatchback',
'transmission': 'manual',
'trim': 'S',
'vin': 'NLHA751ALJZ410912',
'year': 2018}
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV18%2520FLW%27 HTTP/1.1" 200 None
2026-03-28 22:06:16 [bca.uk] INFO: Saving data for LV18%20FLW: {'created_time': 1774735576.441274, 'last_price_update_time': 1774735576.441286, 'auction_closing_time': 1774864800.0}
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LV18%2520FLW') HTTP/1.1" 204 0
2026-03-28 22:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158113/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158113>
2026-03-28 22:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146039/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146039>
2026-03-28 22:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188493/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188493>
2026-03-28 22:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146032/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146032>
2026-03-28 22:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188500/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188500>
2026-03-28 22:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158116/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158116>
2026-03-28 22:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994404/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994404>
2026-03-28 22:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188526/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN22SLU/42804593?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=hhNBBoBPvxsGjwiVsOUff1izuJYcAqLpIDtsYgB2%2FIY%3D)
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54777e6d0>
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68511f88-68fc-5ac1-befe-453b6775c3b3/68511f88-68fc-5ac1-befe-453b6775c3b3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV67VJU%252F699146059%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146059/600 saved to cache
2026-03-28 22:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 68511f88-68fc-5ac1-befe-453b6775c3b3
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55456c310>
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b95ec648-e27a-5a47-b460-f09e07adbbeb/b95ec648-e27a-5a47-b460-f09e07adbbeb_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN22SLU%252F699188548%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188548/600 saved to cache
2026-03-28 22:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b95ec648-e27a-5a47-b460-f09e07adbbeb
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471ce9d0>
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68511f88-68fc-5ac1-befe-453b6775c3b3/68511f88-68fc-5ac1-befe-453b6775c3b3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV67VJU%252F699146070%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146070/600 saved to cache
2026-03-28 22:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 68511f88-68fc-5ac1-befe-453b6775c3b3
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b0ebd0>
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e39c955-50ed-58e2-b150-dec2ff78b99f/8e39c955-50ed-58e2-b150-dec2ff78b99f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK73EWD%252F699158163%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158163/600 saved to cache
2026-03-28 22:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e39c955-50ed-58e2-b150-dec2ff78b99f
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554987510>
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b95ec648-e27a-5a47-b460-f09e07adbbeb/b95ec648-e27a-5a47-b460-f09e07adbbeb_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN22SLU%252F699188557%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188557/600 saved to cache
2026-03-28 22:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b95ec648-e27a-5a47-b460-f09e07adbbeb
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b0df10>
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2faac3c-f66f-5c6b-825e-332b835cca02/c2faac3c-f66f-5c6b-825e-332b835cca02_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ14PYU%252F698994481%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994481/600 saved to cache
2026-03-28 22:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c2faac3c-f66f-5c6b-825e-332b835cca02
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547680310>
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e39c955-50ed-58e2-b150-dec2ff78b99f/8e39c955-50ed-58e2-b150-dec2ff78b99f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK73EWD%252F699158151%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158151/600 saved to cache
2026-03-28 22:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e39c955-50ed-58e2-b150-dec2ff78b99f
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55485aa10>
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b95ec648-e27a-5a47-b460-f09e07adbbeb/b95ec648-e27a-5a47-b460-f09e07adbbeb_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN22SLU%252F699188526%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188526/600 saved to cache
2026-03-28 22:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b95ec648-e27a-5a47-b460-f09e07adbbeb
2026-03-28 22:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146020/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146020>
2026-03-28 22:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146025/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146025>
2026-03-28 22:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208282/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208282>
2026-03-28 22:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158108/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158108>
2026-03-28 22:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188478/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188478>
2026-03-28 22:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994385/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994385>
2026-03-28 22:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188484/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188484>
2026-03-28 22:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188514/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN22SLU/42804593?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=hhNBBoBPvxsGjwiVsOUff1izuJYcAqLpIDtsYgB2%2FIY%3D)
2026-03-28 22:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994404/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ14PYU/42810573?sv=2020-08-04&st=2026-03-28T22%3A05%3A56Z&se=2026-03-28T22%3A30%3A56Z&sr=b&sp=r&sig=tkEo323ohrihOZXVnqm5FOYri5pOdaZiZLNiiyp2Vog%3D)
2026-03-28 22:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188500/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN22SLU/42804593?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=hhNBBoBPvxsGjwiVsOUff1izuJYcAqLpIDtsYgB2%2FIY%3D)
2026-03-28 22:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146039/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV67VJU/42810955?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=pcdQ%2FQprBD1I89Z22aQT%2Fy%2FecVGPDfQATBl8G%2BxCxUw%3D)
2026-03-28 22:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146032/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV67VJU/42810955?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=pcdQ%2FQprBD1I89Z22aQT%2Fy%2FecVGPDfQATBl8G%2BxCxUw%3D)
2026-03-28 22:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158113/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK73EWD/42804333?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=5M4SgAmptrCJ8i0ARGkLnrB6V3wMXNdNGY6VCvEo%2F%2FI%3D)
2026-03-28 22:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208275/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CE19UGD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188493/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN22SLU/42804593?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=hhNBBoBPvxsGjwiVsOUff1izuJYcAqLpIDtsYgB2%2FIY%3D)
2026-03-28 22:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146020/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV67VJU/42810955?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=pcdQ%2FQprBD1I89Z22aQT%2Fy%2FecVGPDfQATBl8G%2BxCxUw%3D)
2026-03-28 22:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158108/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK73EWD/42804333?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=5M4SgAmptrCJ8i0ARGkLnrB6V3wMXNdNGY6VCvEo%2F%2FI%3D)
2026-03-28 22:06:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55485bdd0>
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b95ec648-e27a-5a47-b460-f09e07adbbeb/b95ec648-e27a-5a47-b460-f09e07adbbeb_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN22SLU%252F699188514%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188514/600 saved to cache
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b95ec648-e27a-5a47-b460-f09e07adbbeb
2026-03-28 22:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158116/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK73EWD/42804333?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=5M4SgAmptrCJ8i0ARGkLnrB6V3wMXNdNGY6VCvEo%2F%2FI%3D)
2026-03-28 22:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146025/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV67VJU/42810955?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=pcdQ%2FQprBD1I89Z22aQT%2Fy%2FecVGPDfQATBl8G%2BxCxUw%3D)
2026-03-28 22:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188478/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN22SLU/42804593?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=hhNBBoBPvxsGjwiVsOUff1izuJYcAqLpIDtsYgB2%2FIY%3D)
2026-03-28 22:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208282/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE19UGD/42807906?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=PVNSmCdj4lqVo33gqsXVrCQnpHCUCgw%2FIRQ0Qxai5qw%3D)
2026-03-28 22:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188484/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN22SLU/42804593?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=hhNBBoBPvxsGjwiVsOUff1izuJYcAqLpIDtsYgB2%2FIY%3D)
2026-03-28 22:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994385/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ14PYU/42810573?sv=2020-08-04&st=2026-03-28T22%3A05%3A56Z&se=2026-03-28T22%3A30%3A56Z&sr=b&sp=r&sig=tkEo323ohrihOZXVnqm5FOYri5pOdaZiZLNiiyp2Vog%3D)
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55422d250>
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2faac3c-f66f-5c6b-825e-332b835cca02/c2faac3c-f66f-5c6b-825e-332b835cca02_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ14PYU%252F698994404%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994404/600 saved to cache
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c2faac3c-f66f-5c6b-825e-332b835cca02
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554280250>
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b95ec648-e27a-5a47-b460-f09e07adbbeb/b95ec648-e27a-5a47-b460-f09e07adbbeb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN22SLU%252F699188500%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188500/600 saved to cache
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b95ec648-e27a-5a47-b460-f09e07adbbeb
2026-03-28 22:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994368/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EJ14PYU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158104/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158104>
2026-03-28 22:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208275/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE19UGD/42807906?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=PVNSmCdj4lqVo33gqsXVrCQnpHCUCgw%2FIRQ0Qxai5qw%3D)
2026-03-28 22:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146011/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146011>
2026-03-28 22:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188461/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CN22SLU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188468/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188468>
2026-03-28 22:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158099/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HK73EWD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146004/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OV67VJU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547742690>
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68511f88-68fc-5ac1-befe-453b6775c3b3/68511f88-68fc-5ac1-befe-453b6775c3b3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV67VJU%252F699146039%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146039/600 saved to cache
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 68511f88-68fc-5ac1-befe-453b6775c3b3
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471f7410>
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68511f88-68fc-5ac1-befe-453b6775c3b3/68511f88-68fc-5ac1-befe-453b6775c3b3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV67VJU%252F699146032%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146032/600 saved to cache
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 68511f88-68fc-5ac1-befe-453b6775c3b3
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554283c50>
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e39c955-50ed-58e2-b150-dec2ff78b99f/8e39c955-50ed-58e2-b150-dec2ff78b99f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK73EWD%252F699158113%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158113/600 saved to cache
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e39c955-50ed-58e2-b150-dec2ff78b99f
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547741550>
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b95ec648-e27a-5a47-b460-f09e07adbbeb/b95ec648-e27a-5a47-b460-f09e07adbbeb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN22SLU%252F699188493%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188493/600 saved to cache
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b95ec648-e27a-5a47-b460-f09e07adbbeb
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55430fd50>
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68511f88-68fc-5ac1-befe-453b6775c3b3/68511f88-68fc-5ac1-befe-453b6775c3b3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV67VJU%252F699146020%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146020/600 saved to cache
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 68511f88-68fc-5ac1-befe-453b6775c3b3
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554979d10>
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e39c955-50ed-58e2-b150-dec2ff78b99f/8e39c955-50ed-58e2-b150-dec2ff78b99f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK73EWD%252F699158108%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158108/600 saved to cache
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e39c955-50ed-58e2-b150-dec2ff78b99f
2026-03-28 22:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253456/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253456>
2026-03-28 22:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976154/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976154>
2026-03-28 22:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976103/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698976103>
2026-03-28 22:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF68HMX/42810701?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=VJkB3V1eYsfB99bax5tHm9xSKTZvKZqqHjZcNzH%2BIG0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AF68%20HMX-GB>
2026-03-28 22:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT05ONJ/42810976?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=5MixAqDo0hxRmLUvG5M%2B4PG7rAb3blo5qbHfZngnDeI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT05%20ONJ-GB>
2026-03-28 22:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ71WSN/42810927?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=99Y%2F2O0XgNIgp1TnOJNknTQ6RKH%2BfHRxWx3tjIKgxWM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ71%20WSN-GB>
2026-03-28 22:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252925/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252925>
2026-03-28 22:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV70FXU/42810883?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=FPY2a%2BwTPBX3%2FgfHv4tGqy5Xp%2BqnbitwV6VOtdx3RWA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WV70%20FXU-GB>
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5570f0dd0>
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e39c955-50ed-58e2-b150-dec2ff78b99f/8e39c955-50ed-58e2-b150-dec2ff78b99f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK73EWD%252F699158116%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158116/600 saved to cache
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e39c955-50ed-58e2-b150-dec2ff78b99f
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473daf90>
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68511f88-68fc-5ac1-befe-453b6775c3b3/68511f88-68fc-5ac1-befe-453b6775c3b3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV67VJU%252F699146025%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146025/600 saved to cache
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 68511f88-68fc-5ac1-befe-453b6775c3b3
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549552d0>
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b95ec648-e27a-5a47-b460-f09e07adbbeb/b95ec648-e27a-5a47-b460-f09e07adbbeb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN22SLU%252F699188478%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188478/600 saved to cache
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b95ec648-e27a-5a47-b460-f09e07adbbeb
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547227410>
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2785a6e-33af-5eba-b84f-311143aa78be/e2785a6e-33af-5eba-b84f-311143aa78be_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE19UGD%252F699208282%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208282/600 saved to cache
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2785a6e-33af-5eba-b84f-311143aa78be
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554aa5310>
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b95ec648-e27a-5a47-b460-f09e07adbbeb/b95ec648-e27a-5a47-b460-f09e07adbbeb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN22SLU%252F699188484%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188484/600 saved to cache
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b95ec648-e27a-5a47-b460-f09e07adbbeb
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547227910>
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2faac3c-f66f-5c6b-825e-332b835cca02/c2faac3c-f66f-5c6b-825e-332b835cca02_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ14PYU%252F698994385%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994385/600 saved to cache
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c2faac3c-f66f-5c6b-825e-332b835cca02
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473d85d0>
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2785a6e-33af-5eba-b84f-311143aa78be/e2785a6e-33af-5eba-b84f-311143aa78be_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE19UGD%252F699208275%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208275/600 saved to cache
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2785a6e-33af-5eba-b84f-311143aa78be
2026-03-28 22:06:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2785a6e-33af-5eba-b84f-311143aa78be, skipping ID generation
2026-03-28 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2785a6e-33af-5eba-b84f-311143aa78be sending to next pipeline
2026-03-28 22:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e2785a6e-33af-5eba-b84f-311143aa78be, identifier: CE19%20UGD
2026-03-28 22:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e2785a6e-33af-5eba-b84f-311143aa78be with identifier: CE19%20UGD
2026-03-28 22:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e2785a6e-33af-5eba-b84f-311143aa78be with identifier: CE19%20UGD
2026-03-28 22:06:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e2785a6e-33af-5eba-b84f-311143aa78be with identifier: CE19%20UGD to the API
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208275/600>
{'auction_title': '',
'c_o_2_emission_value': 133,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2785a6e-33af-5eba-b84f-311143aa78be/e2785a6e-33af-5eba-b84f-311143aa78be_expert_report_file_f5271fbc-7e73-419e-a8c0-3c90a6ce55d5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CE19%20UGD-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 6,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e2785a6e-33af-5eba-b84f-311143aa78be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CE19 UGD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CE19%20UGD&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'MINI',
'model': 'CLUBMAN',
'odometer': 83001,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2785a6e-33af-5eba-b84f-311143aa78be/e2785a6e-33af-5eba-b84f-311143aa78be_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42663,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208275/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2785a6e-33af-5eba-b84f-311143aa78be/e2785a6e-33af-5eba-b84f-311143aa78be_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41563,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208282/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2785a6e-33af-5eba-b84f-311143aa78be/e2785a6e-33af-5eba-b84f-311143aa78be_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37108,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208292/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2785a6e-33af-5eba-b84f-311143aa78be/e2785a6e-33af-5eba-b84f-311143aa78be_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37602,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208302/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2785a6e-33af-5eba-b84f-311143aa78be/e2785a6e-33af-5eba-b84f-311143aa78be_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36373,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208311/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2785a6e-33af-5eba-b84f-311143aa78be/e2785a6e-33af-5eba-b84f-311143aa78be_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34496,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208316/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2785a6e-33af-5eba-b84f-311143aa78be/e2785a6e-33af-5eba-b84f-311143aa78be_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82307,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208333/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2785a6e-33af-5eba-b84f-311143aa78be/e2785a6e-33af-5eba-b84f-311143aa78be_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80247,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208351/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2785a6e-33af-5eba-b84f-311143aa78be/e2785a6e-33af-5eba-b84f-311143aa78be_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89698,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208370/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2785a6e-33af-5eba-b84f-311143aa78be/e2785a6e-33af-5eba-b84f-311143aa78be_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94145,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE19UGD/699208389/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'MINI CLUBMAN 2.0 COOPER S EXCLUSIVE Estate',
'transmission': 'automatic',
'trim': 'COOPER S EXCLUSIVE',
'vin': 'WMWJZ520002L19288',
'year': 2019}
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE19%2520UGD%27 HTTP/1.1" 200 None
2026-03-28 22:06:18 [bca.uk] INFO: Saving data for CE19%20UGD: {'created_time': 1774735578.336249, 'last_price_update_time': 1774735578.336259, 'auction_closing_time': 1774864800.0}
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CE19%2520UGD') HTTP/1.1" 204 0
2026-03-28 22:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146004/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV67VJU/42810955?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=pcdQ%2FQprBD1I89Z22aQT%2Fy%2FecVGPDfQATBl8G%2BxCxUw%3D)
2026-03-28 22:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188461/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN22SLU/42804593?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=hhNBBoBPvxsGjwiVsOUff1izuJYcAqLpIDtsYgB2%2FIY%3D)
2026-03-28 22:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158099/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK73EWD/42804333?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=5M4SgAmptrCJ8i0ARGkLnrB6V3wMXNdNGY6VCvEo%2F%2FI%3D)
2026-03-28 22:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994368/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ14PYU/42810573?sv=2020-08-04&st=2026-03-28T22%3A05%3A56Z&se=2026-03-28T22%3A30%3A56Z&sr=b&sp=r&sig=tkEo323ohrihOZXVnqm5FOYri5pOdaZiZLNiiyp2Vog%3D)
2026-03-28 22:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188468/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN22SLU/42804593?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=hhNBBoBPvxsGjwiVsOUff1izuJYcAqLpIDtsYgB2%2FIY%3D)
2026-03-28 22:06:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP58SRV/42811050?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=DaOCdMHzkQgJyUt%2BrWSjo2kz0u2ypMaZ1Rq1vMqPeao%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KP58%20SRV-GB>
2026-03-28 22:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146011/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV67VJU/42810955?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=pcdQ%2FQprBD1I89Z22aQT%2Fy%2FecVGPDfQATBl8G%2BxCxUw%3D)
2026-03-28 22:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158104/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK73EWD/42804333?sv=2020-08-04&st=2026-03-28T22%3A05%3A59Z&se=2026-03-28T22%3A30%3A59Z&sr=b&sp=r&sig=5M4SgAmptrCJ8i0ARGkLnrB6V3wMXNdNGY6VCvEo%2F%2FI%3D)
2026-03-28 22:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253456/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK65LPO/42809710?sv=2020-08-04&st=2026-03-28T22%3A05%3A20Z&se=2026-03-28T22%3A30%3A20Z&sr=b&sp=r&sig=oYxianEWP158PMpIdI%2Bc0WAWDjGi9DwdgesR7rPTi%2Bg%3D)
2026-03-28 22:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976103/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MW21AXB/42810470?sv=2020-08-04&st=2026-03-28T22%3A05%3A20Z&se=2026-03-28T22%3A30%3A20Z&sr=b&sp=r&sig=%2BrUdlzqIxAeDMjwos9mDVGiRE12qe2ahKjkgj9P6mZg%3D)
2026-03-28 22:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252925/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PFZ8482/42809655?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=TH37lPUKNzlJ9cPYi1xKA9ls4RZTQzngvd4d8Rd6Xgc%3D)
2026-03-28 22:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976154/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MW21AXB/42810470?sv=2020-08-04&st=2026-03-28T22%3A05%3A20Z&se=2026-03-28T22%3A30%3A20Z&sr=b&sp=r&sig=%2BrUdlzqIxAeDMjwos9mDVGiRE12qe2ahKjkgj9P6mZg%3D)
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472073d0>
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68511f88-68fc-5ac1-befe-453b6775c3b3/68511f88-68fc-5ac1-befe-453b6775c3b3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV67VJU%252F699146004%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146004/600 saved to cache
2026-03-28 22:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68511f88-68fc-5ac1-befe-453b6775c3b3
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547204a10>
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b95ec648-e27a-5a47-b460-f09e07adbbeb/b95ec648-e27a-5a47-b460-f09e07adbbeb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN22SLU%252F699188461%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188461/600 saved to cache
2026-03-28 22:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b95ec648-e27a-5a47-b460-f09e07adbbeb
2026-03-28 22:06:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253434/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253434>
2026-03-28 22:06:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP69ZFO/42810902?sv=2020-08-04&st=2026-03-28T22%3A06%3A18Z&se=2026-03-28T22%3A31%3A18Z&sr=b&sp=r&sig=UML8GIUegn3Nyj4HJOcKbNITmMDJOsnF532qVJDzw2o%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DP69%20ZFO-GB>
2026-03-28 22:06:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253427/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253427>
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473cdd50>
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e39c955-50ed-58e2-b150-dec2ff78b99f/8e39c955-50ed-58e2-b150-dec2ff78b99f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK73EWD%252F699158099%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158099/600 saved to cache
2026-03-28 22:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e39c955-50ed-58e2-b150-dec2ff78b99f
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547106550>
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2faac3c-f66f-5c6b-825e-332b835cca02/c2faac3c-f66f-5c6b-825e-332b835cca02_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ14PYU%252F698994368%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994368/600 saved to cache
2026-03-28 22:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2faac3c-f66f-5c6b-825e-332b835cca02
2026-03-28 22:06:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2faac3c-f66f-5c6b-825e-332b835cca02, skipping ID generation
2026-03-28 22:06:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2faac3c-f66f-5c6b-825e-332b835cca02 sending to next pipeline
2026-03-28 22:06:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c2faac3c-f66f-5c6b-825e-332b835cca02, identifier: EJ14%20PYU
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472072d0>
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b95ec648-e27a-5a47-b460-f09e07adbbeb/b95ec648-e27a-5a47-b460-f09e07adbbeb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN22SLU%252F699188468%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188468/600 saved to cache
2026-03-28 22:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b95ec648-e27a-5a47-b460-f09e07adbbeb
2026-03-28 22:06:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b95ec648-e27a-5a47-b460-f09e07adbbeb, skipping ID generation
2026-03-28 22:06:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b95ec648-e27a-5a47-b460-f09e07adbbeb sending to next pipeline
2026-03-28 22:06:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b95ec648-e27a-5a47-b460-f09e07adbbeb, identifier: CN22%20SLU
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555c6de10>
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68511f88-68fc-5ac1-befe-453b6775c3b3/68511f88-68fc-5ac1-befe-453b6775c3b3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV67VJU%252F699146011%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146011/600 saved to cache
2026-03-28 22:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 68511f88-68fc-5ac1-befe-453b6775c3b3
2026-03-28 22:06:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68511f88-68fc-5ac1-befe-453b6775c3b3, skipping ID generation
2026-03-28 22:06:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68511f88-68fc-5ac1-befe-453b6775c3b3 sending to next pipeline
2026-03-28 22:06:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 68511f88-68fc-5ac1-befe-453b6775c3b3, identifier: OV67%20VJU
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55729b910>
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e39c955-50ed-58e2-b150-dec2ff78b99f/8e39c955-50ed-58e2-b150-dec2ff78b99f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK73EWD%252F699158104%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158104/600 saved to cache
2026-03-28 22:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e39c955-50ed-58e2-b150-dec2ff78b99f
2026-03-28 22:06:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e39c955-50ed-58e2-b150-dec2ff78b99f, skipping ID generation
2026-03-28 22:06:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e39c955-50ed-58e2-b150-dec2ff78b99f sending to next pipeline
2026-03-28 22:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8e39c955-50ed-58e2-b150-dec2ff78b99f, identifier: HK73%20EWD
2026-03-28 22:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF68HMX/42810701?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=VJkB3V1eYsfB99bax5tHm9xSKTZvKZqqHjZcNzH%2BIG0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ71WSN/42810927?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=99Y%2F2O0XgNIgp1TnOJNknTQ6RKH%2BfHRxWx3tjIKgxWM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c2faac3c-f66f-5c6b-825e-332b835cca02 with identifier: EJ14%20PYU
2026-03-28 22:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c2faac3c-f66f-5c6b-825e-332b835cca02 with identifier: EJ14%20PYU
2026-03-28 22:06:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c2faac3c-f66f-5c6b-825e-332b835cca02 with identifier: EJ14%20PYU to the API
2026-03-28 22:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994368/600>
{'auction_title': '',
'c_o_2_emission_value': 98,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2faac3c-f66f-5c6b-825e-332b835cca02/c2faac3c-f66f-5c6b-825e-332b835cca02_expert_report_file_a021ff63-ed4b-43e8-a3eb-822b6956630f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EJ14%20PYU-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c2faac3c-f66f-5c6b-825e-332b835cca02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EJ14 PYU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EJ14%20PYU&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '2008',
'odometer': 82620,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2faac3c-f66f-5c6b-825e-332b835cca02/c2faac3c-f66f-5c6b-825e-332b835cca02_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39588,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994368/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2faac3c-f66f-5c6b-825e-332b835cca02/c2faac3c-f66f-5c6b-825e-332b835cca02_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41010,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994385/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2faac3c-f66f-5c6b-825e-332b835cca02/c2faac3c-f66f-5c6b-825e-332b835cca02_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40949,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994404/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2faac3c-f66f-5c6b-825e-332b835cca02/c2faac3c-f66f-5c6b-825e-332b835cca02_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40094,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994415/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2faac3c-f66f-5c6b-825e-332b835cca02/c2faac3c-f66f-5c6b-825e-332b835cca02_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38606,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994428/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2faac3c-f66f-5c6b-825e-332b835cca02/c2faac3c-f66f-5c6b-825e-332b835cca02_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38087,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994454/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2faac3c-f66f-5c6b-825e-332b835cca02/c2faac3c-f66f-5c6b-825e-332b835cca02_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93588,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994481/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2faac3c-f66f-5c6b-825e-332b835cca02/c2faac3c-f66f-5c6b-825e-332b835cca02_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68608,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994514/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2faac3c-f66f-5c6b-825e-332b835cca02/c2faac3c-f66f-5c6b-825e-332b835cca02_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87965,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994541/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2faac3c-f66f-5c6b-825e-332b835cca02/c2faac3c-f66f-5c6b-825e-332b835cca02_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88983,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ14PYU/698994575/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'PEUGEOT 2008 1.6 E-HDI ACTIVE EGC MPV',
'transmission': 'automatic',
'trim': 'E-HDI ACTIVE EGC',
'vin': 'VF3CU9HP8EY069706',
'year': 2014}
2026-03-28 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ14%2520PYU%27 HTTP/1.1" 200 None
2026-03-28 22:06:19 [bca.uk] INFO: Saving data for EJ14%20PYU: {'created_time': 1774735579.469298, 'last_price_update_time': 1774735579.469312, 'auction_closing_time': 1774864800.0}
2026-03-28 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EJ14%2520PYU') HTTP/1.1" 204 0
2026-03-28 22:06:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b95ec648-e27a-5a47-b460-f09e07adbbeb with identifier: CN22%20SLU
2026-03-28 22:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b95ec648-e27a-5a47-b460-f09e07adbbeb with identifier: CN22%20SLU
2026-03-28 22:06:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b95ec648-e27a-5a47-b460-f09e07adbbeb with identifier: CN22%20SLU to the API
2026-03-28 22:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188468/600>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b95ec648-e27a-5a47-b460-f09e07adbbeb/b95ec648-e27a-5a47-b460-f09e07adbbeb_expert_report_file_9ab6a484-ec04-4179-80fd-72f9b2eb2762.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CN22%20SLU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b95ec648-e27a-5a47-b460-f09e07adbbeb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CN22 SLU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CN22%20SLU&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'MAZDA',
'model': '3',
'odometer': 48101,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b95ec648-e27a-5a47-b460-f09e07adbbeb/b95ec648-e27a-5a47-b460-f09e07adbbeb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38986,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188461/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b95ec648-e27a-5a47-b460-f09e07adbbeb/b95ec648-e27a-5a47-b460-f09e07adbbeb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38843,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188468/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b95ec648-e27a-5a47-b460-f09e07adbbeb/b95ec648-e27a-5a47-b460-f09e07adbbeb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38362,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188478/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b95ec648-e27a-5a47-b460-f09e07adbbeb/b95ec648-e27a-5a47-b460-f09e07adbbeb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39495,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188484/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b95ec648-e27a-5a47-b460-f09e07adbbeb/b95ec648-e27a-5a47-b460-f09e07adbbeb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36880,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188493/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b95ec648-e27a-5a47-b460-f09e07adbbeb/b95ec648-e27a-5a47-b460-f09e07adbbeb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35814,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188500/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b95ec648-e27a-5a47-b460-f09e07adbbeb/b95ec648-e27a-5a47-b460-f09e07adbbeb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70642,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188514/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b95ec648-e27a-5a47-b460-f09e07adbbeb/b95ec648-e27a-5a47-b460-f09e07adbbeb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55358,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188526/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b95ec648-e27a-5a47-b460-f09e07adbbeb/b95ec648-e27a-5a47-b460-f09e07adbbeb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76101,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188548/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b95ec648-e27a-5a47-b460-f09e07adbbeb/b95ec648-e27a-5a47-b460-f09e07adbbeb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79140,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN22SLU/699188557/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'MAZDA 3 2.0 E-SKY-G MHEV SE-L LUX Hatchback',
'transmission': 'manual',
'trim': 'E-SKY-G MHEV SE-L LUX',
'vin': 'JM4BP6HE601306558',
'year': 2022}
2026-03-28 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN22%2520SLU%27 HTTP/1.1" 200 None
2026-03-28 22:06:19 [bca.uk] INFO: Saving data for CN22%20SLU: {'created_time': 1774735579.849802, 'last_price_update_time': 1774735579.849812, 'auction_closing_time': 1774864800.0}
2026-03-28 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CN22%2520SLU') HTTP/1.1" 204 0
2026-03-28 22:06:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 68511f88-68fc-5ac1-befe-453b6775c3b3 with identifier: OV67%20VJU
2026-03-28 22:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 68511f88-68fc-5ac1-befe-453b6775c3b3 with identifier: OV67%20VJU
2026-03-28 22:06:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 68511f88-68fc-5ac1-befe-453b6775c3b3 with identifier: OV67%20VJU to the API
2026-03-28 22:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146011/600>
{'auction_title': '',
'c_o_2_emission_value': 101,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68511f88-68fc-5ac1-befe-453b6775c3b3/68511f88-68fc-5ac1-befe-453b6775c3b3_expert_report_file_5d9df9f2-fb35-4933-ad9e-836ba009696b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV67%20VJU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '68511f88-68fc-5ac1-befe-453b6775c3b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OV67 VJU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OV67%20VJU&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'SKODA',
'model': 'FABIA',
'odometer': 59182,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68511f88-68fc-5ac1-befe-453b6775c3b3/68511f88-68fc-5ac1-befe-453b6775c3b3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46125,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146004/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68511f88-68fc-5ac1-befe-453b6775c3b3/68511f88-68fc-5ac1-befe-453b6775c3b3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43272,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146011/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68511f88-68fc-5ac1-befe-453b6775c3b3/68511f88-68fc-5ac1-befe-453b6775c3b3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43947,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146020/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68511f88-68fc-5ac1-befe-453b6775c3b3/68511f88-68fc-5ac1-befe-453b6775c3b3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44558,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146025/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68511f88-68fc-5ac1-befe-453b6775c3b3/68511f88-68fc-5ac1-befe-453b6775c3b3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44619,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146032/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68511f88-68fc-5ac1-befe-453b6775c3b3/68511f88-68fc-5ac1-befe-453b6775c3b3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43859,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146039/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68511f88-68fc-5ac1-befe-453b6775c3b3/68511f88-68fc-5ac1-befe-453b6775c3b3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84366,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146051/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68511f88-68fc-5ac1-befe-453b6775c3b3/68511f88-68fc-5ac1-befe-453b6775c3b3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66142,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146059/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68511f88-68fc-5ac1-befe-453b6775c3b3/68511f88-68fc-5ac1-befe-453b6775c3b3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84661,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146070/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68511f88-68fc-5ac1-befe-453b6775c3b3/68511f88-68fc-5ac1-befe-453b6775c3b3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72363,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV67VJU/699146080/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'SKODA FABIA 1.0 TSI 95 COLOUR EDITION Hatchback',
'transmission': 'manual',
'trim': 'TSI 95 COLOUR EDITION',
'vin': 'TMBFP6NJ8JZ129286',
'year': 2018}
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV67%2520VJU%27 HTTP/1.1" 200 None
2026-03-28 22:06:20 [bca.uk] INFO: Saving data for OV67%20VJU: {'created_time': 1774735580.269931, 'last_price_update_time': 1774735580.269943, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OV67%2520VJU') HTTP/1.1" 204 0
2026-03-28 22:06:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8e39c955-50ed-58e2-b150-dec2ff78b99f with identifier: HK73%20EWD
2026-03-28 22:06:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8e39c955-50ed-58e2-b150-dec2ff78b99f with identifier: HK73%20EWD
2026-03-28 22:06:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8e39c955-50ed-58e2-b150-dec2ff78b99f with identifier: HK73%20EWD to the API
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158104/600>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e39c955-50ed-58e2-b150-dec2ff78b99f/8e39c955-50ed-58e2-b150-dec2ff78b99f_expert_report_file_b03704b2-79e4-4e86-bb20-1dc6ba0d6942.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK73%20EWD-GB',
'category': 'Car',
'color': 'orange',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8e39c955-50ed-58e2-b150-dec2ff78b99f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HK73 EWD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HK73%20EWD&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'MG MOTOR UK',
'model': 'ZS',
'odometer': 21872,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e39c955-50ed-58e2-b150-dec2ff78b99f/8e39c955-50ed-58e2-b150-dec2ff78b99f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49576,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158099/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e39c955-50ed-58e2-b150-dec2ff78b99f/8e39c955-50ed-58e2-b150-dec2ff78b99f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50381,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158104/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e39c955-50ed-58e2-b150-dec2ff78b99f/8e39c955-50ed-58e2-b150-dec2ff78b99f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49171,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158108/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e39c955-50ed-58e2-b150-dec2ff78b99f/8e39c955-50ed-58e2-b150-dec2ff78b99f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48184,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158113/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e39c955-50ed-58e2-b150-dec2ff78b99f/8e39c955-50ed-58e2-b150-dec2ff78b99f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43596,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158116/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e39c955-50ed-58e2-b150-dec2ff78b99f/8e39c955-50ed-58e2-b150-dec2ff78b99f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44183,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158122/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e39c955-50ed-58e2-b150-dec2ff78b99f/8e39c955-50ed-58e2-b150-dec2ff78b99f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101243,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158138/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e39c955-50ed-58e2-b150-dec2ff78b99f/8e39c955-50ed-58e2-b150-dec2ff78b99f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85004,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158151/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e39c955-50ed-58e2-b150-dec2ff78b99f/8e39c955-50ed-58e2-b150-dec2ff78b99f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89080,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158163/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e39c955-50ed-58e2-b150-dec2ff78b99f/8e39c955-50ed-58e2-b150-dec2ff78b99f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67606,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK73EWD/699158174/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'MG MOTOR UK ZS 1.0 T GDI EXCLUSIVE Hatchback',
'transmission': 'manual',
'trim': 'T GDI EXCLUSIVE',
'vin': 'LSJW74C99PZ313270',
'year': 2023}
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK73%2520EWD%27 HTTP/1.1" 200 None
2026-03-28 22:06:20 [bca.uk] INFO: Saving data for HK73%20EWD: {'created_time': 1774735580.664539, 'last_price_update_time': 1774735580.664549, 'auction_closing_time': 1774864800.0}
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HK73%2520EWD') HTTP/1.1" 204 0
2026-03-28 22:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV70FXU/42810883?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=FPY2a%2BwTPBX3%2FgfHv4tGqy5Xp%2BqnbitwV6VOtdx3RWA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554ae0a10>
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a373065-9147-5214-8a56-d55636e4875e/7a373065-9147-5214-8a56-d55636e4875e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK65LPO%252F699253456%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253456/600 saved to cache
2026-03-28 22:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7a373065-9147-5214-8a56-d55636e4875e
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b649d0>
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec532b91-2d62-5ebd-830b-087067e8ed90/ec532b91-2d62-5ebd-830b-087067e8ed90_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMW21AXB%252F698976103%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976103/600 saved to cache
2026-03-28 22:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec532b91-2d62-5ebd-830b-087067e8ed90
2026-03-28 22:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208440/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208440>
2026-03-28 22:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234724/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234724>
2026-03-28 22:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976054/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MW21AXB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547703110>
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9700af5-622f-5b72-9af3-28e1d8f91693/b9700af5-622f-5b72-9af3-28e1d8f91693_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPFZ8482%252F699252925%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252925/600 saved to cache
2026-03-28 22:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b9700af5-622f-5b72-9af3-28e1d8f91693
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554aa4bd0>
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec532b91-2d62-5ebd-830b-087067e8ed90/ec532b91-2d62-5ebd-830b-087067e8ed90_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMW21AXB%252F698976154%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976154/600 saved to cache
2026-03-28 22:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec532b91-2d62-5ebd-830b-087067e8ed90
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55711ef50>
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c669890-4fd5-5f63-8a29-4ca91e40fe4b/9c669890-4fd5-5f63-8a29-4ca91e40fe4b_expert_report_file_1bee9051-2645-467c-b0ee-8e51c430b628.pdf HTTP/1.1" 201 0
2026-03-28 22:06:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9c669890-4fd5-5f63-8a29-4ca91e40fe4b
2026-03-28 22:06:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c669890-4fd5-5f63-8a29-4ca91e40fe4b, skipping ID generation
2026-03-28 22:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9c669890-4fd5-5f63-8a29-4ca91e40fe4b
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAF68HMX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AF68HMX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547390d50>
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce69b670-8852-55c2-be68-a54396142524/ce69b670-8852-55c2-be68-a54396142524_expert_report_file_2a2314ed-bdb8-45ae-b9be-14ba10952da5.pdf HTTP/1.1" 201 0
2026-03-28 22:06:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ce69b670-8852-55c2-be68-a54396142524
2026-03-28 22:06:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce69b670-8852-55c2-be68-a54396142524, skipping ID generation
2026-03-28 22:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ce69b670-8852-55c2-be68-a54396142524
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGJ71WSN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GJ71WSN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP58SRV/42811050?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=DaOCdMHzkQgJyUt%2BrWSjo2kz0u2ypMaZ1Rq1vMqPeao%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253427/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK65LPO/42809710?sv=2020-08-04&st=2026-03-28T22%3A05%3A20Z&se=2026-03-28T22%3A30%3A20Z&sr=b&sp=r&sig=oYxianEWP158PMpIdI%2Bc0WAWDjGi9DwdgesR7rPTi%2Bg%3D)
2026-03-28 22:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246109/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246109>
2026-03-28 22:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252867/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252867>
2026-03-28 22:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU09ZBO/42804375?sv=2020-08-04&st=2026-03-28T22%3A06%3A20Z&se=2026-03-28T22%3A31%3A20Z&sr=b&sp=r&sig=RN8i065PmmEvJhQd4a1aNT2MQopoicKXAwhsLdscQss%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU09%20ZBO-GB>
2026-03-28 22:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208420/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208420>
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142134%27 HTTP/1.1" 200 None
2026-03-28 22:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142134 not downloaded yet
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011381%27 HTTP/1.1" 200 None
2026-03-28 22:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011381 not downloaded yet
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554aa78d0>
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c91238b-60eb-5c43-b2e1-23b211f67d90/1c91238b-60eb-5c43-b2e1-23b211f67d90_expert_report_file_6a2c6b15-f7da-4933-8c90-ab5385c45fa8.pdf HTTP/1.1" 201 0
2026-03-28 22:06:21 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1c91238b-60eb-5c43-b2e1-23b211f67d90
2026-03-28 22:06:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c91238b-60eb-5c43-b2e1-23b211f67d90, skipping ID generation
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1c91238b-60eb-5c43-b2e1-23b211f67d90
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWV70FXU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WV70FXU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT05ONJ/42810976?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=5MixAqDo0hxRmLUvG5M%2B4PG7rAb3blo5qbHfZngnDeI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD20VFR/42811012?sv=2020-08-04&st=2026-03-28T22%3A06%3A20Z&se=2026-03-28T22%3A31%3A20Z&sr=b&sp=r&sig=MyaAAS4vzNk5eSde8IAEaU9p72KXqy1v4RjR%2FWBJ3yo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD20%20VFR-GB>
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142144%27 HTTP/1.1" 200 None
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142144 not downloaded yet
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011394%27 HTTP/1.1" 200 None
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011394 not downloaded yet
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002776%27 HTTP/1.1" 200 None
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002776 not downloaded yet
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142153%27 HTTP/1.1" 200 None
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142153 not downloaded yet
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011408%27 HTTP/1.1" 200 None
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011408 not downloaded yet
2026-03-28 22:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253434/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK65LPO/42809710?sv=2020-08-04&st=2026-03-28T22%3A05%3A20Z&se=2026-03-28T22%3A30%3A20Z&sr=b&sp=r&sig=oYxianEWP158PMpIdI%2Bc0WAWDjGi9DwdgesR7rPTi%2Bg%3D)
2026-03-28 22:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976054/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MW21AXB/42810470?sv=2020-08-04&st=2026-03-28T22%3A05%3A20Z&se=2026-03-28T22%3A30%3A20Z&sr=b&sp=r&sig=%2BrUdlzqIxAeDMjwos9mDVGiRE12qe2ahKjkgj9P6mZg%3D)
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002789%27 HTTP/1.1" 200 None
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002789 not downloaded yet
2026-03-28 22:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471157d0>
2026-03-28 22:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dae85f49-83c1-5309-bd8a-55acf0d1d837/dae85f49-83c1-5309-bd8a-55acf0d1d837_expert_report_file_a51b35a3-0bf4-4cf6-aebc-ba53e1484a44.pdf HTTP/1.1" 201 0
2026-03-28 22:06:21 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item dae85f49-83c1-5309-bd8a-55acf0d1d837
2026-03-28 22:06:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dae85f49-83c1-5309-bd8a-55acf0d1d837, skipping ID generation
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dae85f49-83c1-5309-bd8a-55acf0d1d837
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKP58SRV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KP58SRV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544e3910>
2026-03-28 22:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a373065-9147-5214-8a56-d55636e4875e/7a373065-9147-5214-8a56-d55636e4875e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK65LPO%252F699253427%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253427/600 saved to cache
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7a373065-9147-5214-8a56-d55636e4875e
2026-03-28 22:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP69ZFO/42810902?sv=2020-08-04&st=2026-03-28T22%3A06%3A18Z&se=2026-03-28T22%3A31%3A18Z&sr=b&sp=r&sig=UML8GIUegn3Nyj4HJOcKbNITmMDJOsnF532qVJDzw2o%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253415/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VK65LPO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234673/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234673>
2026-03-28 22:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246097/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246097>
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142168%27 HTTP/1.1" 200 None
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142168 not downloaded yet
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011422%27 HTTP/1.1" 200 None
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011422 not downloaded yet
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002807%27 HTTP/1.1" 200 None
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002807 not downloaded yet
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144824%27 HTTP/1.1" 200 None
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144824 not downloaded yet
2026-03-28 22:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547dc990>
2026-03-28 22:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08b948d7-14c0-5cfd-b5ed-455492122930/08b948d7-14c0-5cfd-b5ed-455492122930_expert_report_file_ee202c17-389c-4a0f-93a0-cae29e5f802d.pdf HTTP/1.1" 201 0
2026-03-28 22:06:21 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 08b948d7-14c0-5cfd-b5ed-455492122930
2026-03-28 22:06:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08b948d7-14c0-5cfd-b5ed-455492122930, skipping ID generation
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 08b948d7-14c0-5cfd-b5ed-455492122930
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLT05ONJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LT05ONJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208440/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU68LVG/42800882?sv=2020-08-04&st=2026-03-28T22%3A05%3A12Z&se=2026-03-28T22%3A30%3A12Z&sr=b&sp=r&sig=NJDddzay8QfXZCkDpDoajXCukxQxXVptkxb3qmj1KmE%3D)
2026-03-28 22:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234724/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO65VXH/42775624?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=slIW%2B3iwvDchqJURAJRdLEGkYLYSjXVM0OamBF34cz0%3D)
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142180%27 HTTP/1.1" 200 None
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142180 not downloaded yet
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011436%27 HTTP/1.1" 200 None
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011436 not downloaded yet
2026-03-28 22:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208400/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208400>
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002822%27 HTTP/1.1" 200 None
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002822 not downloaded yet
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144829%27 HTTP/1.1" 200 None
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144829 not downloaded yet
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145423%27 HTTP/1.1" 200 None
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145423 not downloaded yet
2026-03-28 22:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208420/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU68LVG/42800882?sv=2020-08-04&st=2026-03-28T22%3A05%3A12Z&se=2026-03-28T22%3A30%3A12Z&sr=b&sp=r&sig=NJDddzay8QfXZCkDpDoajXCukxQxXVptkxb3qmj1KmE%3D)
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142198%27 HTTP/1.1" 200 None
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142198 not downloaded yet
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011472%27 HTTP/1.1" 200 None
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011472 not downloaded yet
2026-03-28 22:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557298c90>
2026-03-28 22:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a373065-9147-5214-8a56-d55636e4875e/7a373065-9147-5214-8a56-d55636e4875e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK65LPO%252F699253434%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253434/600 saved to cache
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7a373065-9147-5214-8a56-d55636e4875e
2026-03-28 22:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fc70d0>
2026-03-28 22:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec532b91-2d62-5ebd-830b-087067e8ed90/ec532b91-2d62-5ebd-830b-087067e8ed90_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMW21AXB%252F698976054%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976054/600 saved to cache
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec532b91-2d62-5ebd-830b-087067e8ed90
2026-03-28 22:06:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec532b91-2d62-5ebd-830b-087067e8ed90, skipping ID generation
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec532b91-2d62-5ebd-830b-087067e8ed90 sending to next pipeline
2026-03-28 22:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ec532b91-2d62-5ebd-830b-087067e8ed90, identifier: MW21%20AXB
2026-03-28 22:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f98a50>
2026-03-28 22:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ae84d00-f082-5222-b51d-cfbb89091e57/8ae84d00-f082-5222-b51d-cfbb89091e57_expert_report_file_70d97c62-f535-4deb-9633-9c90d295799e.pdf HTTP/1.1" 201 0
2026-03-28 22:06:21 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8ae84d00-f082-5222-b51d-cfbb89091e57
2026-03-28 22:06:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ae84d00-f082-5222-b51d-cfbb89091e57, skipping ID generation
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ae84d00-f082-5222-b51d-cfbb89091e57
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDP69ZFO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DP69ZFO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246109/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB11OWR/42809523?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=%2BXPbFoBXFln5oK0NHPy9dGoxYCx5FDGBaSdCO93wM50%3D)
2026-03-28 22:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011370/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GJ71WSN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002760/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WV70FXU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002844%27 HTTP/1.1" 200 None
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002844 not downloaded yet
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144835%27 HTTP/1.1" 200 None
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144835 not downloaded yet
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145430%27 HTTP/1.1" 200 None
2026-03-28 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145430 not downloaded yet
2026-03-28 22:06:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ec532b91-2d62-5ebd-830b-087067e8ed90 with identifier: MW21%20AXB
2026-03-28 22:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ec532b91-2d62-5ebd-830b-087067e8ed90 with identifier: MW21%20AXB
2026-03-28 22:06:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ec532b91-2d62-5ebd-830b-087067e8ed90 with identifier: MW21%20AXB to the API
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976054/600>
{'auction_title': '',
'c_o_2_emission_value': 32,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec532b91-2d62-5ebd-830b-087067e8ed90/ec532b91-2d62-5ebd-830b-087067e8ed90_expert_report_file_3a32d7f8-d987-474e-8c78-789d317d6b7a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MW21%20AXB-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'ec532b91-2d62-5ebd-830b-087067e8ed90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MW21 AXB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MW21%20AXB&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'KIA',
'model': 'XCEED',
'odometer': 120359,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec532b91-2d62-5ebd-830b-087067e8ed90/ec532b91-2d62-5ebd-830b-087067e8ed90_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39305,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976054/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec532b91-2d62-5ebd-830b-087067e8ed90/ec532b91-2d62-5ebd-830b-087067e8ed90_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39103,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976068/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec532b91-2d62-5ebd-830b-087067e8ed90/ec532b91-2d62-5ebd-830b-087067e8ed90_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40103,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976086/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec532b91-2d62-5ebd-830b-087067e8ed90/ec532b91-2d62-5ebd-830b-087067e8ed90_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41101,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976103/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec532b91-2d62-5ebd-830b-087067e8ed90/ec532b91-2d62-5ebd-830b-087067e8ed90_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36436,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976128/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec532b91-2d62-5ebd-830b-087067e8ed90/ec532b91-2d62-5ebd-830b-087067e8ed90_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35432,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976154/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec532b91-2d62-5ebd-830b-087067e8ed90/ec532b91-2d62-5ebd-830b-087067e8ed90_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87254,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976177/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec532b91-2d62-5ebd-830b-087067e8ed90/ec532b91-2d62-5ebd-830b-087067e8ed90_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76010,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976203/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec532b91-2d62-5ebd-830b-087067e8ed90/ec532b91-2d62-5ebd-830b-087067e8ed90_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93273,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976233/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec532b91-2d62-5ebd-830b-087067e8ed90/ec532b91-2d62-5ebd-830b-087067e8ed90_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99596,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW21AXB/698976273/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'KIA XCEED 1.6 GDI PHEV 3 DCT Hatchback',
'transmission': 'automatic',
'trim': 'GDI PHEV 3 DCT',
'vin': 'U5YH5F1AVML016396',
'year': 2021}
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW21%2520AXB%27 HTTP/1.1" 200 None
2026-03-28 22:06:22 [bca.uk] INFO: Saving data for MW21%20AXB: {'created_time': 1774735582.374547, 'last_price_update_time': 1774735582.374559, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MW21%2520AXB') HTTP/1.1" 204 0
2026-03-28 22:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252867/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PFZ8482/42809655?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=TH37lPUKNzlJ9cPYi1xKA9ls4RZTQzngvd4d8Rd6Xgc%3D)
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142219%27 HTTP/1.1" 200 None
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142219 not downloaded yet
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011517%27 HTTP/1.1" 200 None
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011517 not downloaded yet
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002710%27 HTTP/1.1" 200 None
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002710 not downloaded yet
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473d95d0>
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73e9fcad-8a90-5e2f-8b8b-a9df139e02bc/73e9fcad-8a90-5e2f-8b8b-a9df139e02bc_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU68LVG%252F699208440%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208440/600 saved to cache
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471cfed0>
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced2c5eb-991e-54e7-b6dd-6b7667db3844/ced2c5eb-991e-54e7-b6dd-6b7667db3844_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO65VXH%252F699234724%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234724/600 saved to cache
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ced2c5eb-991e-54e7-b6dd-6b7667db3844
2026-03-28 22:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD20VFR/42811012?sv=2020-08-04&st=2026-03-28T22%3A06%3A20Z&se=2026-03-28T22%3A31%3A20Z&sr=b&sp=r&sig=MyaAAS4vzNk5eSde8IAEaU9p72KXqy1v4RjR%2FWBJ3yo%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011394/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011394>
2026-03-28 22:06:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002776/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002776>
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002896%27 HTTP/1.1" 200 None
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002896 not downloaded yet
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144842%27 HTTP/1.1" 200 None
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144842 not downloaded yet
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145437%27 HTTP/1.1" 200 None
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145437 not downloaded yet
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142240%27 HTTP/1.1" 200 None
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142240 not downloaded yet
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011543%27 HTTP/1.1" 200 None
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011543 not downloaded yet
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002720%27 HTTP/1.1" 200 None
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002720 not downloaded yet
2026-03-28 22:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU09ZBO/42804375?sv=2020-08-04&st=2026-03-28T22%3A06%3A20Z&se=2026-03-28T22%3A31%3A20Z&sr=b&sp=r&sig=RN8i065PmmEvJhQd4a1aNT2MQopoicKXAwhsLdscQss%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253415/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK65LPO/42809710?sv=2020-08-04&st=2026-03-28T22%3A05%3A20Z&se=2026-03-28T22%3A30%3A20Z&sr=b&sp=r&sig=oYxianEWP158PMpIdI%2Bc0WAWDjGi9DwdgesR7rPTi%2Bg%3D)
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002936%27 HTTP/1.1" 200 None
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002936 not downloaded yet
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144846%27 HTTP/1.1" 200 None
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144846 not downloaded yet
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145446%27 HTTP/1.1" 200 None
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145446 not downloaded yet
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54738ff50>
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73e9fcad-8a90-5e2f-8b8b-a9df139e02bc/73e9fcad-8a90-5e2f-8b8b-a9df139e02bc_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU68LVG%252F699208420%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208420/600 saved to cache
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547202550>
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff2a82d-f7ab-592a-a781-86aaae91d694/6ff2a82d-f7ab-592a-a781-86aaae91d694_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB11OWR%252F699246109%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246109/600 saved to cache
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6ff2a82d-f7ab-592a-a781-86aaae91d694
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55437bdd0>
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9700af5-622f-5b72-9af3-28e1d8f91693/b9700af5-622f-5b72-9af3-28e1d8f91693_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPFZ8482%252F699252867%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252867/600 saved to cache
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b9700af5-622f-5b72-9af3-28e1d8f91693
2026-03-28 22:06:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144815/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KP58SRV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246097/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB11OWR/42809523?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=%2BXPbFoBXFln5oK0NHPy9dGoxYCx5FDGBaSdCO93wM50%3D)
2026-03-28 22:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234673/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO65VXH/42775624?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=slIW%2B3iwvDchqJURAJRdLEGkYLYSjXVM0OamBF34cz0%3D)
2026-03-28 22:06:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011422/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011422>
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142254%27 HTTP/1.1" 200 None
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142254 not downloaded yet
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011565%27 HTTP/1.1" 200 None
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011565 not downloaded yet
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002734%27 HTTP/1.1" 200 None
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002734 not downloaded yet
2026-03-28 22:06:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142168/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142168>
2026-03-28 22:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208400/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU68LVG/42800882?sv=2020-08-04&st=2026-03-28T22%3A05%3A12Z&se=2026-03-28T22%3A30%3A12Z&sr=b&sp=r&sig=NJDddzay8QfXZCkDpDoajXCukxQxXVptkxb3qmj1KmE%3D)
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002965%27 HTTP/1.1" 200 None
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002965 not downloaded yet
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144855%27 HTTP/1.1" 200 None
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144855 not downloaded yet
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145450%27 HTTP/1.1" 200 None
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145450 not downloaded yet
2026-03-28 22:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002760/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV70FXU/42810883?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=FPY2a%2BwTPBX3%2FgfHv4tGqy5Xp%2BqnbitwV6VOtdx3RWA%3D)
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002745%27 HTTP/1.1" 200 None
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002745 not downloaded yet
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473b9050>
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e42f65-62fc-5369-aa50-0828074023cd/e2e42f65-62fc-5369-aa50-0828074023cd_expert_report_file_83d65fbb-983e-4853-bf0a-fc7be9dcdade.pdf HTTP/1.1" 201 0
2026-03-28 22:06:22 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e2e42f65-62fc-5369-aa50-0828074023cd
2026-03-28 22:06:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2e42f65-62fc-5369-aa50-0828074023cd, skipping ID generation
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e2e42f65-62fc-5369-aa50-0828074023cd
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLD20VFR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD20VFR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477ce2d0>
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d01a147-3afb-5ecc-8676-b197cf6baca3/1d01a147-3afb-5ecc-8676-b197cf6baca3_expert_report_file_be65850d-2bf0-47e3-b5df-35b3add9d37a.pdf HTTP/1.1" 201 0
2026-03-28 22:06:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1d01a147-3afb-5ecc-8676-b197cf6baca3
2026-03-28 22:06:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d01a147-3afb-5ecc-8676-b197cf6baca3, skipping ID generation
2026-03-28 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d01a147-3afb-5ecc-8676-b197cf6baca3
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGU09ZBO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GU09ZBO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554849c10>
2026-03-28 22:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a373065-9147-5214-8a56-d55636e4875e/7a373065-9147-5214-8a56-d55636e4875e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK65LPO%252F699253415%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253415/600 saved to cache
2026-03-28 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a373065-9147-5214-8a56-d55636e4875e
2026-03-28 22:06:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a373065-9147-5214-8a56-d55636e4875e, skipping ID generation
2026-03-28 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a373065-9147-5214-8a56-d55636e4875e sending to next pipeline
2026-03-28 22:06:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7a373065-9147-5214-8a56-d55636e4875e, identifier: VK65%20LPO
2026-03-28 22:06:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011436/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011436>
2026-03-28 22:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002776/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV70FXU/42810883?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=FPY2a%2BwTPBX3%2FgfHv4tGqy5Xp%2BqnbitwV6VOtdx3RWA%3D)
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002990%27 HTTP/1.1" 200 None
2026-03-28 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002990 not downloaded yet
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144864%27 HTTP/1.1" 200 None
2026-03-28 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144864 not downloaded yet
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145465%27 HTTP/1.1" 200 None
2026-03-28 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145465 not downloaded yet
2026-03-28 22:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7a373065-9147-5214-8a56-d55636e4875e with identifier: VK65%20LPO
2026-03-28 22:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7a373065-9147-5214-8a56-d55636e4875e with identifier: VK65%20LPO
2026-03-28 22:06:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7a373065-9147-5214-8a56-d55636e4875e with identifier: VK65%20LPO to the API
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253415/600>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a373065-9147-5214-8a56-d55636e4875e/7a373065-9147-5214-8a56-d55636e4875e_expert_report_file_08d68f89-8bc7-4ebc-9ebf-a0fee49e7cc6.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VK65%20LPO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7a373065-9147-5214-8a56-d55636e4875e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VK65 LPO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VK65%20LPO&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 92111,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a373065-9147-5214-8a56-d55636e4875e/7a373065-9147-5214-8a56-d55636e4875e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37841,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253415/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a373065-9147-5214-8a56-d55636e4875e/7a373065-9147-5214-8a56-d55636e4875e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37147,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253423/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a373065-9147-5214-8a56-d55636e4875e/7a373065-9147-5214-8a56-d55636e4875e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36325,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253427/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a373065-9147-5214-8a56-d55636e4875e/7a373065-9147-5214-8a56-d55636e4875e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36414,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253434/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a373065-9147-5214-8a56-d55636e4875e/7a373065-9147-5214-8a56-d55636e4875e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34704,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253438/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a373065-9147-5214-8a56-d55636e4875e/7a373065-9147-5214-8a56-d55636e4875e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35114,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253445/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a373065-9147-5214-8a56-d55636e4875e/7a373065-9147-5214-8a56-d55636e4875e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87372,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253456/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a373065-9147-5214-8a56-d55636e4875e/7a373065-9147-5214-8a56-d55636e4875e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61997,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253466/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a373065-9147-5214-8a56-d55636e4875e/7a373065-9147-5214-8a56-d55636e4875e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72222,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253476/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a373065-9147-5214-8a56-d55636e4875e/7a373065-9147-5214-8a56-d55636e4875e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80427,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK65LPO/699253486/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.5 DCI ACENTA PREMIUM Hatchback',
'transmission': 'manual',
'trim': 'DCI ACENTA PREMIUM',
'vin': 'SJNFCAF15U7160265',
'year': 2015}
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK65%2520LPO%27 HTTP/1.1" 200 None
2026-03-28 22:06:23 [bca.uk] INFO: Saving data for VK65%20LPO: {'created_time': 1774735583.639104, 'last_price_update_time': 1774735583.639115, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VK65%2520LPO') HTTP/1.1" 204 0
2026-03-28 22:06:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011472/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011472>
2026-03-28 22:06:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002700/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DP69ZFO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011370/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ71WSN/42810927?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=99Y%2F2O0XgNIgp1TnOJNknTQ6RKH%2BfHRxWx3tjIKgxWM%3D)
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002757%27 HTTP/1.1" 200 None
2026-03-28 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002757 not downloaded yet
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022968%27 HTTP/1.1" 200 None
2026-03-28 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022968 not downloaded yet
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176050%27 HTTP/1.1" 200 None
2026-03-28 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176050 not downloaded yet
2026-03-28 22:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011394/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ71WSN/42810927?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=99Y%2F2O0XgNIgp1TnOJNknTQ6RKH%2BfHRxWx3tjIKgxWM%3D)
2026-03-28 22:06:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145430/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145430>
2026-03-28 22:06:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145437/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145437>
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144871%27 HTTP/1.1" 200 None
2026-03-28 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144871 not downloaded yet
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145478%27 HTTP/1.1" 200 None
2026-03-28 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145478 not downloaded yet
2026-03-28 22:06:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543e8110>
2026-03-28 22:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff2a82d-f7ab-592a-a781-86aaae91d694/6ff2a82d-f7ab-592a-a781-86aaae91d694_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB11OWR%252F699246097%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246097/600 saved to cache
2026-03-28 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6ff2a82d-f7ab-592a-a781-86aaae91d694
2026-03-28 22:06:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554943910>
2026-03-28 22:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced2c5eb-991e-54e7-b6dd-6b7667db3844/ced2c5eb-991e-54e7-b6dd-6b7667db3844_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO65VXH%252F699234673%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234673/600 saved to cache
2026-03-28 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ced2c5eb-991e-54e7-b6dd-6b7667db3844
2026-03-28 22:06:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549f0fd0>
2026-03-28 22:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73e9fcad-8a90-5e2f-8b8b-a9df139e02bc/73e9fcad-8a90-5e2f-8b8b-a9df139e02bc_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU68LVG%252F699208400%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208400/600 saved to cache
2026-03-28 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc
2026-03-28 22:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554891910>
2026-03-28 22:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c91238b-60eb-5c43-b2e1-23b211f67d90/1c91238b-60eb-5c43-b2e1-23b211f67d90_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV70FXU%252F699002760%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002760/600 saved to cache
2026-03-28 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c91238b-60eb-5c43-b2e1-23b211f67d90
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002785%27 HTTP/1.1" 200 None
2026-03-28 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002785 not downloaded yet
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015496%27 HTTP/1.1" 200 None
2026-03-28 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015496 not downloaded yet
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176054%27 HTTP/1.1" 200 None
2026-03-28 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176054 not downloaded yet
2026-03-28 22:06:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144842/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144842>
2026-03-28 22:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011422/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ71WSN/42810927?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=99Y%2F2O0XgNIgp1TnOJNknTQ6RKH%2BfHRxWx3tjIKgxWM%3D)
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144883%27 HTTP/1.1" 200 None
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144883 not downloaded yet
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145488%27 HTTP/1.1" 200 None
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145488 not downloaded yet
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5476aadd0>
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c91238b-60eb-5c43-b2e1-23b211f67d90/1c91238b-60eb-5c43-b2e1-23b211f67d90_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV70FXU%252F699002776%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002776/600 saved to cache
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1c91238b-60eb-5c43-b2e1-23b211f67d90
2026-03-28 22:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144815/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP58SRV/42811050?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=DaOCdMHzkQgJyUt%2BrWSjo2kz0u2ypMaZ1Rq1vMqPeao%3D)
2026-03-28 22:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002720/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002720>
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002823%27 HTTP/1.1" 200 None
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002823 not downloaded yet
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022979%27 HTTP/1.1" 200 None
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022979 not downloaded yet
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176058%27 HTTP/1.1" 200 None
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176058 not downloaded yet
2026-03-28 22:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011543/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011543>
2026-03-28 22:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002734/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002734>
2026-03-28 22:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011565/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011565>
2026-03-28 22:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142168/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF68HMX/42810701?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=VJkB3V1eYsfB99bax5tHm9xSKTZvKZqqHjZcNzH%2BIG0%3D)
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145503%27 HTTP/1.1" 200 None
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145503 not downloaded yet
2026-03-28 22:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011436/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ71WSN/42810927?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=99Y%2F2O0XgNIgp1TnOJNknTQ6RKH%2BfHRxWx3tjIKgxWM%3D)
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002868%27 HTTP/1.1" 200 None
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002868 not downloaded yet
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015511%27 HTTP/1.1" 200 None
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015511 not downloaded yet
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176061%27 HTTP/1.1" 200 None
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176061 not downloaded yet
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547173b90>
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce69b670-8852-55c2-be68-a54396142524/ce69b670-8852-55c2-be68-a54396142524_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ71WSN%252F699011370%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011370/600 saved to cache
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce69b670-8852-55c2-be68-a54396142524
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554adf550>
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce69b670-8852-55c2-be68-a54396142524/ce69b670-8852-55c2-be68-a54396142524_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ71WSN%252F699011394%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011394/600 saved to cache
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ce69b670-8852-55c2-be68-a54396142524
2026-03-28 22:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145450/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145450>
2026-03-28 22:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145430/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT05ONJ/42810976?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=5MixAqDo0hxRmLUvG5M%2B4PG7rAb3blo5qbHfZngnDeI%3D)
2026-03-28 22:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145437/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT05ONJ/42810976?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=5MixAqDo0hxRmLUvG5M%2B4PG7rAb3blo5qbHfZngnDeI%3D)
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002922%27 HTTP/1.1" 200 None
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002922 not downloaded yet
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022993%27 HTTP/1.1" 200 None
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022993 not downloaded yet
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176066%27 HTTP/1.1" 200 None
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176066 not downloaded yet
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547729cd0>
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce69b670-8852-55c2-be68-a54396142524/ce69b670-8852-55c2-be68-a54396142524_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ71WSN%252F699011422%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011422/600 saved to cache
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ce69b670-8852-55c2-be68-a54396142524
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543ffad0>
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dae85f49-83c1-5309-bd8a-55acf0d1d837/dae85f49-83c1-5309-bd8a-55acf0d1d837_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP58SRV%252F699144815%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144815/600 saved to cache
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dae85f49-83c1-5309-bd8a-55acf0d1d837
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549ffa50>
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c669890-4fd5-5f63-8a29-4ca91e40fe4b/9c669890-4fd5-5f63-8a29-4ca91e40fe4b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF68HMX%252F699142168%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142168/600 saved to cache
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c669890-4fd5-5f63-8a29-4ca91e40fe4b
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554316b90>
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce69b670-8852-55c2-be68-a54396142524/ce69b670-8852-55c2-be68-a54396142524_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ71WSN%252F699011436%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011436/600 saved to cache
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ce69b670-8852-55c2-be68-a54396142524
2026-03-28 22:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002700/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP69ZFO/42810902?sv=2020-08-04&st=2026-03-28T22%3A06%3A18Z&se=2026-03-28T22%3A31%3A18Z&sr=b&sp=r&sig=UML8GIUegn3Nyj4HJOcKbNITmMDJOsnF532qVJDzw2o%3D)
2026-03-28 22:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144842/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP58SRV/42811050?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=DaOCdMHzkQgJyUt%2BrWSjo2kz0u2ypMaZ1Rq1vMqPeao%3D)
2026-03-28 22:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145465/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145465>
2026-03-28 22:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144864/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144864>
2026-03-28 22:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145478/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145478>
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015528%27 HTTP/1.1" 200 None
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015528 not downloaded yet
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176077%27 HTTP/1.1" 200 None
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176077 not downloaded yet
2026-03-28 22:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002720/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP69ZFO/42810902?sv=2020-08-04&st=2026-03-28T22%3A06%3A18Z&se=2026-03-28T22%3A31%3A18Z&sr=b&sp=r&sig=UML8GIUegn3Nyj4HJOcKbNITmMDJOsnF532qVJDzw2o%3D)
2026-03-28 22:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176054/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176054>
2026-03-28 22:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011472/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ71WSN/42810927?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=99Y%2F2O0XgNIgp1TnOJNknTQ6RKH%2BfHRxWx3tjIKgxWM%3D)
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023001%27 HTTP/1.1" 200 None
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023001 not downloaded yet
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176092%27 HTTP/1.1" 200 None
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176092 not downloaded yet
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548fd5d0>
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08b948d7-14c0-5cfd-b5ed-455492122930/08b948d7-14c0-5cfd-b5ed-455492122930_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT05ONJ%252F699145430%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145430/600 saved to cache
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08b948d7-14c0-5cfd-b5ed-455492122930
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557c9bed0>
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08b948d7-14c0-5cfd-b5ed-455492122930/08b948d7-14c0-5cfd-b5ed-455492122930_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT05ONJ%252F699145437%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145437/600 saved to cache
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08b948d7-14c0-5cfd-b5ed-455492122930
2026-03-28 22:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145450/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT05ONJ/42810976?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=5MixAqDo0hxRmLUvG5M%2B4PG7rAb3blo5qbHfZngnDeI%3D)
2026-03-28 22:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699022979/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022979>
2026-03-28 22:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176061/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176061>
2026-03-28 22:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176058/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176058>
2026-03-28 22:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699015511/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015511>
2026-03-28 22:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002734/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP69ZFO/42810902?sv=2020-08-04&st=2026-03-28T22%3A06%3A18Z&se=2026-03-28T22%3A31%3A18Z&sr=b&sp=r&sig=UML8GIUegn3Nyj4HJOcKbNITmMDJOsnF532qVJDzw2o%3D)
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015544%27 HTTP/1.1" 200 None
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015544 not downloaded yet
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176107%27 HTTP/1.1" 200 None
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176107 not downloaded yet
2026-03-28 22:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011543/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ71WSN/42810927?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=99Y%2F2O0XgNIgp1TnOJNknTQ6RKH%2BfHRxWx3tjIKgxWM%3D)
2026-03-28 22:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011565/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ71WSN/42810927?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=99Y%2F2O0XgNIgp1TnOJNknTQ6RKH%2BfHRxWx3tjIKgxWM%3D)
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472c0810>
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ae84d00-f082-5222-b51d-cfbb89091e57/8ae84d00-f082-5222-b51d-cfbb89091e57_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP69ZFO%252F699002700%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002700/600 saved to cache
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ae84d00-f082-5222-b51d-cfbb89091e57
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474863d0>
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dae85f49-83c1-5309-bd8a-55acf0d1d837/dae85f49-83c1-5309-bd8a-55acf0d1d837_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP58SRV%252F699144842%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144842/600 saved to cache
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dae85f49-83c1-5309-bd8a-55acf0d1d837
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543db610>
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ae84d00-f082-5222-b51d-cfbb89091e57/8ae84d00-f082-5222-b51d-cfbb89091e57_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP69ZFO%252F699002720%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002720/600 saved to cache
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ae84d00-f082-5222-b51d-cfbb89091e57
2026-03-28 22:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547681f90>
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce69b670-8852-55c2-be68-a54396142524/ce69b670-8852-55c2-be68-a54396142524_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ71WSN%252F699011472%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011472/600 saved to cache
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ce69b670-8852-55c2-be68-a54396142524
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023013%27 HTTP/1.1" 200 None
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023013 not downloaded yet
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176117%27 HTTP/1.1" 200 None
2026-03-28 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176117 not downloaded yet
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5572a4d90>
2026-03-28 22:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08b948d7-14c0-5cfd-b5ed-455492122930/08b948d7-14c0-5cfd-b5ed-455492122930_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT05ONJ%252F699145450%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145450/600 saved to cache
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08b948d7-14c0-5cfd-b5ed-455492122930
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554aa42d0>
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ae84d00-f082-5222-b51d-cfbb89091e57/8ae84d00-f082-5222-b51d-cfbb89091e57_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP69ZFO%252F699002734%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002734/600 saved to cache
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ae84d00-f082-5222-b51d-cfbb89091e57
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54717f4d0>
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce69b670-8852-55c2-be68-a54396142524/ce69b670-8852-55c2-be68-a54396142524_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ71WSN%252F699011543%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011543/600 saved to cache
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ce69b670-8852-55c2-be68-a54396142524
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474f4ed0>
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce69b670-8852-55c2-be68-a54396142524/ce69b670-8852-55c2-be68-a54396142524_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ71WSN%252F699011565%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011565/600 saved to cache
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ce69b670-8852-55c2-be68-a54396142524
2026-03-28 22:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176054/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU09ZBO/42804375?sv=2020-08-04&st=2026-03-28T22%3A06%3A20Z&se=2026-03-28T22%3A31%3A20Z&sr=b&sp=r&sig=RN8i065PmmEvJhQd4a1aNT2MQopoicKXAwhsLdscQss%3D)
2026-03-28 22:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176066/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176066>
2026-03-28 22:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699022993/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022993>
2026-03-28 22:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002922/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002922>
2026-03-28 22:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002868/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002868>
2026-03-28 22:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144864/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP58SRV/42811050?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=DaOCdMHzkQgJyUt%2BrWSjo2kz0u2ypMaZ1Rq1vMqPeao%3D)
2026-03-28 22:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145465/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT05ONJ/42810976?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=5MixAqDo0hxRmLUvG5M%2B4PG7rAb3blo5qbHfZngnDeI%3D)
2026-03-28 22:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145478/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT05ONJ/42810976?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=5MixAqDo0hxRmLUvG5M%2B4PG7rAb3blo5qbHfZngnDeI%3D)
2026-03-28 22:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699015528/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015528>
2026-03-28 22:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699023001/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023001>
2026-03-28 22:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176058/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU09ZBO/42804375?sv=2020-08-04&st=2026-03-28T22%3A06%3A20Z&se=2026-03-28T22%3A31%3A20Z&sr=b&sp=r&sig=RN8i065PmmEvJhQd4a1aNT2MQopoicKXAwhsLdscQss%3D)
2026-03-28 22:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176077/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176077>
2026-03-28 22:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176092/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176092>
2026-03-28 22:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176061/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU09ZBO/42804375?sv=2020-08-04&st=2026-03-28T22%3A06%3A20Z&se=2026-03-28T22%3A31%3A20Z&sr=b&sp=r&sig=RN8i065PmmEvJhQd4a1aNT2MQopoicKXAwhsLdscQss%3D)
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b21090>
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d01a147-3afb-5ecc-8676-b197cf6baca3/1d01a147-3afb-5ecc-8676-b197cf6baca3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU09ZBO%252F699176054%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176054/600 saved to cache
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d01a147-3afb-5ecc-8676-b197cf6baca3
2026-03-28 22:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699022979/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD20VFR/42811012?sv=2020-08-04&st=2026-03-28T22%3A06%3A20Z&se=2026-03-28T22%3A31%3A20Z&sr=b&sp=r&sig=MyaAAS4vzNk5eSde8IAEaU9p72KXqy1v4RjR%2FWBJ3yo%3D)
2026-03-28 22:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699015511/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD20VFR/42811012?sv=2020-08-04&st=2026-03-28T22%3A06%3A20Z&se=2026-03-28T22%3A31%3A20Z&sr=b&sp=r&sig=MyaAAS4vzNk5eSde8IAEaU9p72KXqy1v4RjR%2FWBJ3yo%3D)
2026-03-28 22:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002868/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP69ZFO/42810902?sv=2020-08-04&st=2026-03-28T22%3A06%3A18Z&se=2026-03-28T22%3A31%3A18Z&sr=b&sp=r&sig=UML8GIUegn3Nyj4HJOcKbNITmMDJOsnF532qVJDzw2o%3D)
2026-03-28 22:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176117/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176117>
2026-03-28 22:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699023013/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023013>
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544d7290>
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dae85f49-83c1-5309-bd8a-55acf0d1d837/dae85f49-83c1-5309-bd8a-55acf0d1d837_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP58SRV%252F699144864%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144864/600 saved to cache
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dae85f49-83c1-5309-bd8a-55acf0d1d837
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554554990>
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08b948d7-14c0-5cfd-b5ed-455492122930/08b948d7-14c0-5cfd-b5ed-455492122930_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT05ONJ%252F699145465%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145465/600 saved to cache
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08b948d7-14c0-5cfd-b5ed-455492122930
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472486d0>
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08b948d7-14c0-5cfd-b5ed-455492122930/08b948d7-14c0-5cfd-b5ed-455492122930_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT05ONJ%252F699145478%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145478/600 saved to cache
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08b948d7-14c0-5cfd-b5ed-455492122930
2026-03-28 22:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699022993/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD20VFR/42811012?sv=2020-08-04&st=2026-03-28T22%3A06%3A20Z&se=2026-03-28T22%3A31%3A20Z&sr=b&sp=r&sig=MyaAAS4vzNk5eSde8IAEaU9p72KXqy1v4RjR%2FWBJ3yo%3D)
2026-03-28 22:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176066/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU09ZBO/42804375?sv=2020-08-04&st=2026-03-28T22%3A06%3A20Z&se=2026-03-28T22%3A31%3A20Z&sr=b&sp=r&sig=RN8i065PmmEvJhQd4a1aNT2MQopoicKXAwhsLdscQss%3D)
2026-03-28 22:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176107/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176107>
2026-03-28 22:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699015544/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015544>
2026-03-28 22:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002922/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP69ZFO/42810902?sv=2020-08-04&st=2026-03-28T22%3A06%3A18Z&se=2026-03-28T22%3A31%3A18Z&sr=b&sp=r&sig=UML8GIUegn3Nyj4HJOcKbNITmMDJOsnF532qVJDzw2o%3D)
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554474a50>
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d01a147-3afb-5ecc-8676-b197cf6baca3/1d01a147-3afb-5ecc-8676-b197cf6baca3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU09ZBO%252F699176058%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176058/600 saved to cache
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d01a147-3afb-5ecc-8676-b197cf6baca3
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547225210>
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d01a147-3afb-5ecc-8676-b197cf6baca3/1d01a147-3afb-5ecc-8676-b197cf6baca3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU09ZBO%252F699176061%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176061/600 saved to cache
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d01a147-3afb-5ecc-8676-b197cf6baca3
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54778aa10>
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e42f65-62fc-5369-aa50-0828074023cd/e2e42f65-62fc-5369-aa50-0828074023cd_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD20VFR%252F699022979%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699022979/600 saved to cache
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2e42f65-62fc-5369-aa50-0828074023cd
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543e2350>
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e42f65-62fc-5369-aa50-0828074023cd/e2e42f65-62fc-5369-aa50-0828074023cd_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD20VFR%252F699015511%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699015511/600 saved to cache
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2e42f65-62fc-5369-aa50-0828074023cd
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55422e710>
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ae84d00-f082-5222-b51d-cfbb89091e57/8ae84d00-f082-5222-b51d-cfbb89091e57_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP69ZFO%252F699002868%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002868/600 saved to cache
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8ae84d00-f082-5222-b51d-cfbb89091e57
2026-03-28 22:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002823/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002823>
2026-03-28 22:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145488/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145488>
2026-03-28 22:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145503/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145503>
2026-03-28 22:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144883/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144883>
2026-03-28 22:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699023001/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD20VFR/42811012?sv=2020-08-04&st=2026-03-28T22%3A06%3A20Z&se=2026-03-28T22%3A31%3A20Z&sr=b&sp=r&sig=MyaAAS4vzNk5eSde8IAEaU9p72KXqy1v4RjR%2FWBJ3yo%3D)
2026-03-28 22:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699015528/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD20VFR/42811012?sv=2020-08-04&st=2026-03-28T22%3A06%3A20Z&se=2026-03-28T22%3A31%3A20Z&sr=b&sp=r&sig=MyaAAS4vzNk5eSde8IAEaU9p72KXqy1v4RjR%2FWBJ3yo%3D)
2026-03-28 22:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176092/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU09ZBO/42804375?sv=2020-08-04&st=2026-03-28T22%3A06%3A20Z&se=2026-03-28T22%3A31%3A20Z&sr=b&sp=r&sig=RN8i065PmmEvJhQd4a1aNT2MQopoicKXAwhsLdscQss%3D)
2026-03-28 22:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176077/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU09ZBO/42804375?sv=2020-08-04&st=2026-03-28T22%3A06%3A20Z&se=2026-03-28T22%3A31%3A20Z&sr=b&sp=r&sig=RN8i065PmmEvJhQd4a1aNT2MQopoicKXAwhsLdscQss%3D)
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554486650>
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e42f65-62fc-5369-aa50-0828074023cd/e2e42f65-62fc-5369-aa50-0828074023cd_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD20VFR%252F699022993%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699022993/600 saved to cache
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e2e42f65-62fc-5369-aa50-0828074023cd
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547600b90>
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d01a147-3afb-5ecc-8676-b197cf6baca3/1d01a147-3afb-5ecc-8676-b197cf6baca3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU09ZBO%252F699176066%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176066/600 saved to cache
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d01a147-3afb-5ecc-8676-b197cf6baca3
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5476e5b90>
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ae84d00-f082-5222-b51d-cfbb89091e57/8ae84d00-f082-5222-b51d-cfbb89091e57_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP69ZFO%252F699002922%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002922/600 saved to cache
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8ae84d00-f082-5222-b51d-cfbb89091e57
2026-03-28 22:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699015544/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD20VFR/42811012?sv=2020-08-04&st=2026-03-28T22%3A06%3A20Z&se=2026-03-28T22%3A31%3A20Z&sr=b&sp=r&sig=MyaAAS4vzNk5eSde8IAEaU9p72KXqy1v4RjR%2FWBJ3yo%3D)
2026-03-28 22:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699015496/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015496>
2026-03-28 22:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002785/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002785>
2026-03-28 22:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699023013/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD20VFR/42811012?sv=2020-08-04&st=2026-03-28T22%3A06%3A20Z&se=2026-03-28T22%3A31%3A20Z&sr=b&sp=r&sig=MyaAAS4vzNk5eSde8IAEaU9p72KXqy1v4RjR%2FWBJ3yo%3D)
2026-03-28 22:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176107/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU09ZBO/42804375?sv=2020-08-04&st=2026-03-28T22%3A06%3A20Z&se=2026-03-28T22%3A31%3A20Z&sr=b&sp=r&sig=RN8i065PmmEvJhQd4a1aNT2MQopoicKXAwhsLdscQss%3D)
2026-03-28 22:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176117/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU09ZBO/42804375?sv=2020-08-04&st=2026-03-28T22%3A06%3A20Z&se=2026-03-28T22%3A31%3A20Z&sr=b&sp=r&sig=RN8i065PmmEvJhQd4a1aNT2MQopoicKXAwhsLdscQss%3D)
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557343c50>
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e42f65-62fc-5369-aa50-0828074023cd/e2e42f65-62fc-5369-aa50-0828074023cd_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD20VFR%252F699023001%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699023001/600 saved to cache
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e2e42f65-62fc-5369-aa50-0828074023cd
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55424a090>
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e42f65-62fc-5369-aa50-0828074023cd/e2e42f65-62fc-5369-aa50-0828074023cd_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD20VFR%252F699015528%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699015528/600 saved to cache
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e2e42f65-62fc-5369-aa50-0828074023cd
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a940d0>
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d01a147-3afb-5ecc-8676-b197cf6baca3/1d01a147-3afb-5ecc-8676-b197cf6baca3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU09ZBO%252F699176092%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176092/600 saved to cache
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d01a147-3afb-5ecc-8676-b197cf6baca3
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55491d7d0>
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d01a147-3afb-5ecc-8676-b197cf6baca3/1d01a147-3afb-5ecc-8676-b197cf6baca3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU09ZBO%252F699176077%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176077/600 saved to cache
2026-03-28 22:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d01a147-3afb-5ecc-8676-b197cf6baca3
2026-03-28 22:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144871/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144871>
2026-03-28 22:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176050/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176050>
2026-03-28 22:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002757/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002757>
2026-03-28 22:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145503/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT05ONJ/42810976?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=5MixAqDo0hxRmLUvG5M%2B4PG7rAb3blo5qbHfZngnDeI%3D)
2026-03-28 22:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699022968/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022968>
2026-03-28 22:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144883/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP58SRV/42811050?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=DaOCdMHzkQgJyUt%2BrWSjo2kz0u2ypMaZ1Rq1vMqPeao%3D)
2026-03-28 22:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145488/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT05ONJ/42810976?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=5MixAqDo0hxRmLUvG5M%2B4PG7rAb3blo5qbHfZngnDeI%3D)
2026-03-28 22:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002823/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP69ZFO/42810902?sv=2020-08-04&st=2026-03-28T22%3A06%3A18Z&se=2026-03-28T22%3A31%3A18Z&sr=b&sp=r&sig=UML8GIUegn3Nyj4HJOcKbNITmMDJOsnF532qVJDzw2o%3D)
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55456cc10>
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e42f65-62fc-5369-aa50-0828074023cd/e2e42f65-62fc-5369-aa50-0828074023cd_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD20VFR%252F699015544%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699015544/600 saved to cache
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e2e42f65-62fc-5369-aa50-0828074023cd
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fd7790>
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e42f65-62fc-5369-aa50-0828074023cd/e2e42f65-62fc-5369-aa50-0828074023cd_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD20VFR%252F699023013%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699023013/600 saved to cache
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e2e42f65-62fc-5369-aa50-0828074023cd
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543ff810>
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d01a147-3afb-5ecc-8676-b197cf6baca3/1d01a147-3afb-5ecc-8676-b197cf6baca3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU09ZBO%252F699176107%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176107/600 saved to cache
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1d01a147-3afb-5ecc-8676-b197cf6baca3
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fd7210>
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d01a147-3afb-5ecc-8676-b197cf6baca3/1d01a147-3afb-5ecc-8676-b197cf6baca3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU09ZBO%252F699176117%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176117/600 saved to cache
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1d01a147-3afb-5ecc-8676-b197cf6baca3
2026-03-28 22:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002990/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002990>
2026-03-28 22:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176041/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GU09ZBO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699022956/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD20VFR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554291410>
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08b948d7-14c0-5cfd-b5ed-455492122930/08b948d7-14c0-5cfd-b5ed-455492122930_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT05ONJ%252F699145503%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145503/600 saved to cache
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 08b948d7-14c0-5cfd-b5ed-455492122930
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547775e10>
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dae85f49-83c1-5309-bd8a-55acf0d1d837/dae85f49-83c1-5309-bd8a-55acf0d1d837_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP58SRV%252F699144883%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144883/600 saved to cache
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dae85f49-83c1-5309-bd8a-55acf0d1d837
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54747ac50>
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08b948d7-14c0-5cfd-b5ed-455492122930/08b948d7-14c0-5cfd-b5ed-455492122930_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT05ONJ%252F699145488%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145488/600 saved to cache
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08b948d7-14c0-5cfd-b5ed-455492122930
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55486b490>
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ae84d00-f082-5222-b51d-cfbb89091e57/8ae84d00-f082-5222-b51d-cfbb89091e57_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP69ZFO%252F699002823%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002823/600 saved to cache
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8ae84d00-f082-5222-b51d-cfbb89091e57
2026-03-28 22:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699015496/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD20VFR/42811012?sv=2020-08-04&st=2026-03-28T22%3A06%3A20Z&se=2026-03-28T22%3A31%3A20Z&sr=b&sp=r&sig=MyaAAS4vzNk5eSde8IAEaU9p72KXqy1v4RjR%2FWBJ3yo%3D)
2026-03-28 22:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176050/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU09ZBO/42804375?sv=2020-08-04&st=2026-03-28T22%3A06%3A20Z&se=2026-03-28T22%3A31%3A20Z&sr=b&sp=r&sig=RN8i065PmmEvJhQd4a1aNT2MQopoicKXAwhsLdscQss%3D)
2026-03-28 22:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002745/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002745>
2026-03-28 22:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002965/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002965>
2026-03-28 22:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144855/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144855>
2026-03-28 22:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002757/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP69ZFO/42810902?sv=2020-08-04&st=2026-03-28T22%3A06%3A18Z&se=2026-03-28T22%3A31%3A18Z&sr=b&sp=r&sig=UML8GIUegn3Nyj4HJOcKbNITmMDJOsnF532qVJDzw2o%3D)
2026-03-28 22:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699022968/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD20VFR/42811012?sv=2020-08-04&st=2026-03-28T22%3A06%3A20Z&se=2026-03-28T22%3A31%3A20Z&sr=b&sp=r&sig=MyaAAS4vzNk5eSde8IAEaU9p72KXqy1v4RjR%2FWBJ3yo%3D)
2026-03-28 22:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002785/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP69ZFO/42810902?sv=2020-08-04&st=2026-03-28T22%3A06%3A18Z&se=2026-03-28T22%3A31%3A18Z&sr=b&sp=r&sig=UML8GIUegn3Nyj4HJOcKbNITmMDJOsnF532qVJDzw2o%3D)
2026-03-28 22:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144846/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144846>
2026-03-28 22:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002936/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002936>
2026-03-28 22:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002990/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV70FXU/42810883?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=FPY2a%2BwTPBX3%2FgfHv4tGqy5Xp%2BqnbitwV6VOtdx3RWA%3D)
2026-03-28 22:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699022956/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD20VFR/42811012?sv=2020-08-04&st=2026-03-28T22%3A06%3A20Z&se=2026-03-28T22%3A31%3A20Z&sr=b&sp=r&sig=MyaAAS4vzNk5eSde8IAEaU9p72KXqy1v4RjR%2FWBJ3yo%3D)
2026-03-28 22:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142254/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142254>
2026-03-28 22:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145446/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145446>
2026-03-28 22:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176041/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU09ZBO/42804375?sv=2020-08-04&st=2026-03-28T22%3A06%3A20Z&se=2026-03-28T22%3A31%3A20Z&sr=b&sp=r&sig=RN8i065PmmEvJhQd4a1aNT2MQopoicKXAwhsLdscQss%3D)
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554aa7b50>
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e42f65-62fc-5369-aa50-0828074023cd/e2e42f65-62fc-5369-aa50-0828074023cd_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD20VFR%252F699015496%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699015496/600 saved to cache
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2e42f65-62fc-5369-aa50-0828074023cd
2026-03-28 22:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144871/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP58SRV/42811050?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=DaOCdMHzkQgJyUt%2BrWSjo2kz0u2ypMaZ1Rq1vMqPeao%3D)
2026-03-28 22:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002745/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP69ZFO/42810902?sv=2020-08-04&st=2026-03-28T22%3A06%3A18Z&se=2026-03-28T22%3A31%3A18Z&sr=b&sp=r&sig=UML8GIUegn3Nyj4HJOcKbNITmMDJOsnF532qVJDzw2o%3D)
2026-03-28 22:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142240/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142240>
2026-03-28 22:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002896/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002896>
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55456f010>
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d01a147-3afb-5ecc-8676-b197cf6baca3/1d01a147-3afb-5ecc-8676-b197cf6baca3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU09ZBO%252F699176050%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176050/600 saved to cache
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d01a147-3afb-5ecc-8676-b197cf6baca3
2026-03-28 22:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144855/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP58SRV/42811050?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=DaOCdMHzkQgJyUt%2BrWSjo2kz0u2ypMaZ1Rq1vMqPeao%3D)
2026-03-28 22:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002965/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV70FXU/42810883?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=FPY2a%2BwTPBX3%2FgfHv4tGqy5Xp%2BqnbitwV6VOtdx3RWA%3D)
2026-03-28 22:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002710/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002710>
2026-03-28 22:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011517/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011517>
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5577b10d0>
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ae84d00-f082-5222-b51d-cfbb89091e57/8ae84d00-f082-5222-b51d-cfbb89091e57_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP69ZFO%252F699002757%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002757/600 saved to cache
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8ae84d00-f082-5222-b51d-cfbb89091e57
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547395990>
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e42f65-62fc-5369-aa50-0828074023cd/e2e42f65-62fc-5369-aa50-0828074023cd_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD20VFR%252F699022968%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699022968/600 saved to cache
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2e42f65-62fc-5369-aa50-0828074023cd
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557299c50>
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ae84d00-f082-5222-b51d-cfbb89091e57/8ae84d00-f082-5222-b51d-cfbb89091e57_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP69ZFO%252F699002785%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002785/600 saved to cache
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8ae84d00-f082-5222-b51d-cfbb89091e57
2026-03-28 22:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002936/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV70FXU/42810883?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=FPY2a%2BwTPBX3%2FgfHv4tGqy5Xp%2BqnbitwV6VOtdx3RWA%3D)
2026-03-28 22:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144846/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP58SRV/42811050?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=DaOCdMHzkQgJyUt%2BrWSjo2kz0u2ypMaZ1Rq1vMqPeao%3D)
2026-03-28 22:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142219/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142219>
2026-03-28 22:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144835/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144835>
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fab590>
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c91238b-60eb-5c43-b2e1-23b211f67d90/1c91238b-60eb-5c43-b2e1-23b211f67d90_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV70FXU%252F699002990%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002990/600 saved to cache
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1c91238b-60eb-5c43-b2e1-23b211f67d90
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547202c90>
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e42f65-62fc-5369-aa50-0828074023cd/e2e42f65-62fc-5369-aa50-0828074023cd_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD20VFR%252F699022956%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699022956/600 saved to cache
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2e42f65-62fc-5369-aa50-0828074023cd
2026-03-28 22:06:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2e42f65-62fc-5369-aa50-0828074023cd, skipping ID generation
2026-03-28 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2e42f65-62fc-5369-aa50-0828074023cd sending to next pipeline
2026-03-28 22:06:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e2e42f65-62fc-5369-aa50-0828074023cd, identifier: LD20%20VFR
2026-03-28 22:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55729ccd0>
2026-03-28 22:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d01a147-3afb-5ecc-8676-b197cf6baca3/1d01a147-3afb-5ecc-8676-b197cf6baca3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU09ZBO%252F699176041%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176041/600 saved to cache
2026-03-28 22:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d01a147-3afb-5ecc-8676-b197cf6baca3
2026-03-28 22:06:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d01a147-3afb-5ecc-8676-b197cf6baca3, skipping ID generation
2026-03-28 22:06:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d01a147-3afb-5ecc-8676-b197cf6baca3 sending to next pipeline
2026-03-28 22:06:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1d01a147-3afb-5ecc-8676-b197cf6baca3, identifier: GU09%20ZBO
2026-03-28 22:06:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554476850>
2026-03-28 22:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dae85f49-83c1-5309-bd8a-55acf0d1d837/dae85f49-83c1-5309-bd8a-55acf0d1d837_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP58SRV%252F699144871%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144871/600 saved to cache
2026-03-28 22:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dae85f49-83c1-5309-bd8a-55acf0d1d837
2026-03-28 22:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474f5ed0>
2026-03-28 22:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ae84d00-f082-5222-b51d-cfbb89091e57/8ae84d00-f082-5222-b51d-cfbb89091e57_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP69ZFO%252F699002745%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002745/600 saved to cache
2026-03-28 22:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ae84d00-f082-5222-b51d-cfbb89091e57
2026-03-28 22:06:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547dcfd0>
2026-03-28 22:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dae85f49-83c1-5309-bd8a-55acf0d1d837/dae85f49-83c1-5309-bd8a-55acf0d1d837_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP58SRV%252F699144855%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144855/600 saved to cache
2026-03-28 22:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dae85f49-83c1-5309-bd8a-55acf0d1d837
2026-03-28 22:06:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554909610>
2026-03-28 22:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c91238b-60eb-5c43-b2e1-23b211f67d90/1c91238b-60eb-5c43-b2e1-23b211f67d90_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV70FXU%252F699002965%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002965/600 saved to cache
2026-03-28 22:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1c91238b-60eb-5c43-b2e1-23b211f67d90
2026-03-28 22:06:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e2e42f65-62fc-5369-aa50-0828074023cd with identifier: LD20%20VFR
2026-03-28 22:06:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e2e42f65-62fc-5369-aa50-0828074023cd with identifier: LD20%20VFR
2026-03-28 22:06:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e2e42f65-62fc-5369-aa50-0828074023cd with identifier: LD20%20VFR to the API
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699022956/600>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e42f65-62fc-5369-aa50-0828074023cd/e2e42f65-62fc-5369-aa50-0828074023cd_expert_report_file_83d65fbb-983e-4853-bf0a-fc7be9dcdade.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD20%20VFR-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e2e42f65-62fc-5369-aa50-0828074023cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD20 VFR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD20%20VFR&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'KIA',
'model': 'CEED',
'odometer': 9791,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e42f65-62fc-5369-aa50-0828074023cd/e2e42f65-62fc-5369-aa50-0828074023cd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40795,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699022956/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e42f65-62fc-5369-aa50-0828074023cd/e2e42f65-62fc-5369-aa50-0828074023cd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41746,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699022968/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e42f65-62fc-5369-aa50-0828074023cd/e2e42f65-62fc-5369-aa50-0828074023cd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47260,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699015496/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e42f65-62fc-5369-aa50-0828074023cd/e2e42f65-62fc-5369-aa50-0828074023cd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39399,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699022979/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e42f65-62fc-5369-aa50-0828074023cd/e2e42f65-62fc-5369-aa50-0828074023cd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44700,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699015511/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e42f65-62fc-5369-aa50-0828074023cd/e2e42f65-62fc-5369-aa50-0828074023cd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38340,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699022993/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e42f65-62fc-5369-aa50-0828074023cd/e2e42f65-62fc-5369-aa50-0828074023cd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43704,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699015528/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e42f65-62fc-5369-aa50-0828074023cd/e2e42f65-62fc-5369-aa50-0828074023cd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34439,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699023001/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e42f65-62fc-5369-aa50-0828074023cd/e2e42f65-62fc-5369-aa50-0828074023cd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42178,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699015544/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e42f65-62fc-5369-aa50-0828074023cd/e2e42f65-62fc-5369-aa50-0828074023cd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34937,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD20VFR/699023013/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'KIA CEED 1.0 T GDI 120 2 ISG Hatchback',
'transmission': 'manual',
'trim': 'T GDI 120 2 ISG',
'vin': 'U5YH2511LLL095077',
'year': 2020}
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD20%2520VFR%27 HTTP/1.1" 200 None
2026-03-28 22:06:27 [bca.uk] INFO: Saving data for LD20%20VFR: {'created_time': 1774735587.906265, 'last_price_update_time': 1774735587.906276, 'auction_closing_time': 1774864800.0}
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD20%2520VFR') HTTP/1.1" 204 0
2026-03-28 22:06:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1d01a147-3afb-5ecc-8676-b197cf6baca3 with identifier: GU09%20ZBO
2026-03-28 22:06:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1d01a147-3afb-5ecc-8676-b197cf6baca3 with identifier: GU09%20ZBO
2026-03-28 22:06:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1d01a147-3afb-5ecc-8676-b197cf6baca3 with identifier: GU09%20ZBO to the API
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176041/600>
{'auction_title': '',
'c_o_2_emission_value': 132,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01a147-3afb-5ecc-8676-b197cf6baca3/1d01a147-3afb-5ecc-8676-b197cf6baca3_expert_report_file_be65850d-2bf0-47e3-b5df-35b3add9d37a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU09%20ZBO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1d01a147-3afb-5ecc-8676-b197cf6baca3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU09 ZBO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GU09%20ZBO&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'MINI',
'model': 'COOPER CLUBMAN',
'odometer': 103219,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01a147-3afb-5ecc-8676-b197cf6baca3/1d01a147-3afb-5ecc-8676-b197cf6baca3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44394,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176041/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01a147-3afb-5ecc-8676-b197cf6baca3/1d01a147-3afb-5ecc-8676-b197cf6baca3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41988,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176050/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01a147-3afb-5ecc-8676-b197cf6baca3/1d01a147-3afb-5ecc-8676-b197cf6baca3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37870,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176054/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01a147-3afb-5ecc-8676-b197cf6baca3/1d01a147-3afb-5ecc-8676-b197cf6baca3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39459,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176058/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01a147-3afb-5ecc-8676-b197cf6baca3/1d01a147-3afb-5ecc-8676-b197cf6baca3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37910,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176061/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01a147-3afb-5ecc-8676-b197cf6baca3/1d01a147-3afb-5ecc-8676-b197cf6baca3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37700,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176066/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01a147-3afb-5ecc-8676-b197cf6baca3/1d01a147-3afb-5ecc-8676-b197cf6baca3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93681,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176077/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01a147-3afb-5ecc-8676-b197cf6baca3/1d01a147-3afb-5ecc-8676-b197cf6baca3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74965,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176092/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01a147-3afb-5ecc-8676-b197cf6baca3/1d01a147-3afb-5ecc-8676-b197cf6baca3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82080,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176107/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01a147-3afb-5ecc-8676-b197cf6baca3/1d01a147-3afb-5ecc-8676-b197cf6baca3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90566,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09ZBO/699176117/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'MINI COOPER CLUBMAN 1.6 Estate',
'transmission': 'manual',
'trim': '',
'vin': 'WMWML32060TN49706',
'year': 2009}
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU09%2520ZBO%27 HTTP/1.1" 200 None
2026-03-28 22:06:28 [bca.uk] INFO: Saving data for GU09%20ZBO: {'created_time': 1774735588.289826, 'last_price_update_time': 1774735588.289836, 'auction_closing_time': 1774864800.0}
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GU09%2520ZBO') HTTP/1.1" 204 0
2026-03-28 22:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142198/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142198>
2026-03-28 22:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002844/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002844>
2026-03-28 22:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145446/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT05ONJ/42810976?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=5MixAqDo0hxRmLUvG5M%2B4PG7rAb3blo5qbHfZngnDeI%3D)
2026-03-28 22:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145423/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145423>
2026-03-28 22:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144829/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144829>
2026-03-28 22:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142254/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF68HMX/42810701?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=VJkB3V1eYsfB99bax5tHm9xSKTZvKZqqHjZcNzH%2BIG0%3D)
2026-03-28 22:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142240/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF68HMX/42810701?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=VJkB3V1eYsfB99bax5tHm9xSKTZvKZqqHjZcNzH%2BIG0%3D)
2026-03-28 22:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002896/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV70FXU/42810883?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=FPY2a%2BwTPBX3%2FgfHv4tGqy5Xp%2BqnbitwV6VOtdx3RWA%3D)
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554282110>
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c91238b-60eb-5c43-b2e1-23b211f67d90/1c91238b-60eb-5c43-b2e1-23b211f67d90_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV70FXU%252F699002936%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002936/600 saved to cache
2026-03-28 22:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1c91238b-60eb-5c43-b2e1-23b211f67d90
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554282190>
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dae85f49-83c1-5309-bd8a-55acf0d1d837/dae85f49-83c1-5309-bd8a-55acf0d1d837_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP58SRV%252F699144846%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144846/600 saved to cache
2026-03-28 22:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dae85f49-83c1-5309-bd8a-55acf0d1d837
2026-03-28 22:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002822/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002822>
2026-03-28 22:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011517/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ71WSN/42810927?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=99Y%2F2O0XgNIgp1TnOJNknTQ6RKH%2BfHRxWx3tjIKgxWM%3D)
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471355d0>
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08b948d7-14c0-5cfd-b5ed-455492122930/08b948d7-14c0-5cfd-b5ed-455492122930_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT05ONJ%252F699145446%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145446/600 saved to cache
2026-03-28 22:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08b948d7-14c0-5cfd-b5ed-455492122930
2026-03-28 22:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002710/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP69ZFO/42810902?sv=2020-08-04&st=2026-03-28T22%3A06%3A18Z&se=2026-03-28T22%3A31%3A18Z&sr=b&sp=r&sig=UML8GIUegn3Nyj4HJOcKbNITmMDJOsnF532qVJDzw2o%3D)
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547327750>
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c669890-4fd5-5f63-8a29-4ca91e40fe4b/9c669890-4fd5-5f63-8a29-4ca91e40fe4b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF68HMX%252F699142254%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142254/600 saved to cache
2026-03-28 22:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9c669890-4fd5-5f63-8a29-4ca91e40fe4b
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547206ad0>
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c669890-4fd5-5f63-8a29-4ca91e40fe4b/9c669890-4fd5-5f63-8a29-4ca91e40fe4b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF68HMX%252F699142240%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142240/600 saved to cache
2026-03-28 22:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9c669890-4fd5-5f63-8a29-4ca91e40fe4b
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54774a390>
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c91238b-60eb-5c43-b2e1-23b211f67d90/1c91238b-60eb-5c43-b2e1-23b211f67d90_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV70FXU%252F699002896%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002896/600 saved to cache
2026-03-28 22:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1c91238b-60eb-5c43-b2e1-23b211f67d90
2026-03-28 22:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002844/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV70FXU/42810883?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=FPY2a%2BwTPBX3%2FgfHv4tGqy5Xp%2BqnbitwV6VOtdx3RWA%3D)
2026-03-28 22:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142180/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142180>
2026-03-28 22:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144835/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP58SRV/42811050?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=DaOCdMHzkQgJyUt%2BrWSjo2kz0u2ypMaZ1Rq1vMqPeao%3D)
2026-03-28 22:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144824/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144824>
2026-03-28 22:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145418/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LT05ONJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002807/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002807>
2026-03-28 22:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142198/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF68HMX/42810701?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=VJkB3V1eYsfB99bax5tHm9xSKTZvKZqqHjZcNzH%2BIG0%3D)
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557130090>
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce69b670-8852-55c2-be68-a54396142524/ce69b670-8852-55c2-be68-a54396142524_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ71WSN%252F699011517%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011517/600 saved to cache
2026-03-28 22:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ce69b670-8852-55c2-be68-a54396142524
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477326d0>
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ae84d00-f082-5222-b51d-cfbb89091e57/8ae84d00-f082-5222-b51d-cfbb89091e57_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP69ZFO%252F699002710%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002710/600 saved to cache
2026-03-28 22:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ae84d00-f082-5222-b51d-cfbb89091e57
2026-03-28 22:06:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ae84d00-f082-5222-b51d-cfbb89091e57, skipping ID generation
2026-03-28 22:06:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ae84d00-f082-5222-b51d-cfbb89091e57 sending to next pipeline
2026-03-28 22:06:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8ae84d00-f082-5222-b51d-cfbb89091e57, identifier: DP69%20ZFO
2026-03-28 22:06:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8ae84d00-f082-5222-b51d-cfbb89091e57 with identifier: DP69%20ZFO
2026-03-28 22:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8ae84d00-f082-5222-b51d-cfbb89091e57 with identifier: DP69%20ZFO
2026-03-28 22:06:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8ae84d00-f082-5222-b51d-cfbb89091e57 with identifier: DP69%20ZFO to the API
2026-03-28 22:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002710/600>
{'auction_title': '',
'c_o_2_emission_value': 93,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ae84d00-f082-5222-b51d-cfbb89091e57/8ae84d00-f082-5222-b51d-cfbb89091e57_expert_report_file_70d97c62-f535-4deb-9633-9c90d295799e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DP69%20ZFO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8ae84d00-f082-5222-b51d-cfbb89091e57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DP69 ZFO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DP69%20ZFO&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 25015,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ae84d00-f082-5222-b51d-cfbb89091e57/8ae84d00-f082-5222-b51d-cfbb89091e57_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36874,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002700/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ae84d00-f082-5222-b51d-cfbb89091e57/8ae84d00-f082-5222-b51d-cfbb89091e57_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37417,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002710/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ae84d00-f082-5222-b51d-cfbb89091e57/8ae84d00-f082-5222-b51d-cfbb89091e57_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36473,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002720/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ae84d00-f082-5222-b51d-cfbb89091e57/8ae84d00-f082-5222-b51d-cfbb89091e57_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35383,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002734/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ae84d00-f082-5222-b51d-cfbb89091e57/8ae84d00-f082-5222-b51d-cfbb89091e57_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30477,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002745/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ae84d00-f082-5222-b51d-cfbb89091e57/8ae84d00-f082-5222-b51d-cfbb89091e57_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31097,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002757/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ae84d00-f082-5222-b51d-cfbb89091e57/8ae84d00-f082-5222-b51d-cfbb89091e57_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88719,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002785/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ae84d00-f082-5222-b51d-cfbb89091e57/8ae84d00-f082-5222-b51d-cfbb89091e57_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78434,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002823/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ae84d00-f082-5222-b51d-cfbb89091e57/8ae84d00-f082-5222-b51d-cfbb89091e57_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92619,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002868/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ae84d00-f082-5222-b51d-cfbb89091e57/8ae84d00-f082-5222-b51d-cfbb89091e57_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73811,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP69ZFO/699002922/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 SE Hatchback',
'transmission': 'manual',
'trim': 'SE',
'vin': 'VXKUPHMHDL4067468',
'year': 2019}
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP69%2520ZFO%27 HTTP/1.1" 200 None
2026-03-28 22:06:29 [bca.uk] INFO: Saving data for DP69%20ZFO: {'created_time': 1774735589.131941, 'last_price_update_time': 1774735589.131953, 'auction_closing_time': 1774864800.0}
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DP69%2520ZFO') HTTP/1.1" 204 0
2026-03-28 22:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144829/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP58SRV/42811050?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=DaOCdMHzkQgJyUt%2BrWSjo2kz0u2ypMaZ1Rq1vMqPeao%3D)
2026-03-28 22:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002822/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV70FXU/42810883?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=FPY2a%2BwTPBX3%2FgfHv4tGqy5Xp%2BqnbitwV6VOtdx3RWA%3D)
2026-03-28 22:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011408/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011408>
2026-03-28 22:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142153/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142153>
2026-03-28 22:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145423/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT05ONJ/42810976?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=5MixAqDo0hxRmLUvG5M%2B4PG7rAb3blo5qbHfZngnDeI%3D)
2026-03-28 22:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002789/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002789>
2026-03-28 22:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142144/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142144>
2026-03-28 22:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142219/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF68HMX/42810701?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=VJkB3V1eYsfB99bax5tHm9xSKTZvKZqqHjZcNzH%2BIG0%3D)
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554827dd0>
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c91238b-60eb-5c43-b2e1-23b211f67d90/1c91238b-60eb-5c43-b2e1-23b211f67d90_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV70FXU%252F699002844%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002844/600 saved to cache
2026-03-28 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1c91238b-60eb-5c43-b2e1-23b211f67d90
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547391d10>
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dae85f49-83c1-5309-bd8a-55acf0d1d837/dae85f49-83c1-5309-bd8a-55acf0d1d837_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP58SRV%252F699144835%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144835/600 saved to cache
2026-03-28 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dae85f49-83c1-5309-bd8a-55acf0d1d837
2026-03-28 22:06:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543e0710>
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c669890-4fd5-5f63-8a29-4ca91e40fe4b/9c669890-4fd5-5f63-8a29-4ca91e40fe4b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF68HMX%252F699142198%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142198/600 saved to cache
2026-03-28 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c669890-4fd5-5f63-8a29-4ca91e40fe4b
2026-03-28 22:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002807/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV70FXU/42810883?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=FPY2a%2BwTPBX3%2FgfHv4tGqy5Xp%2BqnbitwV6VOtdx3RWA%3D)
2026-03-28 22:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144824/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP58SRV/42811050?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=DaOCdMHzkQgJyUt%2BrWSjo2kz0u2ypMaZ1Rq1vMqPeao%3D)
2026-03-28 22:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145418/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT05ONJ/42810976?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=5MixAqDo0hxRmLUvG5M%2B4PG7rAb3blo5qbHfZngnDeI%3D)
2026-03-28 22:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142134/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142134>
2026-03-28 22:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011381/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011381>
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54777d690>
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dae85f49-83c1-5309-bd8a-55acf0d1d837/dae85f49-83c1-5309-bd8a-55acf0d1d837_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP58SRV%252F699144829%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144829/600 saved to cache
2026-03-28 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dae85f49-83c1-5309-bd8a-55acf0d1d837
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547390350>
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c91238b-60eb-5c43-b2e1-23b211f67d90/1c91238b-60eb-5c43-b2e1-23b211f67d90_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV70FXU%252F699002822%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002822/600 saved to cache
2026-03-28 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1c91238b-60eb-5c43-b2e1-23b211f67d90
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547390410>
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08b948d7-14c0-5cfd-b5ed-455492122930/08b948d7-14c0-5cfd-b5ed-455492122930_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT05ONJ%252F699145423%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145423/600 saved to cache
2026-03-28 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08b948d7-14c0-5cfd-b5ed-455492122930
2026-03-28 22:06:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547205d90>
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c669890-4fd5-5f63-8a29-4ca91e40fe4b/9c669890-4fd5-5f63-8a29-4ca91e40fe4b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF68HMX%252F699142219%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142219/600 saved to cache
2026-03-28 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c669890-4fd5-5f63-8a29-4ca91e40fe4b
2026-03-28 22:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142180/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF68HMX/42810701?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=VJkB3V1eYsfB99bax5tHm9xSKTZvKZqqHjZcNzH%2BIG0%3D)
2026-03-28 22:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142118/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AF68HMX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX69OHK/42810977?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=0qs50uo1a%2B8v5oQ9QTDhOMr8kra3CfYpsPyh51WuzC4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GX69%20OHK-GB>
2026-03-28 22:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002789/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV70FXU/42810883?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=FPY2a%2BwTPBX3%2FgfHv4tGqy5Xp%2BqnbitwV6VOtdx3RWA%3D)
2026-03-28 22:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208381/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208381>
2026-03-28 22:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234652/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234652>
2026-03-28 22:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142144/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF68HMX/42810701?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=VJkB3V1eYsfB99bax5tHm9xSKTZvKZqqHjZcNzH%2BIG0%3D)
2026-03-28 22:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142153/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF68HMX/42810701?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=VJkB3V1eYsfB99bax5tHm9xSKTZvKZqqHjZcNzH%2BIG0%3D)
2026-03-28 22:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252835/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252835>
2026-03-28 22:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV18MMU/42810984?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=awaP9bI91lSo%2Fl13T4OiJNtRsbOn8slS8eNX2y8Uzxg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BV18%20MMU-GB>
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474f6050>
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c91238b-60eb-5c43-b2e1-23b211f67d90/1c91238b-60eb-5c43-b2e1-23b211f67d90_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV70FXU%252F699002807%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002807/600 saved to cache
2026-03-28 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1c91238b-60eb-5c43-b2e1-23b211f67d90
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547204a50>
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dae85f49-83c1-5309-bd8a-55acf0d1d837/dae85f49-83c1-5309-bd8a-55acf0d1d837_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP58SRV%252F699144824%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144824/600 saved to cache
2026-03-28 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dae85f49-83c1-5309-bd8a-55acf0d1d837
2026-03-28 22:06:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dae85f49-83c1-5309-bd8a-55acf0d1d837, skipping ID generation
2026-03-28 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dae85f49-83c1-5309-bd8a-55acf0d1d837 sending to next pipeline
2026-03-28 22:06:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dae85f49-83c1-5309-bd8a-55acf0d1d837, identifier: KP58%20SRV
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555c6e090>
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08b948d7-14c0-5cfd-b5ed-455492122930/08b948d7-14c0-5cfd-b5ed-455492122930_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT05ONJ%252F699145418%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145418/600 saved to cache
2026-03-28 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08b948d7-14c0-5cfd-b5ed-455492122930
2026-03-28 22:06:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08b948d7-14c0-5cfd-b5ed-455492122930, skipping ID generation
2026-03-28 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08b948d7-14c0-5cfd-b5ed-455492122930 sending to next pipeline
2026-03-28 22:06:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 08b948d7-14c0-5cfd-b5ed-455492122930, identifier: LT05%20ONJ
2026-03-28 22:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011408/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ71WSN/42810927?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=99Y%2F2O0XgNIgp1TnOJNknTQ6RKH%2BfHRxWx3tjIKgxWM%3D)
2026-03-28 22:06:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dae85f49-83c1-5309-bd8a-55acf0d1d837 with identifier: KP58%20SRV
2026-03-28 22:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dae85f49-83c1-5309-bd8a-55acf0d1d837 with identifier: KP58%20SRV
2026-03-28 22:06:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dae85f49-83c1-5309-bd8a-55acf0d1d837 with identifier: KP58%20SRV to the API
2026-03-28 22:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144824/600>
{'auction_title': '',
'c_o_2_emission_value': 165,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae85f49-83c1-5309-bd8a-55acf0d1d837/dae85f49-83c1-5309-bd8a-55acf0d1d837_expert_report_file_a51b35a3-0bf4-4cf6-aebc-ba53e1484a44.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KP58%20SRV-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'dae85f49-83c1-5309-bd8a-55acf0d1d837',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KP58 SRV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KP58%20SRV&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 82095,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae85f49-83c1-5309-bd8a-55acf0d1d837/dae85f49-83c1-5309-bd8a-55acf0d1d837_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49423,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144815/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae85f49-83c1-5309-bd8a-55acf0d1d837/dae85f49-83c1-5309-bd8a-55acf0d1d837_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45958,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144824/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae85f49-83c1-5309-bd8a-55acf0d1d837/dae85f49-83c1-5309-bd8a-55acf0d1d837_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45428,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144829/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae85f49-83c1-5309-bd8a-55acf0d1d837/dae85f49-83c1-5309-bd8a-55acf0d1d837_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47138,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144835/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae85f49-83c1-5309-bd8a-55acf0d1d837/dae85f49-83c1-5309-bd8a-55acf0d1d837_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46512,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144842/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae85f49-83c1-5309-bd8a-55acf0d1d837/dae85f49-83c1-5309-bd8a-55acf0d1d837_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43482,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144846/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae85f49-83c1-5309-bd8a-55acf0d1d837/dae85f49-83c1-5309-bd8a-55acf0d1d837_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84757,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144855/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae85f49-83c1-5309-bd8a-55acf0d1d837/dae85f49-83c1-5309-bd8a-55acf0d1d837_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81977,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144864/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae85f49-83c1-5309-bd8a-55acf0d1d837/dae85f49-83c1-5309-bd8a-55acf0d1d837_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83454,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144871/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae85f49-83c1-5309-bd8a-55acf0d1d837/dae85f49-83c1-5309-bd8a-55acf0d1d837_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73309,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP58SRV/699144883/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.4 80 MATCH Hatchback',
'transmission': 'automatic',
'trim': '80 MATCH',
'vin': 'WVWZZZ9NZ9Y079080',
'year': 2008}
2026-03-28 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP58%2520SRV%27 HTTP/1.1" 200 None
2026-03-28 22:06:30 [bca.uk] INFO: Saving data for KP58%20SRV: {'created_time': 1774735590.264172, 'last_price_update_time': 1774735590.264185, 'auction_closing_time': 1774864800.0}
2026-03-28 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KP58%2520SRV') HTTP/1.1" 204 0
2026-03-28 22:06:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 08b948d7-14c0-5cfd-b5ed-455492122930 with identifier: LT05%20ONJ
2026-03-28 22:06:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 08b948d7-14c0-5cfd-b5ed-455492122930 with identifier: LT05%20ONJ
2026-03-28 22:06:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 08b948d7-14c0-5cfd-b5ed-455492122930 with identifier: LT05%20ONJ to the API
2026-03-28 22:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145418/600>
{'auction_title': '',
'c_o_2_emission_value': 185,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08b948d7-14c0-5cfd-b5ed-455492122930/08b948d7-14c0-5cfd-b5ed-455492122930_expert_report_file_ee202c17-389c-4a0f-93a0-cae29e5f802d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT05%20ONJ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '08b948d7-14c0-5cfd-b5ed-455492122930',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LT05 ONJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LT05%20ONJ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 111178,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08b948d7-14c0-5cfd-b5ed-455492122930/08b948d7-14c0-5cfd-b5ed-455492122930_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48566,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145418/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08b948d7-14c0-5cfd-b5ed-455492122930/08b948d7-14c0-5cfd-b5ed-455492122930_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45683,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145423/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08b948d7-14c0-5cfd-b5ed-455492122930/08b948d7-14c0-5cfd-b5ed-455492122930_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45922,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145430/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08b948d7-14c0-5cfd-b5ed-455492122930/08b948d7-14c0-5cfd-b5ed-455492122930_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47980,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145437/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08b948d7-14c0-5cfd-b5ed-455492122930/08b948d7-14c0-5cfd-b5ed-455492122930_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45730,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145446/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08b948d7-14c0-5cfd-b5ed-455492122930/08b948d7-14c0-5cfd-b5ed-455492122930_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43046,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145450/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08b948d7-14c0-5cfd-b5ed-455492122930/08b948d7-14c0-5cfd-b5ed-455492122930_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98478,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145465/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08b948d7-14c0-5cfd-b5ed-455492122930/08b948d7-14c0-5cfd-b5ed-455492122930_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74414,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145478/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08b948d7-14c0-5cfd-b5ed-455492122930/08b948d7-14c0-5cfd-b5ed-455492122930_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85163,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145488/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08b948d7-14c0-5cfd-b5ed-455492122930/08b948d7-14c0-5cfd-b5ed-455492122930_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64338,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT05ONJ/699145503/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.6 FSI SE Hatchback',
'transmission': 'automatic',
'trim': 'FSI SE',
'vin': 'WVWZZZ1KZ5W177524',
'year': 2005}
2026-03-28 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT05%2520ONJ%27 HTTP/1.1" 200 None
2026-03-28 22:06:30 [bca.uk] INFO: Saving data for LT05%20ONJ: {'created_time': 1774735590.767081, 'last_price_update_time': 1774735590.767092, 'auction_closing_time': 1774864800.0}
2026-03-28 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LT05%2520ONJ') HTTP/1.1" 204 0
2026-03-28 22:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555c6f7d0>
2026-03-28 22:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c669890-4fd5-5f63-8a29-4ca91e40fe4b/9c669890-4fd5-5f63-8a29-4ca91e40fe4b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF68HMX%252F699142180%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142180/600 saved to cache
2026-03-28 22:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c669890-4fd5-5f63-8a29-4ca91e40fe4b
2026-03-28 22:06:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246081/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246081>
2026-03-28 22:06:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246063/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246063>
2026-03-28 22:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142134/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF68HMX/42810701?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=VJkB3V1eYsfB99bax5tHm9xSKTZvKZqqHjZcNzH%2BIG0%3D)
2026-03-28 22:06:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK59LFU/42810532?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=HXSOt9sDMupOgYbsEXCjSHCKuR31TJPXV6ppJsslvik%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LK59%20LFU-GB>
2026-03-28 22:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011381/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ71WSN/42810927?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=99Y%2F2O0XgNIgp1TnOJNknTQ6RKH%2BfHRxWx3tjIKgxWM%3D)
2026-03-28 22:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142118/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF68HMX/42810701?sv=2020-08-04&st=2026-03-28T22%3A06%3A17Z&se=2026-03-28T22%3A31%3A17Z&sr=b&sp=r&sig=VJkB3V1eYsfB99bax5tHm9xSKTZvKZqqHjZcNzH%2BIG0%3D)
2026-03-28 22:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX69OHK/42810977?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=0qs50uo1a%2B8v5oQ9QTDhOMr8kra3CfYpsPyh51WuzC4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474e0890>
2026-03-28 22:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c91238b-60eb-5c43-b2e1-23b211f67d90/1c91238b-60eb-5c43-b2e1-23b211f67d90_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV70FXU%252F699002789%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002789/600 saved to cache
2026-03-28 22:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1c91238b-60eb-5c43-b2e1-23b211f67d90
2026-03-28 22:06:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c91238b-60eb-5c43-b2e1-23b211f67d90, skipping ID generation
2026-03-28 22:06:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c91238b-60eb-5c43-b2e1-23b211f67d90 sending to next pipeline
2026-03-28 22:06:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1c91238b-60eb-5c43-b2e1-23b211f67d90, identifier: WV70%20FXU
2026-03-28 22:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547479510>
2026-03-28 22:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c669890-4fd5-5f63-8a29-4ca91e40fe4b/9c669890-4fd5-5f63-8a29-4ca91e40fe4b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF68HMX%252F699142144%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142144/600 saved to cache
2026-03-28 22:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c669890-4fd5-5f63-8a29-4ca91e40fe4b
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544e32d0>
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c669890-4fd5-5f63-8a29-4ca91e40fe4b/9c669890-4fd5-5f63-8a29-4ca91e40fe4b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF68HMX%252F699142153%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142153/600 saved to cache
2026-03-28 22:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c669890-4fd5-5f63-8a29-4ca91e40fe4b
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54731b350>
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce69b670-8852-55c2-be68-a54396142524/ce69b670-8852-55c2-be68-a54396142524_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ71WSN%252F699011408%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011408/600 saved to cache
2026-03-28 22:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ce69b670-8852-55c2-be68-a54396142524
2026-03-28 22:06:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1c91238b-60eb-5c43-b2e1-23b211f67d90 with identifier: WV70%20FXU
2026-03-28 22:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1c91238b-60eb-5c43-b2e1-23b211f67d90 with identifier: WV70%20FXU
2026-03-28 22:06:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1c91238b-60eb-5c43-b2e1-23b211f67d90 with identifier: WV70%20FXU to the API
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002789/600>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c91238b-60eb-5c43-b2e1-23b211f67d90/1c91238b-60eb-5c43-b2e1-23b211f67d90_expert_report_file_6a2c6b15-f7da-4933-8c90-ab5385c45fa8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WV70%20FXU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Electric',
'id': '1c91238b-60eb-5c43-b2e1-23b211f67d90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WV70 FXU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WV70%20FXU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VAUXHALL',
'model': 'CORSA-E',
'odometer': 75689,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c91238b-60eb-5c43-b2e1-23b211f67d90/1c91238b-60eb-5c43-b2e1-23b211f67d90_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41860,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002760/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c91238b-60eb-5c43-b2e1-23b211f67d90/1c91238b-60eb-5c43-b2e1-23b211f67d90_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40074,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002776/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c91238b-60eb-5c43-b2e1-23b211f67d90/1c91238b-60eb-5c43-b2e1-23b211f67d90_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40016,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002789/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c91238b-60eb-5c43-b2e1-23b211f67d90/1c91238b-60eb-5c43-b2e1-23b211f67d90_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37472,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002807/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c91238b-60eb-5c43-b2e1-23b211f67d90/1c91238b-60eb-5c43-b2e1-23b211f67d90_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35849,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002822/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c91238b-60eb-5c43-b2e1-23b211f67d90/1c91238b-60eb-5c43-b2e1-23b211f67d90_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36060,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002844/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c91238b-60eb-5c43-b2e1-23b211f67d90/1c91238b-60eb-5c43-b2e1-23b211f67d90_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76188,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002896/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c91238b-60eb-5c43-b2e1-23b211f67d90/1c91238b-60eb-5c43-b2e1-23b211f67d90_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50783,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002936/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c91238b-60eb-5c43-b2e1-23b211f67d90/1c91238b-60eb-5c43-b2e1-23b211f67d90_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74711,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002965/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c91238b-60eb-5c43-b2e1-23b211f67d90/1c91238b-60eb-5c43-b2e1-23b211f67d90_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64262,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV70FXU/699002990/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA-E 100KW 50KWH SE (LAUNCH)(7.4) Hatchback',
'transmission': 'automatic',
'trim': '100KW 50KWH SE (LAUNCH)(7.4)',
'vin': 'VXKUHZKXZL4261217',
'year': 2020}
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV70%2520FXU%27 HTTP/1.1" 200 None
2026-03-28 22:06:31 [bca.uk] INFO: Saving data for WV70%20FXU: {'created_time': 1774735591.633935, 'last_price_update_time': 1774735591.633945, 'auction_closing_time': 1774864800.0}
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WV70%2520FXU') HTTP/1.1" 204 0
2026-03-28 22:06:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK19NOH/42807908?sv=2020-08-04&st=2026-03-28T22%3A06%3A30Z&se=2026-03-28T22%3A31%3A30Z&sr=b&sp=r&sig=rD3Vv7GDvTTwqOKVf200giGIHE48KJ5OcykHqguP%2F7A%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YK19%20NOH-GB>
2026-03-28 22:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252835/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PFZ8482/42809655?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=TH37lPUKNzlJ9cPYi1xKA9ls4RZTQzngvd4d8Rd6Xgc%3D)
2026-03-28 22:06:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252805/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PFZ8482-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX06XUD/42810500?sv=2020-08-04&st=2026-03-28T22%3A06%3A30Z&se=2026-03-28T22%3A31%3A30Z&sr=b&sp=r&sig=EsoSrfFB91c20kgXYpjr8TG3TdHxfVqotEOHQKGAgUw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KX06%20XUD-GB>
2026-03-28 22:06:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246057/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246057>
2026-03-28 22:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208381/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU68LVG/42800882?sv=2020-08-04&st=2026-03-28T22%3A05%3A12Z&se=2026-03-28T22%3A30%3A12Z&sr=b&sp=r&sig=NJDddzay8QfXZCkDpDoajXCukxQxXVptkxb3qmj1KmE%3D)
2026-03-28 22:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234652/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO65VXH/42775624?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=slIW%2B3iwvDchqJURAJRdLEGkYLYSjXVM0OamBF34cz0%3D)
2026-03-28 22:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV18MMU/42810984?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=awaP9bI91lSo%2Fl13T4OiJNtRsbOn8slS8eNX2y8Uzxg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547391310>
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c669890-4fd5-5f63-8a29-4ca91e40fe4b/9c669890-4fd5-5f63-8a29-4ca91e40fe4b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF68HMX%252F699142134%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142134/600 saved to cache
2026-03-28 22:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c669890-4fd5-5f63-8a29-4ca91e40fe4b
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f88110>
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce69b670-8852-55c2-be68-a54396142524/ce69b670-8852-55c2-be68-a54396142524_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ71WSN%252F699011381%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011381/600 saved to cache
2026-03-28 22:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ce69b670-8852-55c2-be68-a54396142524
2026-03-28 22:06:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce69b670-8852-55c2-be68-a54396142524, skipping ID generation
2026-03-28 22:06:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce69b670-8852-55c2-be68-a54396142524 sending to next pipeline
2026-03-28 22:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ce69b670-8852-55c2-be68-a54396142524, identifier: GJ71%20WSN
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547390c10>
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c669890-4fd5-5f63-8a29-4ca91e40fe4b/9c669890-4fd5-5f63-8a29-4ca91e40fe4b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF68HMX%252F699142118%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142118/600 saved to cache
2026-03-28 22:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c669890-4fd5-5f63-8a29-4ca91e40fe4b
2026-03-28 22:06:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c669890-4fd5-5f63-8a29-4ca91e40fe4b, skipping ID generation
2026-03-28 22:06:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c669890-4fd5-5f63-8a29-4ca91e40fe4b sending to next pipeline
2026-03-28 22:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9c669890-4fd5-5f63-8a29-4ca91e40fe4b, identifier: AF68%20HMX
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547327a90>
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd277234-4dc4-5636-a402-27f6b3385c96/cd277234-4dc4-5636-a402-27f6b3385c96_expert_report_file_6e68b8ac-c89c-4cb7-a2ed-3e1d89571beb.pdf HTTP/1.1" 201 0
2026-03-28 22:06:32 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cd277234-4dc4-5636-a402-27f6b3385c96
2026-03-28 22:06:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cd277234-4dc4-5636-a402-27f6b3385c96, skipping ID generation
2026-03-28 22:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cd277234-4dc4-5636-a402-27f6b3385c96
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGX69OHK-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GX69OHK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ce69b670-8852-55c2-be68-a54396142524 with identifier: GJ71%20WSN
2026-03-28 22:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ce69b670-8852-55c2-be68-a54396142524 with identifier: GJ71%20WSN
2026-03-28 22:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ce69b670-8852-55c2-be68-a54396142524 with identifier: GJ71%20WSN to the API
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011381/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce69b670-8852-55c2-be68-a54396142524/ce69b670-8852-55c2-be68-a54396142524_expert_report_file_2a2314ed-bdb8-45ae-b9be-14ba10952da5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ71%20WSN-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ce69b670-8852-55c2-be68-a54396142524',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ71 WSN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ71%20WSN&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'AUDI',
'model': 'Q2',
'odometer': 43879,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce69b670-8852-55c2-be68-a54396142524/ce69b670-8852-55c2-be68-a54396142524_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44880,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011370/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce69b670-8852-55c2-be68-a54396142524/ce69b670-8852-55c2-be68-a54396142524_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44459,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011381/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce69b670-8852-55c2-be68-a54396142524/ce69b670-8852-55c2-be68-a54396142524_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43751,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011394/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce69b670-8852-55c2-be68-a54396142524/ce69b670-8852-55c2-be68-a54396142524_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41126,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011408/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce69b670-8852-55c2-be68-a54396142524/ce69b670-8852-55c2-be68-a54396142524_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36911,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011422/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce69b670-8852-55c2-be68-a54396142524/ce69b670-8852-55c2-be68-a54396142524_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36967,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011436/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce69b670-8852-55c2-be68-a54396142524/ce69b670-8852-55c2-be68-a54396142524_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88714,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011472/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce69b670-8852-55c2-be68-a54396142524/ce69b670-8852-55c2-be68-a54396142524_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64081,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011517/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce69b670-8852-55c2-be68-a54396142524/ce69b670-8852-55c2-be68-a54396142524_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82696,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011543/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce69b670-8852-55c2-be68-a54396142524/ce69b670-8852-55c2-be68-a54396142524_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67903,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ71WSN/699011565/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'AUDI Q2 1.5 35 TFSI SPORT S-T Hatchback',
'transmission': 'automatic',
'trim': '35 TFSI SPORT S-T',
'vin': 'WAUZZZGA5NA009257',
'year': 2021}
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ71%2520WSN%27 HTTP/1.1" 200 None
2026-03-28 22:06:32 [bca.uk] INFO: Saving data for GJ71%20WSN: {'created_time': 1774735592.400705, 'last_price_update_time': 1774735592.400715, 'auction_closing_time': 1774864800.0}
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ71%2520WSN') HTTP/1.1" 204 0
2026-03-28 22:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9c669890-4fd5-5f63-8a29-4ca91e40fe4b with identifier: AF68%20HMX
2026-03-28 22:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9c669890-4fd5-5f63-8a29-4ca91e40fe4b with identifier: AF68%20HMX
2026-03-28 22:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9c669890-4fd5-5f63-8a29-4ca91e40fe4b with identifier: AF68%20HMX to the API
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142118/600>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c669890-4fd5-5f63-8a29-4ca91e40fe4b/9c669890-4fd5-5f63-8a29-4ca91e40fe4b_expert_report_file_1bee9051-2645-467c-b0ee-8e51c430b628.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AF68%20HMX-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9c669890-4fd5-5f63-8a29-4ca91e40fe4b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AF68 HMX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AF68%20HMX&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'BMW',
'model': '118I',
'odometer': 75411,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c669890-4fd5-5f63-8a29-4ca91e40fe4b/9c669890-4fd5-5f63-8a29-4ca91e40fe4b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49774,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142118/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c669890-4fd5-5f63-8a29-4ca91e40fe4b/9c669890-4fd5-5f63-8a29-4ca91e40fe4b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46717,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142134/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c669890-4fd5-5f63-8a29-4ca91e40fe4b/9c669890-4fd5-5f63-8a29-4ca91e40fe4b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46565,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142144/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c669890-4fd5-5f63-8a29-4ca91e40fe4b/9c669890-4fd5-5f63-8a29-4ca91e40fe4b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49210,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142153/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c669890-4fd5-5f63-8a29-4ca91e40fe4b/9c669890-4fd5-5f63-8a29-4ca91e40fe4b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45374,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142168/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c669890-4fd5-5f63-8a29-4ca91e40fe4b/9c669890-4fd5-5f63-8a29-4ca91e40fe4b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41587,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142180/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c669890-4fd5-5f63-8a29-4ca91e40fe4b/9c669890-4fd5-5f63-8a29-4ca91e40fe4b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77463,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142198/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c669890-4fd5-5f63-8a29-4ca91e40fe4b/9c669890-4fd5-5f63-8a29-4ca91e40fe4b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77070,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142219/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c669890-4fd5-5f63-8a29-4ca91e40fe4b/9c669890-4fd5-5f63-8a29-4ca91e40fe4b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87424,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142240/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c669890-4fd5-5f63-8a29-4ca91e40fe4b/9c669890-4fd5-5f63-8a29-4ca91e40fe4b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73077,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF68HMX/699142254/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'BMW 118I 1.5 SE Hatchback',
'transmission': 'manual',
'trim': 'SE',
'vin': 'WBA1R520907B76945',
'year': 2018}
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF68%2520HMX%27 HTTP/1.1" 200 None
2026-03-28 22:06:32 [bca.uk] INFO: Saving data for AF68%20HMX: {'created_time': 1774735592.805023, 'last_price_update_time': 1774735592.805035, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AF68%2520HMX') HTTP/1.1" 204 0
2026-03-28 22:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246063/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB11OWR/42809523?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=%2BXPbFoBXFln5oK0NHPy9dGoxYCx5FDGBaSdCO93wM50%3D)
2026-03-28 22:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246081/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB11OWR/42809523?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=%2BXPbFoBXFln5oK0NHPy9dGoxYCx5FDGBaSdCO93wM50%3D)
2026-03-28 22:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK66WKL/42809678?sv=2020-08-04&st=2026-03-28T22%3A06%3A31Z&se=2026-03-28T22%3A31%3A31Z&sr=b&sp=r&sig=GiRcAhCOYBxFcUqxASPaChe3ssVirE1Tda7AJNXRiQc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LK66%20WKL-GB>
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015654%27 HTTP/1.1" 200 None
2026-03-28 22:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015654 not downloaded yet
2026-03-28 22:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208335/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208335>
2026-03-28 22:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234598/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234598>
2026-03-28 22:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV67NMF/42809798?sv=2020-08-04&st=2026-03-28T22%3A06%3A32Z&se=2026-03-28T22%3A31%3A32Z&sr=b&sp=r&sig=lKizQk1RoS6P9DBphb%2FP%2BEN1BYx9SlUGlkVfpOEs6ZM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WV67%20NMF-GB>
2026-03-28 22:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP05UXR/42810558?sv=2020-08-04&st=2026-03-28T22%3A06%3A32Z&se=2026-03-28T22%3A31%3A32Z&sr=b&sp=r&sig=oeBmjw6h7yhrRcDk7Az0DSC0qw6NipydgolxhmUcW6w%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KP05%20UXR-GB>
2026-03-28 22:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548ffc90>
2026-03-28 22:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9700af5-622f-5b72-9af3-28e1d8f91693/b9700af5-622f-5b72-9af3-28e1d8f91693_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPFZ8482%252F699252835%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252835/600 saved to cache
2026-03-28 22:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b9700af5-622f-5b72-9af3-28e1d8f91693
2026-03-28 22:06:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547777fd0>
2026-03-28 22:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73e9fcad-8a90-5e2f-8b8b-a9df139e02bc/73e9fcad-8a90-5e2f-8b8b-a9df139e02bc_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU68LVG%252F699208381%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208381/600 saved to cache
2026-03-28 22:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc
2026-03-28 22:06:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f95510>
2026-03-28 22:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced2c5eb-991e-54e7-b6dd-6b7667db3844/ced2c5eb-991e-54e7-b6dd-6b7667db3844_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO65VXH%252F699234652%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234652/600 saved to cache
2026-03-28 22:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ced2c5eb-991e-54e7-b6dd-6b7667db3844
2026-03-28 22:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547777d90>
2026-03-28 22:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab00141-98d7-507d-a35a-585edf20fde4/bab00141-98d7-507d-a35a-585edf20fde4_expert_report_file_ad06c7b2-4a1f-443d-a750-c6bbc27f50c9.pdf HTTP/1.1" 201 0
2026-03-28 22:06:32 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item bab00141-98d7-507d-a35a-585edf20fde4
2026-03-28 22:06:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bab00141-98d7-507d-a35a-585edf20fde4, skipping ID generation
2026-03-28 22:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bab00141-98d7-507d-a35a-585edf20fde4
2026-03-28 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBV18MMU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BV18MMU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015659%27 HTTP/1.1" 200 None
2026-03-28 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015659 not downloaded yet
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015635%27 HTTP/1.1" 200 None
2026-03-28 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015635 not downloaded yet
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015667%27 HTTP/1.1" 200 None
2026-03-28 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015667 not downloaded yet
2026-03-28 22:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK59LFU/42810532?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=HXSOt9sDMupOgYbsEXCjSHCKuR31TJPXV6ppJsslvik%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015638%27 HTTP/1.1" 200 None
2026-03-28 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015638 not downloaded yet
2026-03-28 22:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252805/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PFZ8482/42809655?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=TH37lPUKNzlJ9cPYi1xKA9ls4RZTQzngvd4d8Rd6Xgc%3D)
2026-03-28 22:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246057/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB11OWR/42809523?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=%2BXPbFoBXFln5oK0NHPy9dGoxYCx5FDGBaSdCO93wM50%3D)
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015670%27 HTTP/1.1" 200 None
2026-03-28 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015670 not downloaded yet
2026-03-28 22:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554291290>
2026-03-28 22:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff2a82d-f7ab-592a-a781-86aaae91d694/6ff2a82d-f7ab-592a-a781-86aaae91d694_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB11OWR%252F699246063%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246063/600 saved to cache
2026-03-28 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ff2a82d-f7ab-592a-a781-86aaae91d694
2026-03-28 22:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554233fd0>
2026-03-28 22:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff2a82d-f7ab-592a-a781-86aaae91d694/6ff2a82d-f7ab-592a-a781-86aaae91d694_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB11OWR%252F699246081%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246081/600 saved to cache
2026-03-28 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ff2a82d-f7ab-592a-a781-86aaae91d694
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015726%27 HTTP/1.1" 200 None
2026-03-28 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015726 not downloaded yet
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015677%27 HTTP/1.1" 200 None
2026-03-28 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015677 not downloaded yet
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015753%27 HTTP/1.1" 200 None
2026-03-28 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015753 not downloaded yet
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015690%27 HTTP/1.1" 200 None
2026-03-28 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015690 not downloaded yet
2026-03-28 22:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK19NOH/42807908?sv=2020-08-04&st=2026-03-28T22%3A06%3A30Z&se=2026-03-28T22%3A31%3A30Z&sr=b&sp=r&sig=rD3Vv7GDvTTwqOKVf200giGIHE48KJ5OcykHqguP%2F7A%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015765%27 HTTP/1.1" 200 None
2026-03-28 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015765 not downloaded yet
2026-03-28 22:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554add350>
2026-03-28 22:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a83e0fd1-5b31-5398-90ed-f3506792a1a5/a83e0fd1-5b31-5398-90ed-f3506792a1a5_expert_report_file_b6fefe72-39e9-448b-b270-52c019e40786.pdf HTTP/1.1" 201 0
2026-03-28 22:06:33 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a83e0fd1-5b31-5398-90ed-f3506792a1a5
2026-03-28 22:06:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a83e0fd1-5b31-5398-90ed-f3506792a1a5, skipping ID generation
2026-03-28 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a83e0fd1-5b31-5398-90ed-f3506792a1a5
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLK59LFU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LK59LFU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547606e50>
2026-03-28 22:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9700af5-622f-5b72-9af3-28e1d8f91693/b9700af5-622f-5b72-9af3-28e1d8f91693_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPFZ8482%252F699252805%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252805/600 saved to cache
2026-03-28 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9700af5-622f-5b72-9af3-28e1d8f91693
2026-03-28 22:06:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9700af5-622f-5b72-9af3-28e1d8f91693, skipping ID generation
2026-03-28 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9700af5-622f-5b72-9af3-28e1d8f91693 sending to next pipeline
2026-03-28 22:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b9700af5-622f-5b72-9af3-28e1d8f91693, identifier: PFZ%208482
2026-03-28 22:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557364150>
2026-03-28 22:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff2a82d-f7ab-592a-a781-86aaae91d694/6ff2a82d-f7ab-592a-a781-86aaae91d694_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB11OWR%252F699246057%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246057/600 saved to cache
2026-03-28 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ff2a82d-f7ab-592a-a781-86aaae91d694
2026-03-28 22:06:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ff2a82d-f7ab-592a-a781-86aaae91d694, skipping ID generation
2026-03-28 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ff2a82d-f7ab-592a-a781-86aaae91d694 sending to next pipeline
2026-03-28 22:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6ff2a82d-f7ab-592a-a781-86aaae91d694, identifier: SB11%20OWR
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015707%27 HTTP/1.1" 200 None
2026-03-28 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015707 not downloaded yet
2026-03-28 22:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b9700af5-622f-5b72-9af3-28e1d8f91693 with identifier: PFZ%208482
2026-03-28 22:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b9700af5-622f-5b72-9af3-28e1d8f91693 with identifier: PFZ%208482
2026-03-28 22:06:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b9700af5-622f-5b72-9af3-28e1d8f91693 with identifier: PFZ%208482 to the API
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252805/600>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9700af5-622f-5b72-9af3-28e1d8f91693/b9700af5-622f-5b72-9af3-28e1d8f91693_expert_report_file_2e6f5fb5-dee2-4bce-959b-52730a9585a8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PFZ%208482-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.9L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b9700af5-622f-5b72-9af3-28e1d8f91693',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PFZ 8482',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PFZ%208482&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'DACIA',
'model': 'SANDERO STEPWAY',
'odometer': 31496,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9700af5-622f-5b72-9af3-28e1d8f91693/b9700af5-622f-5b72-9af3-28e1d8f91693_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40696,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252805/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9700af5-622f-5b72-9af3-28e1d8f91693/b9700af5-622f-5b72-9af3-28e1d8f91693_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39574,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252815/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9700af5-622f-5b72-9af3-28e1d8f91693/b9700af5-622f-5b72-9af3-28e1d8f91693_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40340,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252823/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9700af5-622f-5b72-9af3-28e1d8f91693/b9700af5-622f-5b72-9af3-28e1d8f91693_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42055,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252835/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9700af5-622f-5b72-9af3-28e1d8f91693/b9700af5-622f-5b72-9af3-28e1d8f91693_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39478,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252840/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9700af5-622f-5b72-9af3-28e1d8f91693/b9700af5-622f-5b72-9af3-28e1d8f91693_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36560,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252855/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9700af5-622f-5b72-9af3-28e1d8f91693/b9700af5-622f-5b72-9af3-28e1d8f91693_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105550,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252867/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9700af5-622f-5b72-9af3-28e1d8f91693/b9700af5-622f-5b72-9af3-28e1d8f91693_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80543,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252883/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9700af5-622f-5b72-9af3-28e1d8f91693/b9700af5-622f-5b72-9af3-28e1d8f91693_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95389,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252904/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9700af5-622f-5b72-9af3-28e1d8f91693/b9700af5-622f-5b72-9af3-28e1d8f91693_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81641,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PFZ8482/699252925/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'DACIA SANDERO STEPWAY 0.9 TCE 90 AMBIANCE Hatchback',
'transmission': 'manual',
'trim': 'TCE 90 AMBIANCE',
'vin': 'UU15SDAAC49631435',
'year': 2013}
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PFZ%25208482%27 HTTP/1.1" 200 None
2026-03-28 22:06:34 [bca.uk] INFO: Saving data for PFZ%208482: {'created_time': 1774735594.089067, 'last_price_update_time': 1774735594.08908, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PFZ%25208482') HTTP/1.1" 204 0
2026-03-28 22:06:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6ff2a82d-f7ab-592a-a781-86aaae91d694 with identifier: SB11%20OWR
2026-03-28 22:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6ff2a82d-f7ab-592a-a781-86aaae91d694 with identifier: SB11%20OWR
2026-03-28 22:06:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6ff2a82d-f7ab-592a-a781-86aaae91d694 with identifier: SB11%20OWR to the API
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246057/600>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ff2a82d-f7ab-592a-a781-86aaae91d694/6ff2a82d-f7ab-592a-a781-86aaae91d694_expert_report_file_d15e875c-c444-4b93-8d8a-31e5287e9ece.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SB11%20OWR-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6ff2a82d-f7ab-592a-a781-86aaae91d694',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SB11 OWR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SB11%20OWR&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 46831,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ff2a82d-f7ab-592a-a781-86aaae91d694/6ff2a82d-f7ab-592a-a781-86aaae91d694_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35664,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246049/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ff2a82d-f7ab-592a-a781-86aaae91d694/6ff2a82d-f7ab-592a-a781-86aaae91d694_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34946,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246057/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ff2a82d-f7ab-592a-a781-86aaae91d694/6ff2a82d-f7ab-592a-a781-86aaae91d694_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35634,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246063/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ff2a82d-f7ab-592a-a781-86aaae91d694/6ff2a82d-f7ab-592a-a781-86aaae91d694_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36472,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246073/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ff2a82d-f7ab-592a-a781-86aaae91d694/6ff2a82d-f7ab-592a-a781-86aaae91d694_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32310,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246081/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ff2a82d-f7ab-592a-a781-86aaae91d694/6ff2a82d-f7ab-592a-a781-86aaae91d694_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31888,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246085/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ff2a82d-f7ab-592a-a781-86aaae91d694/6ff2a82d-f7ab-592a-a781-86aaae91d694_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88452,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246097/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ff2a82d-f7ab-592a-a781-86aaae91d694/6ff2a82d-f7ab-592a-a781-86aaae91d694_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61561,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246109/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ff2a82d-f7ab-592a-a781-86aaae91d694/6ff2a82d-f7ab-592a-a781-86aaae91d694_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80251,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246123/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ff2a82d-f7ab-592a-a781-86aaae91d694/6ff2a82d-f7ab-592a-a781-86aaae91d694_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93956,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB11OWR/699246138/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.6 VISIA Hatchback',
'transmission': 'manual',
'trim': 'VISIA',
'vin': 'SJNFBAF15U6097949',
'year': 2011}
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB11%2520OWR%27 HTTP/1.1" 200 None
2026-03-28 22:06:34 [bca.uk] INFO: Saving data for SB11%20OWR: {'created_time': 1774735594.490878, 'last_price_update_time': 1774735594.490893, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SB11%2520OWR') HTTP/1.1" 204 0
2026-03-28 22:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208327/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208327>
2026-03-28 22:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KE04ECL/42810509?sv=2020-08-04&st=2026-03-28T22%3A06%3A33Z&se=2026-03-28T22%3A31%3A33Z&sr=b&sp=r&sig=Ascom%2BZDxKQh%2BFtTk23j2PXyfZx6maQlK%2F3ZwUvdUog%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KE04%20ECL-GB>
2026-03-28 22:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024901/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024901>
2026-03-28 22:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP60LBZ/42810031?sv=2020-08-04&st=2026-03-28T22%3A06%3A33Z&se=2026-03-28T22%3A31%3A33Z&sr=b&sp=r&sig=3GaBsmw3hnsp9No2y3eY2AkbLUE5m1vAbGo5WjWqHUM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FP60%20LBZ-GB>
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015799%27 HTTP/1.1" 200 None
2026-03-28 22:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015799 not downloaded yet
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010729%27 HTTP/1.1" 200 None
2026-03-28 22:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010729 not downloaded yet
2026-03-28 22:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234598/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO65VXH/42775624?sv=2020-08-04&st=2026-03-28T22%3A05%3A13Z&se=2026-03-28T22%3A30%3A13Z&sr=b&sp=r&sig=slIW%2B3iwvDchqJURAJRdLEGkYLYSjXVM0OamBF34cz0%3D)
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015740%27 HTTP/1.1" 200 None
2026-03-28 22:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015740 not downloaded yet
2026-03-28 22:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX06XUD/42810500?sv=2020-08-04&st=2026-03-28T22%3A06%3A30Z&se=2026-03-28T22%3A31%3A30Z&sr=b&sp=r&sig=EsoSrfFB91c20kgXYpjr8TG3TdHxfVqotEOHQKGAgUw%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV67NMF/42809798?sv=2020-08-04&st=2026-03-28T22%3A06%3A32Z&se=2026-03-28T22%3A31%3A32Z&sr=b&sp=r&sig=lKizQk1RoS6P9DBphb%2FP%2BEN1BYx9SlUGlkVfpOEs6ZM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015829%27 HTTP/1.1" 200 None
2026-03-28 22:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015829 not downloaded yet
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010751%27 HTTP/1.1" 200 None
2026-03-28 22:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010751 not downloaded yet
2026-03-28 22:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549b3190>
2026-03-28 22:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e320279-d073-5e8e-aee4-113575c202cf/3e320279-d073-5e8e-aee4-113575c202cf_expert_report_file_3d54cb60-9cc2-47d0-9898-9ec1c354b604.pdf HTTP/1.1" 201 0
2026-03-28 22:06:34 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3e320279-d073-5e8e-aee4-113575c202cf
2026-03-28 22:06:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e320279-d073-5e8e-aee4-113575c202cf, skipping ID generation
2026-03-28 22:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3e320279-d073-5e8e-aee4-113575c202cf
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYK19NOH-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YK19NOH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP05UXR/42810558?sv=2020-08-04&st=2026-03-28T22%3A06%3A32Z&se=2026-03-28T22%3A31%3A32Z&sr=b&sp=r&sig=oeBmjw6h7yhrRcDk7Az0DSC0qw6NipydgolxhmUcW6w%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015774%27 HTTP/1.1" 200 None
2026-03-28 22:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015774 not downloaded yet
2026-03-28 22:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208335/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU68LVG/42800882?sv=2020-08-04&st=2026-03-28T22%3A05%3A12Z&se=2026-03-28T22%3A30%3A12Z&sr=b&sp=r&sig=NJDddzay8QfXZCkDpDoajXCukxQxXVptkxb3qmj1KmE%3D)
2026-03-28 22:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015647/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GX69OHK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR09VJO/42810008?sv=2020-08-04&st=2026-03-28T22%3A06%3A34Z&se=2026-03-28T22%3A31%3A34Z&sr=b&sp=r&sig=aKbRLG16TZ1nY2%2FcD%2BZrCbLa1V8iWZctNa6W3Fpmjbg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LR09%20VJO-GB>
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015873%27 HTTP/1.1" 200 None
2026-03-28 22:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015873 not downloaded yet
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010772%27 HTTP/1.1" 200 None
2026-03-28 22:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010772 not downloaded yet
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176650%27 HTTP/1.1" 200 None
2026-03-28 22:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176650 not downloaded yet
2026-03-28 22:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554909c90>
2026-03-28 22:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced2c5eb-991e-54e7-b6dd-6b7667db3844/ced2c5eb-991e-54e7-b6dd-6b7667db3844_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO65VXH%252F699234598%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234598/600 saved to cache
2026-03-28 22:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ced2c5eb-991e-54e7-b6dd-6b7667db3844
2026-03-28 22:06:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ced2c5eb-991e-54e7-b6dd-6b7667db3844, skipping ID generation
2026-03-28 22:06:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ced2c5eb-991e-54e7-b6dd-6b7667db3844 sending to next pipeline
2026-03-28 22:06:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ced2c5eb-991e-54e7-b6dd-6b7667db3844, identifier: AO65%20VXH
2026-03-28 22:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK66WKL/42809678?sv=2020-08-04&st=2026-03-28T22%3A06%3A31Z&se=2026-03-28T22%3A31%3A31Z&sr=b&sp=r&sig=GiRcAhCOYBxFcUqxASPaChe3ssVirE1Tda7AJNXRiQc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015659/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015659>
2026-03-28 22:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015667/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015667>
2026-03-28 22:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015635/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015635>
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015896%27 HTTP/1.1" 200 None
2026-03-28 22:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015896 not downloaded yet
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010802%27 HTTP/1.1" 200 None
2026-03-28 22:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010802 not downloaded yet
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176654%27 HTTP/1.1" 200 None
2026-03-28 22:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176654 not downloaded yet
2026-03-28 22:06:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ced2c5eb-991e-54e7-b6dd-6b7667db3844 with identifier: AO65%20VXH
2026-03-28 22:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ced2c5eb-991e-54e7-b6dd-6b7667db3844 with identifier: AO65%20VXH
2026-03-28 22:06:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ced2c5eb-991e-54e7-b6dd-6b7667db3844 with identifier: AO65%20VXH to the API
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234598/600>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced2c5eb-991e-54e7-b6dd-6b7667db3844/ced2c5eb-991e-54e7-b6dd-6b7667db3844_expert_report_file_b2ef3e4a-97e8-4226-bb35-5c67aa056807.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AO65%20VXH-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ced2c5eb-991e-54e7-b6dd-6b7667db3844',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AO65 VXH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AO65%20VXH&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 47500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced2c5eb-991e-54e7-b6dd-6b7667db3844/ced2c5eb-991e-54e7-b6dd-6b7667db3844_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40478,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234588/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced2c5eb-991e-54e7-b6dd-6b7667db3844/ced2c5eb-991e-54e7-b6dd-6b7667db3844_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39952,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234598/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced2c5eb-991e-54e7-b6dd-6b7667db3844/ced2c5eb-991e-54e7-b6dd-6b7667db3844_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38942,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234606/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced2c5eb-991e-54e7-b6dd-6b7667db3844/ced2c5eb-991e-54e7-b6dd-6b7667db3844_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41374,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234618/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced2c5eb-991e-54e7-b6dd-6b7667db3844/ced2c5eb-991e-54e7-b6dd-6b7667db3844_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39575,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234629/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced2c5eb-991e-54e7-b6dd-6b7667db3844/ced2c5eb-991e-54e7-b6dd-6b7667db3844_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37405,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234639/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced2c5eb-991e-54e7-b6dd-6b7667db3844/ced2c5eb-991e-54e7-b6dd-6b7667db3844_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85869,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234652/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced2c5eb-991e-54e7-b6dd-6b7667db3844/ced2c5eb-991e-54e7-b6dd-6b7667db3844_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76646,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234673/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced2c5eb-991e-54e7-b6dd-6b7667db3844/ced2c5eb-991e-54e7-b6dd-6b7667db3844_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88976,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234697/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced2c5eb-991e-54e7-b6dd-6b7667db3844/ced2c5eb-991e-54e7-b6dd-6b7667db3844_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75884,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO65VXH/699234724/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.2 TSI 90 SE DSG Hatchback',
'transmission': 'automatic',
'trim': 'TSI 90 SE DSG',
'vin': 'WVWZZZ6RZGU008304',
'year': 2015}
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO65%2520VXH%27 HTTP/1.1" 200 None
2026-03-28 22:06:35 [bca.uk] INFO: Saving data for AO65%20VXH: {'created_time': 1774735595.343929, 'last_price_update_time': 1774735595.343942, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AO65%2520VXH') HTTP/1.1" 204 0
2026-03-28 22:06:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015753/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015753>
2026-03-28 22:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554adfbd0>
2026-03-28 22:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea9ccc5-341e-59d0-9330-b505b5ad8888/6ea9ccc5-341e-59d0-9330-b505b5ad8888_expert_report_file_0978bab6-19ea-4df5-831b-3b0fa12eb4c5.pdf HTTP/1.1" 201 0
2026-03-28 22:06:35 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6ea9ccc5-341e-59d0-9330-b505b5ad8888
2026-03-28 22:06:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ea9ccc5-341e-59d0-9330-b505b5ad8888, skipping ID generation
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6ea9ccc5-341e-59d0-9330-b505b5ad8888
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKX06XUD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KX06XUD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554280590>
2026-03-28 22:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_172158fc-c6ba-569f-b467-7d56f3769264/172158fc-c6ba-569f-b467-7d56f3769264_expert_report_file_5b810461-60fc-42eb-a740-84d3934a7523.pdf HTTP/1.1" 201 0
2026-03-28 22:06:35 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 172158fc-c6ba-569f-b467-7d56f3769264
2026-03-28 22:06:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 172158fc-c6ba-569f-b467-7d56f3769264, skipping ID generation
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 172158fc-c6ba-569f-b467-7d56f3769264
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWV67NMF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WV67NMF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473dbf50>
2026-03-28 22:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_992fca31-db18-5535-9b9a-21d4a1d64a72/992fca31-db18-5535-9b9a-21d4a1d64a72_expert_report_file_3ef19788-0487-4b6b-a3ec-f92c33faffac.pdf HTTP/1.1" 201 0
2026-03-28 22:06:35 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 992fca31-db18-5535-9b9a-21d4a1d64a72
2026-03-28 22:06:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 992fca31-db18-5535-9b9a-21d4a1d64a72, skipping ID generation
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 992fca31-db18-5535-9b9a-21d4a1d64a72
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKP05UXR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KP05UXR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010832%27 HTTP/1.1" 200 None
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010832 not downloaded yet
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176659%27 HTTP/1.1" 200 None
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176659 not downloaded yet
2026-03-28 22:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024901/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YX16OWF/42810933?sv=2020-08-04&st=2026-03-28T22%3A05%3A09Z&se=2026-03-28T22%3A30%3A09Z&sr=b&sp=r&sig=3EOZGDetp00%2FdUCWDR68oq2Rwg5gxQSyaFaneq5tB70%3D)
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010775%27 HTTP/1.1" 200 None
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010775 not downloaded yet
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699159252%27 HTTP/1.1" 200 None
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699159252 not downloaded yet
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010735%27 HTTP/1.1" 200 None
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010735 not downloaded yet
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010872%27 HTTP/1.1" 200 None
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010872 not downloaded yet
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176663%27 HTTP/1.1" 200 None
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176663 not downloaded yet
2026-03-28 22:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55497af10>
2026-03-28 22:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73e9fcad-8a90-5e2f-8b8b-a9df139e02bc/73e9fcad-8a90-5e2f-8b8b-a9df139e02bc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU68LVG%252F699208335%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208335/600 saved to cache
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc
2026-03-28 22:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554476390>
2026-03-28 22:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48020b9d-f1ca-5049-9c7b-c8f63a357c9e/48020b9d-f1ca-5049-9c7b-c8f63a357c9e_expert_report_file_5a79053c-8c55-4fd9-a58a-302a754fac05.pdf HTTP/1.1" 201 0
2026-03-28 22:06:35 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 48020b9d-f1ca-5049-9c7b-c8f63a357c9e
2026-03-28 22:06:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 48020b9d-f1ca-5049-9c7b-c8f63a357c9e, skipping ID generation
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 48020b9d-f1ca-5049-9c7b-c8f63a357c9e
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLK66WKL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LK66WKL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KE04ECL/42810509?sv=2020-08-04&st=2026-03-28T22%3A06%3A33Z&se=2026-03-28T22%3A31%3A33Z&sr=b&sp=r&sig=Ascom%2BZDxKQh%2BFtTk23j2PXyfZx6maQlK%2F3ZwUvdUog%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP60LBZ/42810031?sv=2020-08-04&st=2026-03-28T22%3A06%3A33Z&se=2026-03-28T22%3A31%3A33Z&sr=b&sp=r&sig=3GaBsmw3hnsp9No2y3eY2AkbLUE5m1vAbGo5WjWqHUM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208327/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU68LVG/42800882?sv=2020-08-04&st=2026-03-28T22%3A05%3A12Z&se=2026-03-28T22%3A30%3A12Z&sr=b&sp=r&sig=NJDddzay8QfXZCkDpDoajXCukxQxXVptkxb3qmj1KmE%3D)
2026-03-28 22:06:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015740/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015740>
2026-03-28 22:06:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010729/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010729>
2026-03-28 22:06:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015799/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015799>
2026-03-28 22:06:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015707/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015707>
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010795%27 HTTP/1.1" 200 None
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010795 not downloaded yet
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699159263%27 HTTP/1.1" 200 None
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699159263 not downloaded yet
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010760%27 HTTP/1.1" 200 None
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010760 not downloaded yet
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010908%27 HTTP/1.1" 200 None
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010908 not downloaded yet
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176666%27 HTTP/1.1" 200 None
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176666 not downloaded yet
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158304%27 HTTP/1.1" 200 None
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158304 not downloaded yet
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010818%27 HTTP/1.1" 200 None
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010818 not downloaded yet
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699159267%27 HTTP/1.1" 200 None
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699159267 not downloaded yet
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010787%27 HTTP/1.1" 200 None
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010787 not downloaded yet
2026-03-28 22:06:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473da250>
2026-03-28 22:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12dd3ce3-5de5-5fe4-88d0-7054e427658d/12dd3ce3-5de5-5fe4-88d0-7054e427658d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYX16OWF%252F699024901%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024901/600 saved to cache
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 12dd3ce3-5de5-5fe4-88d0-7054e427658d
2026-03-28 22:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015635/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV18MMU/42810984?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=awaP9bI91lSo%2Fl13T4OiJNtRsbOn8slS8eNX2y8Uzxg%3D)
2026-03-28 22:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015647/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX69OHK/42810977?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=0qs50uo1a%2B8v5oQ9QTDhOMr8kra3CfYpsPyh51WuzC4%3D)
2026-03-28 22:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015753/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV18MMU/42810984?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=awaP9bI91lSo%2Fl13T4OiJNtRsbOn8slS8eNX2y8Uzxg%3D)
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010931%27 HTTP/1.1" 200 None
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010931 not downloaded yet
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176674%27 HTTP/1.1" 200 None
2026-03-28 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176674 not downloaded yet
2026-03-28 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158309%27 HTTP/1.1" 200 None
2026-03-28 22:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158309 not downloaded yet
2026-03-28 22:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015659/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX69OHK/42810977?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=0qs50uo1a%2B8v5oQ9QTDhOMr8kra3CfYpsPyh51WuzC4%3D)
2026-03-28 22:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015667/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX69OHK/42810977?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=0qs50uo1a%2B8v5oQ9QTDhOMr8kra3CfYpsPyh51WuzC4%3D)
2026-03-28 22:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015774/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015774>
2026-03-28 22:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176650/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176650>
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010845%27 HTTP/1.1" 200 None
2026-03-28 22:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010845 not downloaded yet
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699159275%27 HTTP/1.1" 200 None
2026-03-28 22:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699159275 not downloaded yet
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010808%27 HTTP/1.1" 200 None
2026-03-28 22:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010808 not downloaded yet
2026-03-28 22:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR09VJO/42810008?sv=2020-08-04&st=2026-03-28T22%3A06%3A34Z&se=2026-03-28T22%3A31%3A34Z&sr=b&sp=r&sig=aKbRLG16TZ1nY2%2FcD%2BZrCbLa1V8iWZctNa6W3Fpmjbg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010959%27 HTTP/1.1" 200 None
2026-03-28 22:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010959 not downloaded yet
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176685%27 HTTP/1.1" 200 None
2026-03-28 22:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176685 not downloaded yet
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158320%27 HTTP/1.1" 200 None
2026-03-28 22:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158320 not downloaded yet
2026-03-28 22:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554484ed0>
2026-03-28 22:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba9a5f3-be93-54af-9867-b958cb5e410e/7ba9a5f3-be93-54af-9867-b958cb5e410e_expert_report_file_78b2c94a-38a1-436a-88b9-3901770e5bf7.pdf HTTP/1.1" 201 0
2026-03-28 22:06:36 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7ba9a5f3-be93-54af-9867-b958cb5e410e
2026-03-28 22:06:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ba9a5f3-be93-54af-9867-b958cb5e410e, skipping ID generation
2026-03-28 22:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ba9a5f3-be93-54af-9867-b958cb5e410e
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKE04ECL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KE04ECL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55431ab10>
2026-03-28 22:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0379ad37-0288-50b0-bf91-fbe98128e386/0379ad37-0288-50b0-bf91-fbe98128e386_expert_report_file_2b77112e-81fa-438f-9ca6-d6d854fe7d88.pdf HTTP/1.1" 201 0
2026-03-28 22:06:36 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0379ad37-0288-50b0-bf91-fbe98128e386
2026-03-28 22:06:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0379ad37-0288-50b0-bf91-fbe98128e386, skipping ID generation
2026-03-28 22:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0379ad37-0288-50b0-bf91-fbe98128e386
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFP60LBZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FP60LBZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5547dfdd0>
2026-03-28 22:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73e9fcad-8a90-5e2f-8b8b-a9df139e02bc/73e9fcad-8a90-5e2f-8b8b-a9df139e02bc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU68LVG%252F699208327%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208327/600 saved to cache
2026-03-28 22:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc
2026-03-28 22:06:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc, skipping ID generation
2026-03-28 22:06:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc sending to next pipeline
2026-03-28 22:06:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc, identifier: DU68%20LVG
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010874%27 HTTP/1.1" 200 None
2026-03-28 22:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010874 not downloaded yet
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699159283%27 HTTP/1.1" 200 None
2026-03-28 22:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699159283 not downloaded yet
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010834%27 HTTP/1.1" 200 None
2026-03-28 22:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010834 not downloaded yet
2026-03-28 22:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc with identifier: DU68%20LVG
2026-03-28 22:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc with identifier: DU68%20LVG
2026-03-28 22:06:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc with identifier: DU68%20LVG to the API
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208327/600>
{'auction_title': '',
'c_o_2_emission_value': 160,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73e9fcad-8a90-5e2f-8b8b-a9df139e02bc/73e9fcad-8a90-5e2f-8b8b-a9df139e02bc_expert_report_file_519467fd-5c77-488f-8001-200974c829e4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DU68%20LVG-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '73e9fcad-8a90-5e2f-8b8b-a9df139e02bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DU68 LVG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DU68%20LVG&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FORD',
'model': 'KUGA',
'odometer': 73497,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73e9fcad-8a90-5e2f-8b8b-a9df139e02bc/73e9fcad-8a90-5e2f-8b8b-a9df139e02bc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40093,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208315/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73e9fcad-8a90-5e2f-8b8b-a9df139e02bc/73e9fcad-8a90-5e2f-8b8b-a9df139e02bc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38345,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208327/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73e9fcad-8a90-5e2f-8b8b-a9df139e02bc/73e9fcad-8a90-5e2f-8b8b-a9df139e02bc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35596,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208335/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73e9fcad-8a90-5e2f-8b8b-a9df139e02bc/73e9fcad-8a90-5e2f-8b8b-a9df139e02bc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36392,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208347/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73e9fcad-8a90-5e2f-8b8b-a9df139e02bc/73e9fcad-8a90-5e2f-8b8b-a9df139e02bc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36052,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208354/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73e9fcad-8a90-5e2f-8b8b-a9df139e02bc/73e9fcad-8a90-5e2f-8b8b-a9df139e02bc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34950,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208364/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73e9fcad-8a90-5e2f-8b8b-a9df139e02bc/73e9fcad-8a90-5e2f-8b8b-a9df139e02bc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76586,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208381/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73e9fcad-8a90-5e2f-8b8b-a9df139e02bc/73e9fcad-8a90-5e2f-8b8b-a9df139e02bc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66315,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208400/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73e9fcad-8a90-5e2f-8b8b-a9df139e02bc/73e9fcad-8a90-5e2f-8b8b-a9df139e02bc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85494,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208420/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73e9fcad-8a90-5e2f-8b8b-a9df139e02bc/73e9fcad-8a90-5e2f-8b8b-a9df139e02bc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82135,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68LVG/699208440/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 TDCI 180 4WD ST-LINE X P/S StationWagon',
'transmission': 'automatic',
'trim': 'TDCI 180 4WD ST-LINE X P/S',
'vin': 'WF0AXXWPMAJM87964',
'year': 2018}
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU68%2520LVG%27 HTTP/1.1" 200 None
2026-03-28 22:06:36 [bca.uk] INFO: Saving data for DU68%20LVG: {'created_time': 1774735596.812727, 'last_price_update_time': 1774735596.812736, 'auction_closing_time': 1774864800.0}
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DU68%2520LVG') HTTP/1.1" 204 0
2026-03-28 22:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176659/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176659>
2026-03-28 22:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015707/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX69OHK/42810977?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=0qs50uo1a%2B8v5oQ9QTDhOMr8kra3CfYpsPyh51WuzC4%3D)
2026-03-28 22:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015799/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV18MMU/42810984?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=awaP9bI91lSo%2Fl13T4OiJNtRsbOn8slS8eNX2y8Uzxg%3D)
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176696%27 HTTP/1.1" 200 None
2026-03-28 22:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176696 not downloaded yet
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158326%27 HTTP/1.1" 200 None
2026-03-28 22:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158326 not downloaded yet
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010766%27 HTTP/1.1" 200 None
2026-03-28 22:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010766 not downloaded yet
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010730%27 HTTP/1.1" 200 None
2026-03-28 22:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010730 not downloaded yet
2026-03-28 22:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010729/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK59LFU/42810532?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=HXSOt9sDMupOgYbsEXCjSHCKuR31TJPXV6ppJsslvik%3D)
2026-03-28 22:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010735/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010735>
2026-03-28 22:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010775/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010775>
2026-03-28 22:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159252/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699159252>
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010905%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010905 not downloaded yet
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699159296%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699159296 not downloaded yet
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010864%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010864 not downloaded yet
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543191d0>
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab00141-98d7-507d-a35a-585edf20fde4/bab00141-98d7-507d-a35a-585edf20fde4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV18MMU%252F699015635%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015635/600 saved to cache
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bab00141-98d7-507d-a35a-585edf20fde4
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54744fb90>
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd277234-4dc4-5636-a402-27f6b3385c96/cd277234-4dc4-5636-a402-27f6b3385c96_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX69OHK%252F699015647%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015647/600 saved to cache
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cd277234-4dc4-5636-a402-27f6b3385c96
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55420ecd0>
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab00141-98d7-507d-a35a-585edf20fde4/bab00141-98d7-507d-a35a-585edf20fde4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV18MMU%252F699015753%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015753/600 saved to cache
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bab00141-98d7-507d-a35a-585edf20fde4
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a8ac90>
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd277234-4dc4-5636-a402-27f6b3385c96/cd277234-4dc4-5636-a402-27f6b3385c96_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX69OHK%252F699015659%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015659/600 saved to cache
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cd277234-4dc4-5636-a402-27f6b3385c96
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55424a990>
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd277234-4dc4-5636-a402-27f6b3385c96/cd277234-4dc4-5636-a402-27f6b3385c96_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX69OHK%252F699015667%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015667/600 saved to cache
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cd277234-4dc4-5636-a402-27f6b3385c96
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554412c90>
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb9c86d4-3652-5684-9f6c-db4bea055518/cb9c86d4-3652-5684-9f6c-db4bea055518_expert_report_file_76522c1a-54bd-4d0f-bcf9-4f04446becc7.pdf HTTP/1.1" 201 0
2026-03-28 22:06:37 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cb9c86d4-3652-5684-9f6c-db4bea055518
2026-03-28 22:06:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb9c86d4-3652-5684-9f6c-db4bea055518, skipping ID generation
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb9c86d4-3652-5684-9f6c-db4bea055518
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLR09VJO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LR09VJO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015740/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX69OHK/42810977?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=0qs50uo1a%2B8v5oQ9QTDhOMr8kra3CfYpsPyh51WuzC4%3D)
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699176714%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176714 not downloaded yet
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158332%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158332 not downloaded yet
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010785%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010785 not downloaded yet
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010753%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010753 not downloaded yet
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010933%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010933 not downloaded yet
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699159308%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699159308 not downloaded yet
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010889%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010889 not downloaded yet
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975339%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975339 not downloaded yet
2026-03-28 22:06:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54732eb90>
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd277234-4dc4-5636-a402-27f6b3385c96/cd277234-4dc4-5636-a402-27f6b3385c96_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX69OHK%252F699015707%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015707/600 saved to cache
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cd277234-4dc4-5636-a402-27f6b3385c96
2026-03-28 22:06:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471a36d0>
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab00141-98d7-507d-a35a-585edf20fde4/bab00141-98d7-507d-a35a-585edf20fde4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV18MMU%252F699015799%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015799/600 saved to cache
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bab00141-98d7-507d-a35a-585edf20fde4
2026-03-28 22:06:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010908/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010908>
2026-03-28 22:06:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158304/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158304>
2026-03-28 22:06:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158309/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158309>
2026-03-28 22:06:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176674/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176674>
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158343%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158343 not downloaded yet
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010813%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010813 not downloaded yet
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010781%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010781 not downloaded yet
2026-03-28 22:06:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176666/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176666>
2026-03-28 22:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176650/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK19NOH/42807908?sv=2020-08-04&st=2026-03-28T22%3A06%3A30Z&se=2026-03-28T22%3A31%3A30Z&sr=b&sp=r&sig=rD3Vv7GDvTTwqOKVf200giGIHE48KJ5OcykHqguP%2F7A%3D)
2026-03-28 22:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015774/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX69OHK/42810977?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=0qs50uo1a%2B8v5oQ9QTDhOMr8kra3CfYpsPyh51WuzC4%3D)
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010954%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010954 not downloaded yet
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699159325%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699159325 not downloaded yet
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010926%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010926 not downloaded yet
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975369%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975369 not downloaded yet
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158352%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158352 not downloaded yet
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010847%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010847 not downloaded yet
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010801%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010801 not downloaded yet
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471a1dd0>
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a83e0fd1-5b31-5398-90ed-f3506792a1a5/a83e0fd1-5b31-5398-90ed-f3506792a1a5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK59LFU%252F699010729%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010729/600 saved to cache
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a83e0fd1-5b31-5398-90ed-f3506792a1a5
2026-03-28 22:06:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55429d950>
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd277234-4dc4-5636-a402-27f6b3385c96/cd277234-4dc4-5636-a402-27f6b3385c96_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX69OHK%252F699015740%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015740/600 saved to cache
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cd277234-4dc4-5636-a402-27f6b3385c96
2026-03-28 22:06:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010931/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010931>
2026-03-28 22:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176659/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK19NOH/42807908?sv=2020-08-04&st=2026-03-28T22%3A06%3A30Z&se=2026-03-28T22%3A31%3A30Z&sr=b&sp=r&sig=rD3Vv7GDvTTwqOKVf200giGIHE48KJ5OcykHqguP%2F7A%3D)
2026-03-28 22:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010775/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX06XUD/42810500?sv=2020-08-04&st=2026-03-28T22%3A06%3A30Z&se=2026-03-28T22%3A31%3A30Z&sr=b&sp=r&sig=EsoSrfFB91c20kgXYpjr8TG3TdHxfVqotEOHQKGAgUw%3D)
2026-03-28 22:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010735/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP05UXR/42810558?sv=2020-08-04&st=2026-03-28T22%3A06%3A32Z&se=2026-03-28T22%3A31%3A32Z&sr=b&sp=r&sig=oeBmjw6h7yhrRcDk7Az0DSC0qw6NipydgolxhmUcW6w%3D)
2026-03-28 22:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159252/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV67NMF/42809798?sv=2020-08-04&st=2026-03-28T22%3A06%3A32Z&se=2026-03-28T22%3A31%3A32Z&sr=b&sp=r&sig=lKizQk1RoS6P9DBphb%2FP%2BEN1BYx9SlUGlkVfpOEs6ZM%3D)
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010978%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010978 not downloaded yet
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699159336%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699159336 not downloaded yet
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010956%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010956 not downloaded yet
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975391%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975391 not downloaded yet
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158365%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158365 not downloaded yet
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010867%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010867 not downloaded yet
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010823%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010823 not downloaded yet
2026-03-28 22:06:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159283/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699159283>
2026-03-28 22:06:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010874/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010874>
2026-03-28 22:06:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010834/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010834>
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975413%27 HTTP/1.1" 200 None
2026-03-28 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975413 not downloaded yet
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55429e010>
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e320279-d073-5e8e-aee4-113575c202cf/3e320279-d073-5e8e-aee4-113575c202cf_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK19NOH%252F699176650%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176650/600 saved to cache
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3e320279-d073-5e8e-aee4-113575c202cf
2026-03-28 22:06:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543e9690>
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd277234-4dc4-5636-a402-27f6b3385c96/cd277234-4dc4-5636-a402-27f6b3385c96_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX69OHK%252F699015774%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015774/600 saved to cache
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cd277234-4dc4-5636-a402-27f6b3385c96
2026-03-28 22:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158309/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK66WKL/42809678?sv=2020-08-04&st=2026-03-28T22%3A06%3A31Z&se=2026-03-28T22%3A31%3A31Z&sr=b&sp=r&sig=GiRcAhCOYBxFcUqxASPaChe3ssVirE1Tda7AJNXRiQc%3D)
2026-03-28 22:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158304/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK66WKL/42809678?sv=2020-08-04&st=2026-03-28T22%3A06%3A31Z&se=2026-03-28T22%3A31%3A31Z&sr=b&sp=r&sig=GiRcAhCOYBxFcUqxASPaChe3ssVirE1Tda7AJNXRiQc%3D)
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158378%27 HTTP/1.1" 200 None
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158378 not downloaded yet
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010893%27 HTTP/1.1" 200 None
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010893 not downloaded yet
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010861%27 HTTP/1.1" 200 None
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010861 not downloaded yet
2026-03-28 22:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975310/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LR09VJO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010908/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK59LFU/42810532?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=HXSOt9sDMupOgYbsEXCjSHCKuR31TJPXV6ppJsslvik%3D)
2026-03-28 22:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176674/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK19NOH/42807908?sv=2020-08-04&st=2026-03-28T22%3A06%3A30Z&se=2026-03-28T22%3A31%3A30Z&sr=b&sp=r&sig=rD3Vv7GDvTTwqOKVf200giGIHE48KJ5OcykHqguP%2F7A%3D)
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975449%27 HTTP/1.1" 200 None
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975449 not downloaded yet
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010923%27 HTTP/1.1" 200 None
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010923 not downloaded yet
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010895%27 HTTP/1.1" 200 None
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010895 not downloaded yet
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a189d0>
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e320279-d073-5e8e-aee4-113575c202cf/3e320279-d073-5e8e-aee4-113575c202cf_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK19NOH%252F699176659%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176659/600 saved to cache
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3e320279-d073-5e8e-aee4-113575c202cf
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548c3f90>
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea9ccc5-341e-59d0-9330-b505b5ad8888/6ea9ccc5-341e-59d0-9330-b505b5ad8888_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX06XUD%252F699010775%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010775/600 saved to cache
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ea9ccc5-341e-59d0-9330-b505b5ad8888
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55778f490>
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_992fca31-db18-5535-9b9a-21d4a1d64a72/992fca31-db18-5535-9b9a-21d4a1d64a72_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP05UXR%252F699010735%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010735/600 saved to cache
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 992fca31-db18-5535-9b9a-21d4a1d64a72
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5577d4210>
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_172158fc-c6ba-569f-b467-7d56f3769264/172158fc-c6ba-569f-b467-7d56f3769264_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV67NMF%252F699159252%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159252/600 saved to cache
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 172158fc-c6ba-569f-b467-7d56f3769264
2026-03-28 22:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176666/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK19NOH/42807908?sv=2020-08-04&st=2026-03-28T22%3A06%3A30Z&se=2026-03-28T22%3A31%3A30Z&sr=b&sp=r&sig=rD3Vv7GDvTTwqOKVf200giGIHE48KJ5OcykHqguP%2F7A%3D)
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975473%27 HTTP/1.1" 200 None
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975473 not downloaded yet
2026-03-28 22:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010813/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010813>
2026-03-28 22:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010781/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010781>
2026-03-28 22:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975369/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975369>
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010946%27 HTTP/1.1" 200 None
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010946 not downloaded yet
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010924%27 HTTP/1.1" 200 None
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010924 not downloaded yet
2026-03-28 22:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010931/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK59LFU/42810532?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=HXSOt9sDMupOgYbsEXCjSHCKuR31TJPXV6ppJsslvik%3D)
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975498%27 HTTP/1.1" 200 None
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975498 not downloaded yet
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549f3990>
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48020b9d-f1ca-5049-9c7b-c8f63a357c9e/48020b9d-f1ca-5049-9c7b-c8f63a357c9e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK66WKL%252F699158309%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158309/600 saved to cache
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 48020b9d-f1ca-5049-9c7b-c8f63a357c9e
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55456e410>
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48020b9d-f1ca-5049-9c7b-c8f63a357c9e/48020b9d-f1ca-5049-9c7b-c8f63a357c9e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK66WKL%252F699158304%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158304/600 saved to cache
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 48020b9d-f1ca-5049-9c7b-c8f63a357c9e
2026-03-28 22:06:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55429f350>
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a83e0fd1-5b31-5398-90ed-f3506792a1a5/a83e0fd1-5b31-5398-90ed-f3506792a1a5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK59LFU%252F699010908%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010908/600 saved to cache
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a83e0fd1-5b31-5398-90ed-f3506792a1a5
2026-03-28 22:06:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f95a90>
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e320279-d073-5e8e-aee4-113575c202cf/3e320279-d073-5e8e-aee4-113575c202cf_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK19NOH%252F699176674%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176674/600 saved to cache
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3e320279-d073-5e8e-aee4-113575c202cf
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010974%27 HTTP/1.1" 200 None
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010974 not downloaded yet
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010944%27 HTTP/1.1" 200 None
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010944 not downloaded yet
2026-03-28 22:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010834/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP05UXR/42810558?sv=2020-08-04&st=2026-03-28T22%3A06%3A32Z&se=2026-03-28T22%3A31%3A32Z&sr=b&sp=r&sig=oeBmjw6h7yhrRcDk7Az0DSC0qw6NipydgolxhmUcW6w%3D)
2026-03-28 22:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010926/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010926>
2026-03-28 22:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010954/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010954>
2026-03-28 22:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159325/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699159325>
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975532%27 HTTP/1.1" 200 None
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975532 not downloaded yet
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549d1850>
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e320279-d073-5e8e-aee4-113575c202cf/3e320279-d073-5e8e-aee4-113575c202cf_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK19NOH%252F699176666%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176666/600 saved to cache
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3e320279-d073-5e8e-aee4-113575c202cf
2026-03-28 22:06:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547313d50>
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a83e0fd1-5b31-5398-90ed-f3506792a1a5/a83e0fd1-5b31-5398-90ed-f3506792a1a5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK59LFU%252F699010931%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010931/600 saved to cache
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a83e0fd1-5b31-5398-90ed-f3506792a1a5
2026-03-28 22:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159283/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV67NMF/42809798?sv=2020-08-04&st=2026-03-28T22%3A06%3A32Z&se=2026-03-28T22%3A31%3A32Z&sr=b&sp=r&sig=lKizQk1RoS6P9DBphb%2FP%2BEN1BYx9SlUGlkVfpOEs6ZM%3D)
2026-03-28 22:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010874/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX06XUD/42810500?sv=2020-08-04&st=2026-03-28T22%3A06%3A30Z&se=2026-03-28T22%3A31%3A30Z&sr=b&sp=r&sig=EsoSrfFB91c20kgXYpjr8TG3TdHxfVqotEOHQKGAgUw%3D)
2026-03-28 22:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010867/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010867>
2026-03-28 22:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010823/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010823>
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975563%27 HTTP/1.1" 200 None
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975563 not downloaded yet
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b07d10>
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_992fca31-db18-5535-9b9a-21d4a1d64a72/992fca31-db18-5535-9b9a-21d4a1d64a72_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP05UXR%252F699010834%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010834/600 saved to cache
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 992fca31-db18-5535-9b9a-21d4a1d64a72
2026-03-28 22:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010861/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010861>
2026-03-28 22:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010893/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010893>
2026-03-28 22:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975449/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975449>
2026-03-28 22:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975310/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR09VJO/42810008?sv=2020-08-04&st=2026-03-28T22%3A06%3A34Z&se=2026-03-28T22%3A31%3A34Z&sr=b&sp=r&sig=aKbRLG16TZ1nY2%2FcD%2BZrCbLa1V8iWZctNa6W3Fpmjbg%3D)
2026-03-28 22:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975473/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975473>
2026-03-28 22:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975369/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR09VJO/42810008?sv=2020-08-04&st=2026-03-28T22%3A06%3A34Z&se=2026-03-28T22%3A31%3A34Z&sr=b&sp=r&sig=aKbRLG16TZ1nY2%2FcD%2BZrCbLa1V8iWZctNa6W3Fpmjbg%3D)
2026-03-28 22:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010781/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP60LBZ/42810031?sv=2020-08-04&st=2026-03-28T22%3A06%3A33Z&se=2026-03-28T22%3A31%3A33Z&sr=b&sp=r&sig=3GaBsmw3hnsp9No2y3eY2AkbLUE5m1vAbGo5WjWqHUM%3D)
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe564c07c90>
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_172158fc-c6ba-569f-b467-7d56f3769264/172158fc-c6ba-569f-b467-7d56f3769264_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV67NMF%252F699159283%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159283/600 saved to cache
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 172158fc-c6ba-569f-b467-7d56f3769264
2026-03-28 22:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159325/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV67NMF/42809798?sv=2020-08-04&st=2026-03-28T22%3A06%3A32Z&se=2026-03-28T22%3A31%3A32Z&sr=b&sp=r&sig=lKizQk1RoS6P9DBphb%2FP%2BEN1BYx9SlUGlkVfpOEs6ZM%3D)
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554250b90>
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea9ccc5-341e-59d0-9330-b505b5ad8888/6ea9ccc5-341e-59d0-9330-b505b5ad8888_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX06XUD%252F699010874%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010874/600 saved to cache
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6ea9ccc5-341e-59d0-9330-b505b5ad8888
2026-03-28 22:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010944/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010944>
2026-03-28 22:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010823/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP60LBZ/42810031?sv=2020-08-04&st=2026-03-28T22%3A06%3A33Z&se=2026-03-28T22%3A31%3A33Z&sr=b&sp=r&sig=3GaBsmw3hnsp9No2y3eY2AkbLUE5m1vAbGo5WjWqHUM%3D)
2026-03-28 22:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010954/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX06XUD/42810500?sv=2020-08-04&st=2026-03-28T22%3A06%3A30Z&se=2026-03-28T22%3A31%3A30Z&sr=b&sp=r&sig=EsoSrfFB91c20kgXYpjr8TG3TdHxfVqotEOHQKGAgUw%3D)
2026-03-28 22:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010867/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KE04ECL/42810509?sv=2020-08-04&st=2026-03-28T22%3A06%3A33Z&se=2026-03-28T22%3A31%3A33Z&sr=b&sp=r&sig=Ascom%2BZDxKQh%2BFtTk23j2PXyfZx6maQlK%2F3ZwUvdUog%3D)
2026-03-28 22:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010926/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP05UXR/42810558?sv=2020-08-04&st=2026-03-28T22%3A06%3A32Z&se=2026-03-28T22%3A31%3A32Z&sr=b&sp=r&sig=oeBmjw6h7yhrRcDk7Az0DSC0qw6NipydgolxhmUcW6w%3D)
2026-03-28 22:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975532/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975532>
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547783dd0>
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb9c86d4-3652-5684-9f6c-db4bea055518/cb9c86d4-3652-5684-9f6c-db4bea055518_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR09VJO%252F698975310%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975310/600 saved to cache
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb9c86d4-3652-5684-9f6c-db4bea055518
2026-03-28 22:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010813/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KE04ECL/42810509?sv=2020-08-04&st=2026-03-28T22%3A06%3A33Z&se=2026-03-28T22%3A31%3A33Z&sr=b&sp=r&sig=Ascom%2BZDxKQh%2BFtTk23j2PXyfZx6maQlK%2F3ZwUvdUog%3D)
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544cbd10>
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb9c86d4-3652-5684-9f6c-db4bea055518/cb9c86d4-3652-5684-9f6c-db4bea055518_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR09VJO%252F698975369%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975369/600 saved to cache
2026-03-28 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb9c86d4-3652-5684-9f6c-db4bea055518
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55489e4d0>
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0379ad37-0288-50b0-bf91-fbe98128e386/0379ad37-0288-50b0-bf91-fbe98128e386_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP60LBZ%252F699010781%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010781/600 saved to cache
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0379ad37-0288-50b0-bf91-fbe98128e386
2026-03-28 22:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975449/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR09VJO/42810008?sv=2020-08-04&st=2026-03-28T22%3A06%3A34Z&se=2026-03-28T22%3A31%3A34Z&sr=b&sp=r&sig=aKbRLG16TZ1nY2%2FcD%2BZrCbLa1V8iWZctNa6W3Fpmjbg%3D)
2026-03-28 22:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010974/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010974>
2026-03-28 22:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975498/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975498>
2026-03-28 22:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975563/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975563>
2026-03-28 22:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010924/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010924>
2026-03-28 22:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010861/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP60LBZ/42810031?sv=2020-08-04&st=2026-03-28T22%3A06%3A33Z&se=2026-03-28T22%3A31%3A33Z&sr=b&sp=r&sig=3GaBsmw3hnsp9No2y3eY2AkbLUE5m1vAbGo5WjWqHUM%3D)
2026-03-28 22:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010893/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KE04ECL/42810509?sv=2020-08-04&st=2026-03-28T22%3A06%3A33Z&se=2026-03-28T22%3A31%3A33Z&sr=b&sp=r&sig=Ascom%2BZDxKQh%2BFtTk23j2PXyfZx6maQlK%2F3ZwUvdUog%3D)
2026-03-28 22:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975473/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR09VJO/42810008?sv=2020-08-04&st=2026-03-28T22%3A06%3A34Z&se=2026-03-28T22%3A31%3A34Z&sr=b&sp=r&sig=aKbRLG16TZ1nY2%2FcD%2BZrCbLa1V8iWZctNa6W3Fpmjbg%3D)
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55428f510>
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_172158fc-c6ba-569f-b467-7d56f3769264/172158fc-c6ba-569f-b467-7d56f3769264_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV67NMF%252F699159325%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159325/600 saved to cache
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 172158fc-c6ba-569f-b467-7d56f3769264
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5545ae610>
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0379ad37-0288-50b0-bf91-fbe98128e386/0379ad37-0288-50b0-bf91-fbe98128e386_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP60LBZ%252F699010823%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010823/600 saved to cache
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0379ad37-0288-50b0-bf91-fbe98128e386
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54732da10>
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea9ccc5-341e-59d0-9330-b505b5ad8888/6ea9ccc5-341e-59d0-9330-b505b5ad8888_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX06XUD%252F699010954%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010954/600 saved to cache
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6ea9ccc5-341e-59d0-9330-b505b5ad8888
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54732e950>
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba9a5f3-be93-54af-9867-b958cb5e410e/7ba9a5f3-be93-54af-9867-b958cb5e410e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKE04ECL%252F699010867%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010867/600 saved to cache
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7ba9a5f3-be93-54af-9867-b958cb5e410e
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a45350>
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_992fca31-db18-5535-9b9a-21d4a1d64a72/992fca31-db18-5535-9b9a-21d4a1d64a72_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP05UXR%252F699010926%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010926/600 saved to cache
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 992fca31-db18-5535-9b9a-21d4a1d64a72
2026-03-28 22:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010923/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010923>
2026-03-28 22:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010895/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010895>
2026-03-28 22:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010946/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010946>
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471a13d0>
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba9a5f3-be93-54af-9867-b958cb5e410e/7ba9a5f3-be93-54af-9867-b958cb5e410e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKE04ECL%252F699010813%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010813/600 saved to cache
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7ba9a5f3-be93-54af-9867-b958cb5e410e
2026-03-28 22:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010944/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP60LBZ/42810031?sv=2020-08-04&st=2026-03-28T22%3A06%3A33Z&se=2026-03-28T22%3A31%3A33Z&sr=b&sp=r&sig=3GaBsmw3hnsp9No2y3eY2AkbLUE5m1vAbGo5WjWqHUM%3D)
2026-03-28 22:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975532/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR09VJO/42810008?sv=2020-08-04&st=2026-03-28T22%3A06%3A34Z&se=2026-03-28T22%3A31%3A34Z&sr=b&sp=r&sig=aKbRLG16TZ1nY2%2FcD%2BZrCbLa1V8iWZctNa6W3Fpmjbg%3D)
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5541f4190>
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb9c86d4-3652-5684-9f6c-db4bea055518/cb9c86d4-3652-5684-9f6c-db4bea055518_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR09VJO%252F698975449%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975449/600 saved to cache
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb9c86d4-3652-5684-9f6c-db4bea055518
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b65810>
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0379ad37-0288-50b0-bf91-fbe98128e386/0379ad37-0288-50b0-bf91-fbe98128e386_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP60LBZ%252F699010861%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010861/600 saved to cache
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0379ad37-0288-50b0-bf91-fbe98128e386
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472a2090>
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba9a5f3-be93-54af-9867-b958cb5e410e/7ba9a5f3-be93-54af-9867-b958cb5e410e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKE04ECL%252F699010893%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010893/600 saved to cache
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7ba9a5f3-be93-54af-9867-b958cb5e410e
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554ae11d0>
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb9c86d4-3652-5684-9f6c-db4bea055518/cb9c86d4-3652-5684-9f6c-db4bea055518_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR09VJO%252F698975473%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975473/600 saved to cache
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb9c86d4-3652-5684-9f6c-db4bea055518
2026-03-28 22:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975413/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975413>
2026-03-28 22:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158365/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158365>
2026-03-28 22:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158378/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158378>
2026-03-28 22:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975563/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR09VJO/42810008?sv=2020-08-04&st=2026-03-28T22%3A06%3A34Z&se=2026-03-28T22%3A31%3A34Z&sr=b&sp=r&sig=aKbRLG16TZ1nY2%2FcD%2BZrCbLa1V8iWZctNa6W3Fpmjbg%3D)
2026-03-28 22:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010924/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP60LBZ/42810031?sv=2020-08-04&st=2026-03-28T22%3A06%3A33Z&se=2026-03-28T22%3A31%3A33Z&sr=b&sp=r&sig=3GaBsmw3hnsp9No2y3eY2AkbLUE5m1vAbGo5WjWqHUM%3D)
2026-03-28 22:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975498/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR09VJO/42810008?sv=2020-08-04&st=2026-03-28T22%3A06%3A34Z&se=2026-03-28T22%3A31%3A34Z&sr=b&sp=r&sig=aKbRLG16TZ1nY2%2FcD%2BZrCbLa1V8iWZctNa6W3Fpmjbg%3D)
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fd78d0>
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0379ad37-0288-50b0-bf91-fbe98128e386/0379ad37-0288-50b0-bf91-fbe98128e386_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP60LBZ%252F699010944%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010944/600 saved to cache
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0379ad37-0288-50b0-bf91-fbe98128e386
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556faf610>
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb9c86d4-3652-5684-9f6c-db4bea055518/cb9c86d4-3652-5684-9f6c-db4bea055518_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR09VJO%252F698975532%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975532/600 saved to cache
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb9c86d4-3652-5684-9f6c-db4bea055518
2026-03-28 22:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975391/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975391>
2026-03-28 22:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010974/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KE04ECL/42810509?sv=2020-08-04&st=2026-03-28T22%3A06%3A33Z&se=2026-03-28T22%3A31%3A33Z&sr=b&sp=r&sig=Ascom%2BZDxKQh%2BFtTk23j2PXyfZx6maQlK%2F3ZwUvdUog%3D)
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b41650>
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb9c86d4-3652-5684-9f6c-db4bea055518/cb9c86d4-3652-5684-9f6c-db4bea055518_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR09VJO%252F698975563%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975563/600 saved to cache
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb9c86d4-3652-5684-9f6c-db4bea055518
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547782510>
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0379ad37-0288-50b0-bf91-fbe98128e386/0379ad37-0288-50b0-bf91-fbe98128e386_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP60LBZ%252F699010924%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010924/600 saved to cache
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0379ad37-0288-50b0-bf91-fbe98128e386
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55431a7d0>
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb9c86d4-3652-5684-9f6c-db4bea055518/cb9c86d4-3652-5684-9f6c-db4bea055518_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR09VJO%252F698975498%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975498/600 saved to cache
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb9c86d4-3652-5684-9f6c-db4bea055518
2026-03-28 22:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010923/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KE04ECL/42810509?sv=2020-08-04&st=2026-03-28T22%3A06%3A33Z&se=2026-03-28T22%3A31%3A33Z&sr=b&sp=r&sig=Ascom%2BZDxKQh%2BFtTk23j2PXyfZx6maQlK%2F3ZwUvdUog%3D)
2026-03-28 22:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010978/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010978>
2026-03-28 22:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159336/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699159336>
2026-03-28 22:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010956/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010956>
2026-03-28 22:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010847/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010847>
2026-03-28 22:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010801/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010801>
2026-03-28 22:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010946/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KE04ECL/42810509?sv=2020-08-04&st=2026-03-28T22%3A06%3A33Z&se=2026-03-28T22%3A31%3A33Z&sr=b&sp=r&sig=Ascom%2BZDxKQh%2BFtTk23j2PXyfZx6maQlK%2F3ZwUvdUog%3D)
2026-03-28 22:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010895/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP60LBZ/42810031?sv=2020-08-04&st=2026-03-28T22%3A06%3A33Z&se=2026-03-28T22%3A31%3A33Z&sr=b&sp=r&sig=3GaBsmw3hnsp9No2y3eY2AkbLUE5m1vAbGo5WjWqHUM%3D)
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5541fc090>
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba9a5f3-be93-54af-9867-b958cb5e410e/7ba9a5f3-be93-54af-9867-b958cb5e410e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKE04ECL%252F699010974%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010974/600 saved to cache
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7ba9a5f3-be93-54af-9867-b958cb5e410e
2026-03-28 22:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975413/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR09VJO/42810008?sv=2020-08-04&st=2026-03-28T22%3A06%3A34Z&se=2026-03-28T22%3A31%3A34Z&sr=b&sp=r&sig=aKbRLG16TZ1nY2%2FcD%2BZrCbLa1V8iWZctNa6W3Fpmjbg%3D)
2026-03-28 22:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975339/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975339>
2026-03-28 22:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158352/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158352>
2026-03-28 22:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158343/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158343>
2026-03-28 22:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158365/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK66WKL/42809678?sv=2020-08-04&st=2026-03-28T22%3A06%3A31Z&se=2026-03-28T22%3A31%3A31Z&sr=b&sp=r&sig=GiRcAhCOYBxFcUqxASPaChe3ssVirE1Tda7AJNXRiQc%3D)
2026-03-28 22:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158378/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK66WKL/42809678?sv=2020-08-04&st=2026-03-28T22%3A06%3A31Z&se=2026-03-28T22%3A31%3A31Z&sr=b&sp=r&sig=GiRcAhCOYBxFcUqxASPaChe3ssVirE1Tda7AJNXRiQc%3D)
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554316d50>
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba9a5f3-be93-54af-9867-b958cb5e410e/7ba9a5f3-be93-54af-9867-b958cb5e410e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKE04ECL%252F699010923%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010923/600 saved to cache
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7ba9a5f3-be93-54af-9867-b958cb5e410e
2026-03-28 22:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975391/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR09VJO/42810008?sv=2020-08-04&st=2026-03-28T22%3A06%3A34Z&se=2026-03-28T22%3A31%3A34Z&sr=b&sp=r&sig=aKbRLG16TZ1nY2%2FcD%2BZrCbLa1V8iWZctNa6W3Fpmjbg%3D)
2026-03-28 22:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010889/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010889>
2026-03-28 22:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010801/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP60LBZ/42810031?sv=2020-08-04&st=2026-03-28T22%3A06%3A33Z&se=2026-03-28T22%3A31%3A33Z&sr=b&sp=r&sig=3GaBsmw3hnsp9No2y3eY2AkbLUE5m1vAbGo5WjWqHUM%3D)
2026-03-28 22:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010847/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KE04ECL/42810509?sv=2020-08-04&st=2026-03-28T22%3A06%3A33Z&se=2026-03-28T22%3A31%3A33Z&sr=b&sp=r&sig=Ascom%2BZDxKQh%2BFtTk23j2PXyfZx6maQlK%2F3ZwUvdUog%3D)
2026-03-28 22:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159308/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699159308>
2026-03-28 22:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010956/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP05UXR/42810558?sv=2020-08-04&st=2026-03-28T22%3A06%3A32Z&se=2026-03-28T22%3A31%3A32Z&sr=b&sp=r&sig=oeBmjw6h7yhrRcDk7Az0DSC0qw6NipydgolxhmUcW6w%3D)
2026-03-28 22:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010978/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX06XUD/42810500?sv=2020-08-04&st=2026-03-28T22%3A06%3A30Z&se=2026-03-28T22%3A31%3A30Z&sr=b&sp=r&sig=EsoSrfFB91c20kgXYpjr8TG3TdHxfVqotEOHQKGAgUw%3D)
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547782d50>
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba9a5f3-be93-54af-9867-b958cb5e410e/7ba9a5f3-be93-54af-9867-b958cb5e410e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKE04ECL%252F699010946%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010946/600 saved to cache
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7ba9a5f3-be93-54af-9867-b958cb5e410e
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547257c90>
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0379ad37-0288-50b0-bf91-fbe98128e386/0379ad37-0288-50b0-bf91-fbe98128e386_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP60LBZ%252F699010895%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010895/600 saved to cache
2026-03-28 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0379ad37-0288-50b0-bf91-fbe98128e386
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a62c50>
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb9c86d4-3652-5684-9f6c-db4bea055518/cb9c86d4-3652-5684-9f6c-db4bea055518_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR09VJO%252F698975413%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975413/600 saved to cache
2026-03-28 22:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb9c86d4-3652-5684-9f6c-db4bea055518
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547257a10>
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48020b9d-f1ca-5049-9c7b-c8f63a357c9e/48020b9d-f1ca-5049-9c7b-c8f63a357c9e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK66WKL%252F699158365%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158365/600 saved to cache
2026-03-28 22:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 48020b9d-f1ca-5049-9c7b-c8f63a357c9e
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547603ad0>
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48020b9d-f1ca-5049-9c7b-c8f63a357c9e/48020b9d-f1ca-5049-9c7b-c8f63a357c9e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK66WKL%252F699158378%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158378/600 saved to cache
2026-03-28 22:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 48020b9d-f1ca-5049-9c7b-c8f63a357c9e
2026-03-28 22:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159336/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV67NMF/42809798?sv=2020-08-04&st=2026-03-28T22%3A06%3A32Z&se=2026-03-28T22%3A31%3A32Z&sr=b&sp=r&sig=lKizQk1RoS6P9DBphb%2FP%2BEN1BYx9SlUGlkVfpOEs6ZM%3D)
2026-03-28 22:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975339/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR09VJO/42810008?sv=2020-08-04&st=2026-03-28T22%3A06%3A34Z&se=2026-03-28T22%3A31%3A34Z&sr=b&sp=r&sig=aKbRLG16TZ1nY2%2FcD%2BZrCbLa1V8iWZctNa6W3Fpmjbg%3D)
2026-03-28 22:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010753/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010753>
2026-03-28 22:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010933/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010933>
2026-03-28 22:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010785/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010785>
2026-03-28 22:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158332/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158332>
2026-03-28 22:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158343/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK66WKL/42809678?sv=2020-08-04&st=2026-03-28T22%3A06%3A31Z&se=2026-03-28T22%3A31%3A31Z&sr=b&sp=r&sig=GiRcAhCOYBxFcUqxASPaChe3ssVirE1Tda7AJNXRiQc%3D)
2026-03-28 22:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158352/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK66WKL/42809678?sv=2020-08-04&st=2026-03-28T22%3A06%3A31Z&se=2026-03-28T22%3A31%3A31Z&sr=b&sp=r&sig=GiRcAhCOYBxFcUqxASPaChe3ssVirE1Tda7AJNXRiQc%3D)
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b673d0>
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb9c86d4-3652-5684-9f6c-db4bea055518/cb9c86d4-3652-5684-9f6c-db4bea055518_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR09VJO%252F698975391%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975391/600 saved to cache
2026-03-28 22:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb9c86d4-3652-5684-9f6c-db4bea055518
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477e7dd0>
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0379ad37-0288-50b0-bf91-fbe98128e386/0379ad37-0288-50b0-bf91-fbe98128e386_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP60LBZ%252F699010801%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010801/600 saved to cache
2026-03-28 22:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0379ad37-0288-50b0-bf91-fbe98128e386
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554230810>
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba9a5f3-be93-54af-9867-b958cb5e410e/7ba9a5f3-be93-54af-9867-b958cb5e410e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKE04ECL%252F699010847%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010847/600 saved to cache
2026-03-28 22:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7ba9a5f3-be93-54af-9867-b958cb5e410e
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554857c10>
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_992fca31-db18-5535-9b9a-21d4a1d64a72/992fca31-db18-5535-9b9a-21d4a1d64a72_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP05UXR%252F699010956%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010956/600 saved to cache
2026-03-28 22:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 992fca31-db18-5535-9b9a-21d4a1d64a72
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a1ad50>
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea9ccc5-341e-59d0-9330-b505b5ad8888/6ea9ccc5-341e-59d0-9330-b505b5ad8888_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX06XUD%252F699010978%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010978/600 saved to cache
2026-03-28 22:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6ea9ccc5-341e-59d0-9330-b505b5ad8888
2026-03-28 22:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010889/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP05UXR/42810558?sv=2020-08-04&st=2026-03-28T22%3A06%3A32Z&se=2026-03-28T22%3A31%3A32Z&sr=b&sp=r&sig=oeBmjw6h7yhrRcDk7Az0DSC0qw6NipydgolxhmUcW6w%3D)
2026-03-28 22:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010905/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010905>
2026-03-28 22:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010730/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010730>
2026-03-28 22:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010864/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010864>
2026-03-28 22:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176714/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176714>
2026-03-28 22:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159296/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699159296>
2026-03-28 22:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010766/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010766>
2026-03-28 22:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159308/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV67NMF/42809798?sv=2020-08-04&st=2026-03-28T22%3A06%3A32Z&se=2026-03-28T22%3A31%3A32Z&sr=b&sp=r&sig=lKizQk1RoS6P9DBphb%2FP%2BEN1BYx9SlUGlkVfpOEs6ZM%3D)
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472c33d0>
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_172158fc-c6ba-569f-b467-7d56f3769264/172158fc-c6ba-569f-b467-7d56f3769264_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV67NMF%252F699159336%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159336/600 saved to cache
2026-03-28 22:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 172158fc-c6ba-569f-b467-7d56f3769264
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5542b4190>
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb9c86d4-3652-5684-9f6c-db4bea055518/cb9c86d4-3652-5684-9f6c-db4bea055518_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR09VJO%252F698975339%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975339/600 saved to cache
2026-03-28 22:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb9c86d4-3652-5684-9f6c-db4bea055518
2026-03-28 22:06:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb9c86d4-3652-5684-9f6c-db4bea055518, skipping ID generation
2026-03-28 22:06:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb9c86d4-3652-5684-9f6c-db4bea055518 sending to next pipeline
2026-03-28 22:06:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cb9c86d4-3652-5684-9f6c-db4bea055518, identifier: LR09%20VJO
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555ca5c10>
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48020b9d-f1ca-5049-9c7b-c8f63a357c9e/48020b9d-f1ca-5049-9c7b-c8f63a357c9e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK66WKL%252F699158343%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158343/600 saved to cache
2026-03-28 22:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 48020b9d-f1ca-5049-9c7b-c8f63a357c9e
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554316710>
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48020b9d-f1ca-5049-9c7b-c8f63a357c9e/48020b9d-f1ca-5049-9c7b-c8f63a357c9e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK66WKL%252F699158352%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158352/600 saved to cache
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 48020b9d-f1ca-5049-9c7b-c8f63a357c9e
2026-03-28 22:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cb9c86d4-3652-5684-9f6c-db4bea055518 with identifier: LR09%20VJO
2026-03-28 22:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cb9c86d4-3652-5684-9f6c-db4bea055518 with identifier: LR09%20VJO
2026-03-28 22:06:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cb9c86d4-3652-5684-9f6c-db4bea055518 with identifier: LR09%20VJO to the API
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975339/600>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb9c86d4-3652-5684-9f6c-db4bea055518/cb9c86d4-3652-5684-9f6c-db4bea055518_expert_report_file_76522c1a-54bd-4d0f-bcf9-4f04446becc7.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LR09%20VJO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'cb9c86d4-3652-5684-9f6c-db4bea055518',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LR09 VJO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LR09%20VJO&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'MAZDA',
'model': '2',
'odometer': 92192,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb9c86d4-3652-5684-9f6c-db4bea055518/cb9c86d4-3652-5684-9f6c-db4bea055518_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47621,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975310/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb9c86d4-3652-5684-9f6c-db4bea055518/cb9c86d4-3652-5684-9f6c-db4bea055518_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46053,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975339/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb9c86d4-3652-5684-9f6c-db4bea055518/cb9c86d4-3652-5684-9f6c-db4bea055518_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45301,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975369/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb9c86d4-3652-5684-9f6c-db4bea055518/cb9c86d4-3652-5684-9f6c-db4bea055518_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43057,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975391/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb9c86d4-3652-5684-9f6c-db4bea055518/cb9c86d4-3652-5684-9f6c-db4bea055518_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44685,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975413/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb9c86d4-3652-5684-9f6c-db4bea055518/cb9c86d4-3652-5684-9f6c-db4bea055518_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44169,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975449/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb9c86d4-3652-5684-9f6c-db4bea055518/cb9c86d4-3652-5684-9f6c-db4bea055518_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85616,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975473/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb9c86d4-3652-5684-9f6c-db4bea055518/cb9c86d4-3652-5684-9f6c-db4bea055518_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75426,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975498/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb9c86d4-3652-5684-9f6c-db4bea055518/cb9c86d4-3652-5684-9f6c-db4bea055518_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81242,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975532/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb9c86d4-3652-5684-9f6c-db4bea055518/cb9c86d4-3652-5684-9f6c-db4bea055518_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84308,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR09VJO/698975563/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'MAZDA 2 1.5 SPORT Hatchback',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'JMZDE135200119167',
'year': 2009}
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR09%2520VJO%27 HTTP/1.1" 200 None
2026-03-28 22:06:41 [bca.uk] INFO: Saving data for LR09%20VJO: {'created_time': 1774735601.423286, 'last_price_update_time': 1774735601.423296, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LR09%2520VJO') HTTP/1.1" 204 0
2026-03-28 22:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158332/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK66WKL/42809678?sv=2020-08-04&st=2026-03-28T22%3A06%3A31Z&se=2026-03-28T22%3A31%3A31Z&sr=b&sp=r&sig=GiRcAhCOYBxFcUqxASPaChe3ssVirE1Tda7AJNXRiQc%3D)
2026-03-28 22:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010785/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KE04ECL/42810509?sv=2020-08-04&st=2026-03-28T22%3A06%3A33Z&se=2026-03-28T22%3A31%3A33Z&sr=b&sp=r&sig=Ascom%2BZDxKQh%2BFtTk23j2PXyfZx6maQlK%2F3ZwUvdUog%3D)
2026-03-28 22:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010933/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX06XUD/42810500?sv=2020-08-04&st=2026-03-28T22%3A06%3A30Z&se=2026-03-28T22%3A31%3A30Z&sr=b&sp=r&sig=EsoSrfFB91c20kgXYpjr8TG3TdHxfVqotEOHQKGAgUw%3D)
2026-03-28 22:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176696/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176696>
2026-03-28 22:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010706/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FP60LBZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158326/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158326>
2026-03-28 22:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010753/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP60LBZ/42810031?sv=2020-08-04&st=2026-03-28T22%3A06%3A33Z&se=2026-03-28T22%3A31%3A33Z&sr=b&sp=r&sig=3GaBsmw3hnsp9No2y3eY2AkbLUE5m1vAbGo5WjWqHUM%3D)
2026-03-28 22:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010744/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KE04ECL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547152ed0>
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_992fca31-db18-5535-9b9a-21d4a1d64a72/992fca31-db18-5535-9b9a-21d4a1d64a72_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP05UXR%252F699010889%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010889/600 saved to cache
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 992fca31-db18-5535-9b9a-21d4a1d64a72
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554935110>
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_172158fc-c6ba-569f-b467-7d56f3769264/172158fc-c6ba-569f-b467-7d56f3769264_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV67NMF%252F699159308%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159308/600 saved to cache
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 172158fc-c6ba-569f-b467-7d56f3769264
2026-03-28 22:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010766/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KE04ECL/42810509?sv=2020-08-04&st=2026-03-28T22%3A06%3A33Z&se=2026-03-28T22%3A31%3A33Z&sr=b&sp=r&sig=Ascom%2BZDxKQh%2BFtTk23j2PXyfZx6maQlK%2F3ZwUvdUog%3D)
2026-03-28 22:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010864/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP05UXR/42810558?sv=2020-08-04&st=2026-03-28T22%3A06%3A32Z&se=2026-03-28T22%3A31%3A32Z&sr=b&sp=r&sig=oeBmjw6h7yhrRcDk7Az0DSC0qw6NipydgolxhmUcW6w%3D)
2026-03-28 22:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010730/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP60LBZ/42810031?sv=2020-08-04&st=2026-03-28T22%3A06%3A33Z&se=2026-03-28T22%3A31%3A33Z&sr=b&sp=r&sig=3GaBsmw3hnsp9No2y3eY2AkbLUE5m1vAbGo5WjWqHUM%3D)
2026-03-28 22:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158320/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158320>
2026-03-28 22:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010905/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX06XUD/42810500?sv=2020-08-04&st=2026-03-28T22%3A06%3A30Z&se=2026-03-28T22%3A31%3A30Z&sr=b&sp=r&sig=EsoSrfFB91c20kgXYpjr8TG3TdHxfVqotEOHQKGAgUw%3D)
2026-03-28 22:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159296/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV67NMF/42809798?sv=2020-08-04&st=2026-03-28T22%3A06%3A32Z&se=2026-03-28T22%3A31%3A32Z&sr=b&sp=r&sig=lKizQk1RoS6P9DBphb%2FP%2BEN1BYx9SlUGlkVfpOEs6ZM%3D)
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554907550>
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48020b9d-f1ca-5049-9c7b-c8f63a357c9e/48020b9d-f1ca-5049-9c7b-c8f63a357c9e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK66WKL%252F699158332%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158332/600 saved to cache
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 48020b9d-f1ca-5049-9c7b-c8f63a357c9e
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55497b8d0>
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba9a5f3-be93-54af-9867-b958cb5e410e/7ba9a5f3-be93-54af-9867-b958cb5e410e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKE04ECL%252F699010785%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010785/600 saved to cache
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7ba9a5f3-be93-54af-9867-b958cb5e410e
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5545af5d0>
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea9ccc5-341e-59d0-9330-b505b5ad8888/6ea9ccc5-341e-59d0-9330-b505b5ad8888_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX06XUD%252F699010933%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010933/600 saved to cache
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6ea9ccc5-341e-59d0-9330-b505b5ad8888
2026-03-28 22:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176714/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK19NOH/42807908?sv=2020-08-04&st=2026-03-28T22%3A06%3A30Z&se=2026-03-28T22%3A31%3A30Z&sr=b&sp=r&sig=rD3Vv7GDvTTwqOKVf200giGIHE48KJ5OcykHqguP%2F7A%3D)
2026-03-28 22:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010706/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP60LBZ/42810031?sv=2020-08-04&st=2026-03-28T22%3A06%3A33Z&se=2026-03-28T22%3A31%3A33Z&sr=b&sp=r&sig=3GaBsmw3hnsp9No2y3eY2AkbLUE5m1vAbGo5WjWqHUM%3D)
2026-03-28 22:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158326/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK66WKL/42809678?sv=2020-08-04&st=2026-03-28T22%3A06%3A31Z&se=2026-03-28T22%3A31%3A31Z&sr=b&sp=r&sig=GiRcAhCOYBxFcUqxASPaChe3ssVirE1Tda7AJNXRiQc%3D)
2026-03-28 22:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176685/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176685>
2026-03-28 22:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010959/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010959>
2026-03-28 22:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159275/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699159275>
2026-03-28 22:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010808/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010808>
2026-03-28 22:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176696/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK19NOH/42807908?sv=2020-08-04&st=2026-03-28T22%3A06%3A30Z&se=2026-03-28T22%3A31%3A30Z&sr=b&sp=r&sig=rD3Vv7GDvTTwqOKVf200giGIHE48KJ5OcykHqguP%2F7A%3D)
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555031a50>
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0379ad37-0288-50b0-bf91-fbe98128e386/0379ad37-0288-50b0-bf91-fbe98128e386_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP60LBZ%252F699010753%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010753/600 saved to cache
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0379ad37-0288-50b0-bf91-fbe98128e386
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472a1650>
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba9a5f3-be93-54af-9867-b958cb5e410e/7ba9a5f3-be93-54af-9867-b958cb5e410e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKE04ECL%252F699010766%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010766/600 saved to cache
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7ba9a5f3-be93-54af-9867-b958cb5e410e
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554554810>
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_992fca31-db18-5535-9b9a-21d4a1d64a72/992fca31-db18-5535-9b9a-21d4a1d64a72_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP05UXR%252F699010864%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010864/600 saved to cache
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 992fca31-db18-5535-9b9a-21d4a1d64a72
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54713ea10>
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0379ad37-0288-50b0-bf91-fbe98128e386/0379ad37-0288-50b0-bf91-fbe98128e386_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP60LBZ%252F699010730%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010730/600 saved to cache
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0379ad37-0288-50b0-bf91-fbe98128e386
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5545551d0>
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea9ccc5-341e-59d0-9330-b505b5ad8888/6ea9ccc5-341e-59d0-9330-b505b5ad8888_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX06XUD%252F699010905%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010905/600 saved to cache
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6ea9ccc5-341e-59d0-9330-b505b5ad8888
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472a2890>
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_172158fc-c6ba-569f-b467-7d56f3769264/172158fc-c6ba-569f-b467-7d56f3769264_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV67NMF%252F699159296%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159296/600 saved to cache
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 172158fc-c6ba-569f-b467-7d56f3769264
2026-03-28 22:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158320/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK66WKL/42809678?sv=2020-08-04&st=2026-03-28T22%3A06%3A31Z&se=2026-03-28T22%3A31%3A31Z&sr=b&sp=r&sig=GiRcAhCOYBxFcUqxASPaChe3ssVirE1Tda7AJNXRiQc%3D)
2026-03-28 22:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010744/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KE04ECL/42810509?sv=2020-08-04&st=2026-03-28T22%3A06%3A33Z&se=2026-03-28T22%3A31%3A33Z&sr=b&sp=r&sig=Ascom%2BZDxKQh%2BFtTk23j2PXyfZx6maQlK%2F3ZwUvdUog%3D)
2026-03-28 22:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010845/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010845>
2026-03-28 22:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159267/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699159267>
2026-03-28 22:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010787/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010787>
2026-03-28 22:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010818/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010818>
2026-03-28 22:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010760/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010760>
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547485f10>
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e320279-d073-5e8e-aee4-113575c202cf/3e320279-d073-5e8e-aee4-113575c202cf_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK19NOH%252F699176714%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176714/600 saved to cache
2026-03-28 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3e320279-d073-5e8e-aee4-113575c202cf
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477e6b50>
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0379ad37-0288-50b0-bf91-fbe98128e386/0379ad37-0288-50b0-bf91-fbe98128e386_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP60LBZ%252F699010706%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010706/600 saved to cache
2026-03-28 22:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0379ad37-0288-50b0-bf91-fbe98128e386
2026-03-28 22:06:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0379ad37-0288-50b0-bf91-fbe98128e386, skipping ID generation
2026-03-28 22:06:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0379ad37-0288-50b0-bf91-fbe98128e386 sending to next pipeline
2026-03-28 22:06:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0379ad37-0288-50b0-bf91-fbe98128e386, identifier: FP60%20LBZ
2026-03-28 22:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473ba790>
2026-03-28 22:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48020b9d-f1ca-5049-9c7b-c8f63a357c9e/48020b9d-f1ca-5049-9c7b-c8f63a357c9e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK66WKL%252F699158326%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158326/600 saved to cache
2026-03-28 22:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 48020b9d-f1ca-5049-9c7b-c8f63a357c9e
2026-03-28 22:06:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547396390>
2026-03-28 22:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e320279-d073-5e8e-aee4-113575c202cf/3e320279-d073-5e8e-aee4-113575c202cf_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK19NOH%252F699176696%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176696/600 saved to cache
2026-03-28 22:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3e320279-d073-5e8e-aee4-113575c202cf
2026-03-28 22:06:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0379ad37-0288-50b0-bf91-fbe98128e386 with identifier: FP60%20LBZ
2026-03-28 22:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0379ad37-0288-50b0-bf91-fbe98128e386 with identifier: FP60%20LBZ
2026-03-28 22:06:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0379ad37-0288-50b0-bf91-fbe98128e386 with identifier: FP60%20LBZ to the API
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010706/600>
{'auction_title': '',
'c_o_2_emission_value': 192,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0379ad37-0288-50b0-bf91-fbe98128e386/0379ad37-0288-50b0-bf91-fbe98128e386_expert_report_file_2b77112e-81fa-438f-9ca6-d6d854fe7d88.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FP60%20LBZ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0379ad37-0288-50b0-bf91-fbe98128e386',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FP60 LBZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FP60%20LBZ&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'VAUXHALL',
'model': 'INSIGNIA',
'odometer': 148055,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0379ad37-0288-50b0-bf91-fbe98128e386/0379ad37-0288-50b0-bf91-fbe98128e386_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50619,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010706/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0379ad37-0288-50b0-bf91-fbe98128e386/0379ad37-0288-50b0-bf91-fbe98128e386_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49005,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010730/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0379ad37-0288-50b0-bf91-fbe98128e386/0379ad37-0288-50b0-bf91-fbe98128e386_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46622,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010753/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0379ad37-0288-50b0-bf91-fbe98128e386/0379ad37-0288-50b0-bf91-fbe98128e386_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44832,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010781/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0379ad37-0288-50b0-bf91-fbe98128e386/0379ad37-0288-50b0-bf91-fbe98128e386_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45554,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010801/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0379ad37-0288-50b0-bf91-fbe98128e386/0379ad37-0288-50b0-bf91-fbe98128e386_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45077,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010823/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0379ad37-0288-50b0-bf91-fbe98128e386/0379ad37-0288-50b0-bf91-fbe98128e386_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85212,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010861/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0379ad37-0288-50b0-bf91-fbe98128e386/0379ad37-0288-50b0-bf91-fbe98128e386_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77437,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010895/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0379ad37-0288-50b0-bf91-fbe98128e386/0379ad37-0288-50b0-bf91-fbe98128e386_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81666,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010924/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0379ad37-0288-50b0-bf91-fbe98128e386/0379ad37-0288-50b0-bf91-fbe98128e386_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92639,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP60LBZ/699010944/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'VAUXHALL INSIGNIA 2.0 T 16V ELITE Saloon',
'transmission': 'manual',
'trim': 'T 16V ELITE',
'vin': 'W0LGT5EE4B1094581',
'year': 2011}
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP60%2520LBZ%27 HTTP/1.1" 200 None
2026-03-28 22:06:42 [bca.uk] INFO: Saving data for FP60%20LBZ: {'created_time': 1774735602.606777, 'last_price_update_time': 1774735602.606788, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FP60%2520LBZ') HTTP/1.1" 204 0
2026-03-28 22:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159263/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699159263>
2026-03-28 22:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010808/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP05UXR/42810558?sv=2020-08-04&st=2026-03-28T22%3A06%3A32Z&se=2026-03-28T22%3A31%3A32Z&sr=b&sp=r&sig=oeBmjw6h7yhrRcDk7Az0DSC0qw6NipydgolxhmUcW6w%3D)
2026-03-28 22:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159275/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV67NMF/42809798?sv=2020-08-04&st=2026-03-28T22%3A06%3A32Z&se=2026-03-28T22%3A31%3A32Z&sr=b&sp=r&sig=lKizQk1RoS6P9DBphb%2FP%2BEN1BYx9SlUGlkVfpOEs6ZM%3D)
2026-03-28 22:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176663/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176663>
2026-03-28 22:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010795/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010795>
2026-03-28 22:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158296/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LK66WKL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176685/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK19NOH/42807908?sv=2020-08-04&st=2026-03-28T22%3A06%3A30Z&se=2026-03-28T22%3A31%3A30Z&sr=b&sp=r&sig=rD3Vv7GDvTTwqOKVf200giGIHE48KJ5OcykHqguP%2F7A%3D)
2026-03-28 22:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010959/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK59LFU/42810532?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=HXSOt9sDMupOgYbsEXCjSHCKuR31TJPXV6ppJsslvik%3D)
2026-03-28 22:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549f13d0>
2026-03-28 22:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48020b9d-f1ca-5049-9c7b-c8f63a357c9e/48020b9d-f1ca-5049-9c7b-c8f63a357c9e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK66WKL%252F699158320%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158320/600 saved to cache
2026-03-28 22:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 48020b9d-f1ca-5049-9c7b-c8f63a357c9e
2026-03-28 22:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554855690>
2026-03-28 22:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba9a5f3-be93-54af-9867-b958cb5e410e/7ba9a5f3-be93-54af-9867-b958cb5e410e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKE04ECL%252F699010744%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010744/600 saved to cache
2026-03-28 22:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ba9a5f3-be93-54af-9867-b958cb5e410e
2026-03-28 22:06:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ba9a5f3-be93-54af-9867-b958cb5e410e, skipping ID generation
2026-03-28 22:06:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ba9a5f3-be93-54af-9867-b958cb5e410e sending to next pipeline
2026-03-28 22:06:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7ba9a5f3-be93-54af-9867-b958cb5e410e, identifier: KE04%20ECL
2026-03-28 22:06:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7ba9a5f3-be93-54af-9867-b958cb5e410e with identifier: KE04%20ECL
2026-03-28 22:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7ba9a5f3-be93-54af-9867-b958cb5e410e with identifier: KE04%20ECL
2026-03-28 22:06:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7ba9a5f3-be93-54af-9867-b958cb5e410e with identifier: KE04%20ECL to the API
2026-03-28 22:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010744/600>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba9a5f3-be93-54af-9867-b958cb5e410e/7ba9a5f3-be93-54af-9867-b958cb5e410e_expert_report_file_78b2c94a-38a1-436a-88b9-3901770e5bf7.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KE04%20ECL-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7ba9a5f3-be93-54af-9867-b958cb5e410e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KE04 ECL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KE04%20ECL&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 89004,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba9a5f3-be93-54af-9867-b958cb5e410e/7ba9a5f3-be93-54af-9867-b958cb5e410e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43388,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010744/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba9a5f3-be93-54af-9867-b958cb5e410e/7ba9a5f3-be93-54af-9867-b958cb5e410e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42044,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010766/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba9a5f3-be93-54af-9867-b958cb5e410e/7ba9a5f3-be93-54af-9867-b958cb5e410e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39857,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010785/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba9a5f3-be93-54af-9867-b958cb5e410e/7ba9a5f3-be93-54af-9867-b958cb5e410e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38049,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010813/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba9a5f3-be93-54af-9867-b958cb5e410e/7ba9a5f3-be93-54af-9867-b958cb5e410e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38350,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010847/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba9a5f3-be93-54af-9867-b958cb5e410e/7ba9a5f3-be93-54af-9867-b958cb5e410e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38437,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010867/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba9a5f3-be93-54af-9867-b958cb5e410e/7ba9a5f3-be93-54af-9867-b958cb5e410e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65327,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010893/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba9a5f3-be93-54af-9867-b958cb5e410e/7ba9a5f3-be93-54af-9867-b958cb5e410e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60547,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010923/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba9a5f3-be93-54af-9867-b958cb5e410e/7ba9a5f3-be93-54af-9867-b958cb5e410e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94409,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010946/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba9a5f3-be93-54af-9867-b958cb5e410e/7ba9a5f3-be93-54af-9867-b958cb5e410e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74441,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KE04ECL/699010974/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 ENERGY 16V Hatchback',
'transmission': 'manual',
'trim': 'ENERGY 16V',
'vin': 'W0L0XCF6844436990',
'year': 2004}
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE04%2520ECL%27 HTTP/1.1" 200 None
2026-03-28 22:06:43 [bca.uk] INFO: Saving data for KE04%20ECL: {'created_time': 1774735603.19572, 'last_price_update_time': 1774735603.195731, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KE04%2520ECL') HTTP/1.1" 204 0
2026-03-28 22:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010845/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX06XUD/42810500?sv=2020-08-04&st=2026-03-28T22%3A06%3A30Z&se=2026-03-28T22%3A31%3A30Z&sr=b&sp=r&sig=EsoSrfFB91c20kgXYpjr8TG3TdHxfVqotEOHQKGAgUw%3D)
2026-03-28 22:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159267/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV67NMF/42809798?sv=2020-08-04&st=2026-03-28T22%3A06%3A32Z&se=2026-03-28T22%3A31%3A32Z&sr=b&sp=r&sig=lKizQk1RoS6P9DBphb%2FP%2BEN1BYx9SlUGlkVfpOEs6ZM%3D)
2026-03-28 22:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010818/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX06XUD/42810500?sv=2020-08-04&st=2026-03-28T22%3A06%3A30Z&se=2026-03-28T22%3A31%3A30Z&sr=b&sp=r&sig=EsoSrfFB91c20kgXYpjr8TG3TdHxfVqotEOHQKGAgUw%3D)
2026-03-28 22:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010760/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP05UXR/42810558?sv=2020-08-04&st=2026-03-28T22%3A06%3A32Z&se=2026-03-28T22%3A31%3A32Z&sr=b&sp=r&sig=oeBmjw6h7yhrRcDk7Az0DSC0qw6NipydgolxhmUcW6w%3D)
2026-03-28 22:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010787/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP05UXR/42810558?sv=2020-08-04&st=2026-03-28T22%3A06%3A32Z&se=2026-03-28T22%3A31%3A32Z&sr=b&sp=r&sig=oeBmjw6h7yhrRcDk7Az0DSC0qw6NipydgolxhmUcW6w%3D)
2026-03-28 22:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010872/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010872>
2026-03-28 22:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010832/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010832>
2026-03-28 22:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010720/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KP05UXR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fab250>
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_992fca31-db18-5535-9b9a-21d4a1d64a72/992fca31-db18-5535-9b9a-21d4a1d64a72_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP05UXR%252F699010808%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010808/600 saved to cache
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 992fca31-db18-5535-9b9a-21d4a1d64a72
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54739cb90>
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_172158fc-c6ba-569f-b467-7d56f3769264/172158fc-c6ba-569f-b467-7d56f3769264_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV67NMF%252F699159275%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159275/600 saved to cache
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 172158fc-c6ba-569f-b467-7d56f3769264
2026-03-28 22:06:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b41e50>
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e320279-d073-5e8e-aee4-113575c202cf/3e320279-d073-5e8e-aee4-113575c202cf_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK19NOH%252F699176685%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176685/600 saved to cache
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3e320279-d073-5e8e-aee4-113575c202cf
2026-03-28 22:06:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54739de50>
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a83e0fd1-5b31-5398-90ed-f3506792a1a5/a83e0fd1-5b31-5398-90ed-f3506792a1a5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK59LFU%252F699010959%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010959/600 saved to cache
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a83e0fd1-5b31-5398-90ed-f3506792a1a5
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554315310>
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea9ccc5-341e-59d0-9330-b505b5ad8888/6ea9ccc5-341e-59d0-9330-b505b5ad8888_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX06XUD%252F699010845%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010845/600 saved to cache
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ea9ccc5-341e-59d0-9330-b505b5ad8888
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f81d90>
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_172158fc-c6ba-569f-b467-7d56f3769264/172158fc-c6ba-569f-b467-7d56f3769264_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV67NMF%252F699159267%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159267/600 saved to cache
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 172158fc-c6ba-569f-b467-7d56f3769264
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471b1f90>
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea9ccc5-341e-59d0-9330-b505b5ad8888/6ea9ccc5-341e-59d0-9330-b505b5ad8888_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX06XUD%252F699010818%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010818/600 saved to cache
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ea9ccc5-341e-59d0-9330-b505b5ad8888
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547254950>
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_992fca31-db18-5535-9b9a-21d4a1d64a72/992fca31-db18-5535-9b9a-21d4a1d64a72_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP05UXR%252F699010760%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010760/600 saved to cache
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 992fca31-db18-5535-9b9a-21d4a1d64a72
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547152290>
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_992fca31-db18-5535-9b9a-21d4a1d64a72/992fca31-db18-5535-9b9a-21d4a1d64a72_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP05UXR%252F699010787%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010787/600 saved to cache
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 992fca31-db18-5535-9b9a-21d4a1d64a72
2026-03-28 22:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159263/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV67NMF/42809798?sv=2020-08-04&st=2026-03-28T22%3A06%3A32Z&se=2026-03-28T22%3A31%3A32Z&sr=b&sp=r&sig=lKizQk1RoS6P9DBphb%2FP%2BEN1BYx9SlUGlkVfpOEs6ZM%3D)
2026-03-28 22:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176663/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK19NOH/42807908?sv=2020-08-04&st=2026-03-28T22%3A06%3A30Z&se=2026-03-28T22%3A31%3A30Z&sr=b&sp=r&sig=rD3Vv7GDvTTwqOKVf200giGIHE48KJ5OcykHqguP%2F7A%3D)
2026-03-28 22:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158296/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK66WKL/42809678?sv=2020-08-04&st=2026-03-28T22%3A06%3A31Z&se=2026-03-28T22%3A31%3A31Z&sr=b&sp=r&sig=GiRcAhCOYBxFcUqxASPaChe3ssVirE1Tda7AJNXRiQc%3D)
2026-03-28 22:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010795/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX06XUD/42810500?sv=2020-08-04&st=2026-03-28T22%3A06%3A30Z&se=2026-03-28T22%3A31%3A30Z&sr=b&sp=r&sig=EsoSrfFB91c20kgXYpjr8TG3TdHxfVqotEOHQKGAgUw%3D)
2026-03-28 22:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176654/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699176654>
2026-03-28 22:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010802/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010802>
2026-03-28 22:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159246/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WV67NMF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010750/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KX06XUD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010772/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010772>
2026-03-28 22:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015873/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015873>
2026-03-28 22:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176644/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YK19NOH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010751/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010751>
2026-03-28 22:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015896/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015896>
2026-03-28 22:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010720/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP05UXR/42810558?sv=2020-08-04&st=2026-03-28T22%3A06%3A32Z&se=2026-03-28T22%3A31%3A32Z&sr=b&sp=r&sig=oeBmjw6h7yhrRcDk7Az0DSC0qw6NipydgolxhmUcW6w%3D)
2026-03-28 22:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010832/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK59LFU/42810532?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=HXSOt9sDMupOgYbsEXCjSHCKuR31TJPXV6ppJsslvik%3D)
2026-03-28 22:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010872/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK59LFU/42810532?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=HXSOt9sDMupOgYbsEXCjSHCKuR31TJPXV6ppJsslvik%3D)
2026-03-28 22:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010750/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX06XUD/42810500?sv=2020-08-04&st=2026-03-28T22%3A06%3A30Z&se=2026-03-28T22%3A31%3A30Z&sr=b&sp=r&sig=EsoSrfFB91c20kgXYpjr8TG3TdHxfVqotEOHQKGAgUw%3D)
2026-03-28 22:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159246/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV67NMF/42809798?sv=2020-08-04&st=2026-03-28T22%3A06%3A32Z&se=2026-03-28T22%3A31%3A32Z&sr=b&sp=r&sig=lKizQk1RoS6P9DBphb%2FP%2BEN1BYx9SlUGlkVfpOEs6ZM%3D)
2026-03-28 22:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176654/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK19NOH/42807908?sv=2020-08-04&st=2026-03-28T22%3A06%3A30Z&se=2026-03-28T22%3A31%3A30Z&sr=b&sp=r&sig=rD3Vv7GDvTTwqOKVf200giGIHE48KJ5OcykHqguP%2F7A%3D)
2026-03-28 22:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010802/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK59LFU/42810532?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=HXSOt9sDMupOgYbsEXCjSHCKuR31TJPXV6ppJsslvik%3D)
2026-03-28 22:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015829/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015829>
2026-03-28 22:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015765/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015765>
2026-03-28 22:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010713/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LK59LFU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015690/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015690>
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543e9650>
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_172158fc-c6ba-569f-b467-7d56f3769264/172158fc-c6ba-569f-b467-7d56f3769264_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV67NMF%252F699159263%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159263/600 saved to cache
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 172158fc-c6ba-569f-b467-7d56f3769264
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a8fd50>
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e320279-d073-5e8e-aee4-113575c202cf/3e320279-d073-5e8e-aee4-113575c202cf_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK19NOH%252F699176663%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176663/600 saved to cache
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3e320279-d073-5e8e-aee4-113575c202cf
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554979a90>
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48020b9d-f1ca-5049-9c7b-c8f63a357c9e/48020b9d-f1ca-5049-9c7b-c8f63a357c9e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK66WKL%252F699158296%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158296/600 saved to cache
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 48020b9d-f1ca-5049-9c7b-c8f63a357c9e
2026-03-28 22:06:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 48020b9d-f1ca-5049-9c7b-c8f63a357c9e, skipping ID generation
2026-03-28 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 48020b9d-f1ca-5049-9c7b-c8f63a357c9e sending to next pipeline
2026-03-28 22:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 48020b9d-f1ca-5049-9c7b-c8f63a357c9e, identifier: LK66%20WKL
2026-03-28 22:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54739c9d0>
2026-03-28 22:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea9ccc5-341e-59d0-9330-b505b5ad8888/6ea9ccc5-341e-59d0-9330-b505b5ad8888_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX06XUD%252F699010795%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010795/600 saved to cache
2026-03-28 22:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ea9ccc5-341e-59d0-9330-b505b5ad8888
2026-03-28 22:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549ac0d0>
2026-03-28 22:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_992fca31-db18-5535-9b9a-21d4a1d64a72/992fca31-db18-5535-9b9a-21d4a1d64a72_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP05UXR%252F699010720%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010720/600 saved to cache
2026-03-28 22:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 992fca31-db18-5535-9b9a-21d4a1d64a72
2026-03-28 22:06:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 992fca31-db18-5535-9b9a-21d4a1d64a72, skipping ID generation
2026-03-28 22:06:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 992fca31-db18-5535-9b9a-21d4a1d64a72 sending to next pipeline
2026-03-28 22:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 992fca31-db18-5535-9b9a-21d4a1d64a72, identifier: KP05%20UXR
2026-03-28 22:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55456e890>
2026-03-28 22:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a83e0fd1-5b31-5398-90ed-f3506792a1a5/a83e0fd1-5b31-5398-90ed-f3506792a1a5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK59LFU%252F699010832%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010832/600 saved to cache
2026-03-28 22:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a83e0fd1-5b31-5398-90ed-f3506792a1a5
2026-03-28 22:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 48020b9d-f1ca-5049-9c7b-c8f63a357c9e with identifier: LK66%20WKL
2026-03-28 22:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 48020b9d-f1ca-5049-9c7b-c8f63a357c9e with identifier: LK66%20WKL
2026-03-28 22:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 48020b9d-f1ca-5049-9c7b-c8f63a357c9e with identifier: LK66%20WKL to the API
2026-03-28 22:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158296/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48020b9d-f1ca-5049-9c7b-c8f63a357c9e/48020b9d-f1ca-5049-9c7b-c8f63a357c9e_expert_report_file_5a79053c-8c55-4fd9-a58a-302a754fac05.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LK66%20WKL-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '48020b9d-f1ca-5049-9c7b-c8f63a357c9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LK66 WKL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LK66%20WKL&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'NISSAN',
'model': 'X-TRAIL',
'odometer': 82419,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48020b9d-f1ca-5049-9c7b-c8f63a357c9e/48020b9d-f1ca-5049-9c7b-c8f63a357c9e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48670,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158296/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48020b9d-f1ca-5049-9c7b-c8f63a357c9e/48020b9d-f1ca-5049-9c7b-c8f63a357c9e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47990,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158304/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48020b9d-f1ca-5049-9c7b-c8f63a357c9e/48020b9d-f1ca-5049-9c7b-c8f63a357c9e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45549,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158309/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48020b9d-f1ca-5049-9c7b-c8f63a357c9e/48020b9d-f1ca-5049-9c7b-c8f63a357c9e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44952,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158320/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48020b9d-f1ca-5049-9c7b-c8f63a357c9e/48020b9d-f1ca-5049-9c7b-c8f63a357c9e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40915,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158326/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48020b9d-f1ca-5049-9c7b-c8f63a357c9e/48020b9d-f1ca-5049-9c7b-c8f63a357c9e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40625,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158332/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48020b9d-f1ca-5049-9c7b-c8f63a357c9e/48020b9d-f1ca-5049-9c7b-c8f63a357c9e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94203,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158343/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48020b9d-f1ca-5049-9c7b-c8f63a357c9e/48020b9d-f1ca-5049-9c7b-c8f63a357c9e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74867,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158352/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48020b9d-f1ca-5049-9c7b-c8f63a357c9e/48020b9d-f1ca-5049-9c7b-c8f63a357c9e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87307,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158365/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48020b9d-f1ca-5049-9c7b-c8f63a357c9e/48020b9d-f1ca-5049-9c7b-c8f63a357c9e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81218,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK66WKL/699158378/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'NISSAN X-TRAIL 1.6 DCI 130 N-TEC (5ST) XTRONIC StationWagon',
'transmission': 'automatic',
'trim': 'DCI 130 N-TEC (5ST) XTRONIC',
'vin': 'JN1TCAT32U0040851',
'year': 2016}
2026-03-28 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK66%2520WKL%27 HTTP/1.1" 200 None
2026-03-28 22:06:44 [bca.uk] INFO: Saving data for LK66%20WKL: {'created_time': 1774735604.587847, 'last_price_update_time': 1774735604.587858, 'auction_closing_time': 1774864800.0}
2026-03-28 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LK66%2520WKL') HTTP/1.1" 204 0
2026-03-28 22:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 992fca31-db18-5535-9b9a-21d4a1d64a72 with identifier: KP05%20UXR
2026-03-28 22:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 992fca31-db18-5535-9b9a-21d4a1d64a72 with identifier: KP05%20UXR
2026-03-28 22:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 992fca31-db18-5535-9b9a-21d4a1d64a72 with identifier: KP05%20UXR to the API
2026-03-28 22:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010720/600>
{'auction_title': '',
'c_o_2_emission_value': 218,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_992fca31-db18-5535-9b9a-21d4a1d64a72/992fca31-db18-5535-9b9a-21d4a1d64a72_expert_report_file_3ef19788-0487-4b6b-a3ec-f92c33faffac.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KP05%20UXR-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '992fca31-db18-5535-9b9a-21d4a1d64a72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KP05 UXR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KP05%20UXR&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'FORD',
'model': 'MONDEO',
'odometer': 174243,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_992fca31-db18-5535-9b9a-21d4a1d64a72/992fca31-db18-5535-9b9a-21d4a1d64a72_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42160,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010720/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_992fca31-db18-5535-9b9a-21d4a1d64a72/992fca31-db18-5535-9b9a-21d4a1d64a72_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41145,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010735/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_992fca31-db18-5535-9b9a-21d4a1d64a72/992fca31-db18-5535-9b9a-21d4a1d64a72_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37443,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010760/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_992fca31-db18-5535-9b9a-21d4a1d64a72/992fca31-db18-5535-9b9a-21d4a1d64a72_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37459,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010787/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_992fca31-db18-5535-9b9a-21d4a1d64a72/992fca31-db18-5535-9b9a-21d4a1d64a72_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35642,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010808/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_992fca31-db18-5535-9b9a-21d4a1d64a72/992fca31-db18-5535-9b9a-21d4a1d64a72_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36167,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010834/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_992fca31-db18-5535-9b9a-21d4a1d64a72/992fca31-db18-5535-9b9a-21d4a1d64a72_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54698,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010864/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_992fca31-db18-5535-9b9a-21d4a1d64a72/992fca31-db18-5535-9b9a-21d4a1d64a72_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59484,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010889/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_992fca31-db18-5535-9b9a-21d4a1d64a72/992fca31-db18-5535-9b9a-21d4a1d64a72_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91840,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010926/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_992fca31-db18-5535-9b9a-21d4a1d64a72/992fca31-db18-5535-9b9a-21d4a1d64a72_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70523,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP05UXR/699010956/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'FORD MONDEO 2.0 ZETEC Hatchback',
'transmission': 'automatic',
'trim': 'ZETEC',
'vin': 'WF05XXGBB54D29224',
'year': 2005}
2026-03-28 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP05%2520UXR%27 HTTP/1.1" 200 None
2026-03-28 22:06:44 [bca.uk] INFO: Saving data for KP05%20UXR: {'created_time': 1774735604.985317, 'last_price_update_time': 1774735604.985326, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KP05%2520UXR') HTTP/1.1" 204 0
2026-03-28 22:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010772/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK59LFU/42810532?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=HXSOt9sDMupOgYbsEXCjSHCKuR31TJPXV6ppJsslvik%3D)
2026-03-28 22:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176644/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK19NOH/42807908?sv=2020-08-04&st=2026-03-28T22%3A06%3A30Z&se=2026-03-28T22%3A31%3A30Z&sr=b&sp=r&sig=rD3Vv7GDvTTwqOKVf200giGIHE48KJ5OcykHqguP%2F7A%3D)
2026-03-28 22:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010751/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK59LFU/42810532?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=HXSOt9sDMupOgYbsEXCjSHCKuR31TJPXV6ppJsslvik%3D)
2026-03-28 22:06:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015726/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015726>
2026-03-28 22:06:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015670/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015670>
2026-03-28 22:06:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015677/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015677>
2026-03-28 22:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015873/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV18MMU/42810984?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=awaP9bI91lSo%2Fl13T4OiJNtRsbOn8slS8eNX2y8Uzxg%3D)
2026-03-28 22:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015896/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV18MMU/42810984?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=awaP9bI91lSo%2Fl13T4OiJNtRsbOn8slS8eNX2y8Uzxg%3D)
2026-03-28 22:06:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543b9050>
2026-03-28 22:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a83e0fd1-5b31-5398-90ed-f3506792a1a5/a83e0fd1-5b31-5398-90ed-f3506792a1a5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK59LFU%252F699010872%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010872/600 saved to cache
2026-03-28 22:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a83e0fd1-5b31-5398-90ed-f3506792a1a5
2026-03-28 22:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554907ed0>
2026-03-28 22:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea9ccc5-341e-59d0-9330-b505b5ad8888/6ea9ccc5-341e-59d0-9330-b505b5ad8888_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX06XUD%252F699010750%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010750/600 saved to cache
2026-03-28 22:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ea9ccc5-341e-59d0-9330-b505b5ad8888
2026-03-28 22:06:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ea9ccc5-341e-59d0-9330-b505b5ad8888, skipping ID generation
2026-03-28 22:06:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ea9ccc5-341e-59d0-9330-b505b5ad8888 sending to next pipeline
2026-03-28 22:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6ea9ccc5-341e-59d0-9330-b505b5ad8888, identifier: KX06%20XUD
2026-03-28 22:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555c6de50>
2026-03-28 22:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_172158fc-c6ba-569f-b467-7d56f3769264/172158fc-c6ba-569f-b467-7d56f3769264_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV67NMF%252F699159246%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159246/600 saved to cache
2026-03-28 22:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 172158fc-c6ba-569f-b467-7d56f3769264
2026-03-28 22:06:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 172158fc-c6ba-569f-b467-7d56f3769264, skipping ID generation
2026-03-28 22:06:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 172158fc-c6ba-569f-b467-7d56f3769264 sending to next pipeline
2026-03-28 22:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 172158fc-c6ba-569f-b467-7d56f3769264, identifier: WV67%20NMF
2026-03-28 22:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471c0c50>
2026-03-28 22:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e320279-d073-5e8e-aee4-113575c202cf/3e320279-d073-5e8e-aee4-113575c202cf_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK19NOH%252F699176654%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176654/600 saved to cache
2026-03-28 22:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3e320279-d073-5e8e-aee4-113575c202cf
2026-03-28 22:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55429df50>
2026-03-28 22:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a83e0fd1-5b31-5398-90ed-f3506792a1a5/a83e0fd1-5b31-5398-90ed-f3506792a1a5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK59LFU%252F699010802%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010802/600 saved to cache
2026-03-28 22:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a83e0fd1-5b31-5398-90ed-f3506792a1a5
2026-03-28 22:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6ea9ccc5-341e-59d0-9330-b505b5ad8888 with identifier: KX06%20XUD
2026-03-28 22:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6ea9ccc5-341e-59d0-9330-b505b5ad8888 with identifier: KX06%20XUD
2026-03-28 22:06:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6ea9ccc5-341e-59d0-9330-b505b5ad8888 with identifier: KX06%20XUD to the API
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010750/600>
{'auction_title': '',
'c_o_2_emission_value': 167,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea9ccc5-341e-59d0-9330-b505b5ad8888/6ea9ccc5-341e-59d0-9330-b505b5ad8888_expert_report_file_0978bab6-19ea-4df5-831b-3b0fa12eb4c5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KX06%20XUD-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '6ea9ccc5-341e-59d0-9330-b505b5ad8888',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KX06 XUD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KX06%20XUD&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'TOYOTA',
'model': 'COROLLA VERSO',
'odometer': 136432,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea9ccc5-341e-59d0-9330-b505b5ad8888/6ea9ccc5-341e-59d0-9330-b505b5ad8888_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41641,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010750/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea9ccc5-341e-59d0-9330-b505b5ad8888/6ea9ccc5-341e-59d0-9330-b505b5ad8888_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41178,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010775/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea9ccc5-341e-59d0-9330-b505b5ad8888/6ea9ccc5-341e-59d0-9330-b505b5ad8888_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38871,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010795/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea9ccc5-341e-59d0-9330-b505b5ad8888/6ea9ccc5-341e-59d0-9330-b505b5ad8888_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37351,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010818/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea9ccc5-341e-59d0-9330-b505b5ad8888/6ea9ccc5-341e-59d0-9330-b505b5ad8888_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35981,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010845/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea9ccc5-341e-59d0-9330-b505b5ad8888/6ea9ccc5-341e-59d0-9330-b505b5ad8888_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36126,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010874/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea9ccc5-341e-59d0-9330-b505b5ad8888/6ea9ccc5-341e-59d0-9330-b505b5ad8888_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66031,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010905/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea9ccc5-341e-59d0-9330-b505b5ad8888/6ea9ccc5-341e-59d0-9330-b505b5ad8888_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60866,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010933/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea9ccc5-341e-59d0-9330-b505b5ad8888/6ea9ccc5-341e-59d0-9330-b505b5ad8888_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77447,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010954/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea9ccc5-341e-59d0-9330-b505b5ad8888/6ea9ccc5-341e-59d0-9330-b505b5ad8888_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87807,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX06XUD/699010978/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'TOYOTA COROLLA VERSO 2.2 D-4D T3 MPV',
'transmission': 'manual',
'trim': 'D-4D T3',
'vin': 'NMTEA16R00R022770',
'year': 2006}
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX06%2520XUD%27 HTTP/1.1" 200 None
2026-03-28 22:06:45 [bca.uk] INFO: Saving data for KX06%20XUD: {'created_time': 1774735605.777113, 'last_price_update_time': 1774735605.777125, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KX06%2520XUD') HTTP/1.1" 204 0
2026-03-28 22:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 172158fc-c6ba-569f-b467-7d56f3769264 with identifier: WV67%20NMF
2026-03-28 22:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 172158fc-c6ba-569f-b467-7d56f3769264 with identifier: WV67%20NMF
2026-03-28 22:06:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 172158fc-c6ba-569f-b467-7d56f3769264 with identifier: WV67%20NMF to the API
2026-03-28 22:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159246/600>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_172158fc-c6ba-569f-b467-7d56f3769264/172158fc-c6ba-569f-b467-7d56f3769264_expert_report_file_5b810461-60fc-42eb-a740-84d3934a7523.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WV67%20NMF-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '172158fc-c6ba-569f-b467-7d56f3769264',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WV67 NMF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WV67%20NMF&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 57275,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_172158fc-c6ba-569f-b467-7d56f3769264/172158fc-c6ba-569f-b467-7d56f3769264_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48523,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159246/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_172158fc-c6ba-569f-b467-7d56f3769264/172158fc-c6ba-569f-b467-7d56f3769264_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47968,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159252/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_172158fc-c6ba-569f-b467-7d56f3769264/172158fc-c6ba-569f-b467-7d56f3769264_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45519,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159263/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_172158fc-c6ba-569f-b467-7d56f3769264/172158fc-c6ba-569f-b467-7d56f3769264_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44183,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159267/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_172158fc-c6ba-569f-b467-7d56f3769264/172158fc-c6ba-569f-b467-7d56f3769264_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41082,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159275/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_172158fc-c6ba-569f-b467-7d56f3769264/172158fc-c6ba-569f-b467-7d56f3769264_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40923,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159283/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_172158fc-c6ba-569f-b467-7d56f3769264/172158fc-c6ba-569f-b467-7d56f3769264_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89256,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159296/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_172158fc-c6ba-569f-b467-7d56f3769264/172158fc-c6ba-569f-b467-7d56f3769264_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85946,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159308/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_172158fc-c6ba-569f-b467-7d56f3769264/172158fc-c6ba-569f-b467-7d56f3769264_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93432,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159325/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_172158fc-c6ba-569f-b467-7d56f3769264/172158fc-c6ba-569f-b467-7d56f3769264_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83470,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV67NMF/699159336/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 125 TITANIUM X Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 TITANIUM X',
'vin': 'WF05XXGCC5HG37612',
'year': 2017}
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV67%2520NMF%27 HTTP/1.1" 200 None
2026-03-28 22:06:46 [bca.uk] INFO: Saving data for WV67%20NMF: {'created_time': 1774735606.14486, 'last_price_update_time': 1774735606.14487, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WV67%2520NMF') HTTP/1.1" 204 0
2026-03-28 22:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015765/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV18MMU/42810984?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=awaP9bI91lSo%2Fl13T4OiJNtRsbOn8slS8eNX2y8Uzxg%3D)
2026-03-28 22:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010713/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK59LFU/42810532?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=HXSOt9sDMupOgYbsEXCjSHCKuR31TJPXV6ppJsslvik%3D)
2026-03-28 22:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015654/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015654>
2026-03-28 22:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269219/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699269219>
2026-03-28 22:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015638/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015638>
2026-03-28 22:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015630/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BV18MMU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015690/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX69OHK/42810977?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=0qs50uo1a%2B8v5oQ9QTDhOMr8kra3CfYpsPyh51WuzC4%3D)
2026-03-28 22:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015829/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV18MMU/42810984?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=awaP9bI91lSo%2Fl13T4OiJNtRsbOn8slS8eNX2y8Uzxg%3D)
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554279e90>
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a83e0fd1-5b31-5398-90ed-f3506792a1a5/a83e0fd1-5b31-5398-90ed-f3506792a1a5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK59LFU%252F699010772%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010772/600 saved to cache
2026-03-28 22:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a83e0fd1-5b31-5398-90ed-f3506792a1a5
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554278250>
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e320279-d073-5e8e-aee4-113575c202cf/3e320279-d073-5e8e-aee4-113575c202cf_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK19NOH%252F699176644%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176644/600 saved to cache
2026-03-28 22:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e320279-d073-5e8e-aee4-113575c202cf
2026-03-28 22:06:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e320279-d073-5e8e-aee4-113575c202cf, skipping ID generation
2026-03-28 22:06:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e320279-d073-5e8e-aee4-113575c202cf sending to next pipeline
2026-03-28 22:06:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3e320279-d073-5e8e-aee4-113575c202cf, identifier: YK19%20NOH
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471ae2d0>
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a83e0fd1-5b31-5398-90ed-f3506792a1a5/a83e0fd1-5b31-5398-90ed-f3506792a1a5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK59LFU%252F699010751%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010751/600 saved to cache
2026-03-28 22:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a83e0fd1-5b31-5398-90ed-f3506792a1a5
2026-03-28 22:06:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547150310>
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab00141-98d7-507d-a35a-585edf20fde4/bab00141-98d7-507d-a35a-585edf20fde4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV18MMU%252F699015873%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015873/600 saved to cache
2026-03-28 22:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bab00141-98d7-507d-a35a-585edf20fde4
2026-03-28 22:06:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554315290>
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab00141-98d7-507d-a35a-585edf20fde4/bab00141-98d7-507d-a35a-585edf20fde4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV18MMU%252F699015896%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015896/600 saved to cache
2026-03-28 22:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bab00141-98d7-507d-a35a-585edf20fde4
2026-03-28 22:06:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3e320279-d073-5e8e-aee4-113575c202cf with identifier: YK19%20NOH
2026-03-28 22:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3e320279-d073-5e8e-aee4-113575c202cf with identifier: YK19%20NOH
2026-03-28 22:06:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3e320279-d073-5e8e-aee4-113575c202cf with identifier: YK19%20NOH to the API
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176644/600>
{'auction_title': '',
'c_o_2_emission_value': 141,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e320279-d073-5e8e-aee4-113575c202cf/3e320279-d073-5e8e-aee4-113575c202cf_expert_report_file_3d54cb60-9cc2-47d0-9898-9ec1c354b604.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YK19%20NOH-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3e320279-d073-5e8e-aee4-113575c202cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YK19 NOH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YK19%20NOH&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'SUZUKI',
'model': 'SX4 S CROSS',
'odometer': 23157,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e320279-d073-5e8e-aee4-113575c202cf/3e320279-d073-5e8e-aee4-113575c202cf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41744,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176644/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e320279-d073-5e8e-aee4-113575c202cf/3e320279-d073-5e8e-aee4-113575c202cf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40490,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176650/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e320279-d073-5e8e-aee4-113575c202cf/3e320279-d073-5e8e-aee4-113575c202cf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38501,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176654/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e320279-d073-5e8e-aee4-113575c202cf/3e320279-d073-5e8e-aee4-113575c202cf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39065,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176659/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e320279-d073-5e8e-aee4-113575c202cf/3e320279-d073-5e8e-aee4-113575c202cf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37325,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176663/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e320279-d073-5e8e-aee4-113575c202cf/3e320279-d073-5e8e-aee4-113575c202cf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36922,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176666/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e320279-d073-5e8e-aee4-113575c202cf/3e320279-d073-5e8e-aee4-113575c202cf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76958,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176674/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e320279-d073-5e8e-aee4-113575c202cf/3e320279-d073-5e8e-aee4-113575c202cf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67153,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176685/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e320279-d073-5e8e-aee4-113575c202cf/3e320279-d073-5e8e-aee4-113575c202cf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80580,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176696/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e320279-d073-5e8e-aee4-113575c202cf/3e320279-d073-5e8e-aee4-113575c202cf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74719,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK19NOH/699176714/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'SUZUKI SX4 S CROSS 1.4 B-JET SZ5 ALLGRIP Hatchback',
'transmission': 'manual',
'trim': 'B-JET SZ5 ALLGRIP',
'vin': 'TSMJYBA2S00677976',
'year': 2019}
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK19%2520NOH%27 HTTP/1.1" 200 None
2026-03-28 22:06:46 [bca.uk] INFO: Saving data for YK19%20NOH: {'created_time': 1774735606.854817, 'last_price_update_time': 1774735606.854829, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YK19%2520NOH') HTTP/1.1" 204 0
2026-03-28 22:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015726/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV18MMU/42810984?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=awaP9bI91lSo%2Fl13T4OiJNtRsbOn8slS8eNX2y8Uzxg%3D)
2026-03-28 22:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333402/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699333402>
2026-03-28 22:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015677/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX69OHK/42810977?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=0qs50uo1a%2B8v5oQ9QTDhOMr8kra3CfYpsPyh51WuzC4%3D)
2026-03-28 22:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD18RFJ/698971848/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971848>
2026-03-28 22:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX15ZPR/699330969/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330969>
2026-03-28 22:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA06YTM/42810893?sv=2020-08-04&st=2026-03-28T22%3A06%3A46Z&se=2026-03-28T22%3A31%3A46Z&sr=b&sp=r&sig=nyYfmAfMU%2Bgfo%2Fr0LXXhL%2Bloa6zNH%2FTmTn3vJ%2FzTyJM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CA06%20YTM-GB>
2026-03-28 22:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE55ACX/42810638?sv=2020-08-04&st=2026-03-28T22%3A06%3A46Z&se=2026-03-28T22%3A31%3A46Z&sr=b&sp=r&sig=Riislef1FM3HPBxrD0vvNR2RRo%2FNoFl6E6%2FfFWY7nLw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FE55%20ACX-GB>
2026-03-28 22:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015670/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX69OHK/42810977?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=0qs50uo1a%2B8v5oQ9QTDhOMr8kra3CfYpsPyh51WuzC4%3D)
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556fae850>
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab00141-98d7-507d-a35a-585edf20fde4/bab00141-98d7-507d-a35a-585edf20fde4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV18MMU%252F699015765%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015765/600 saved to cache
2026-03-28 22:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bab00141-98d7-507d-a35a-585edf20fde4
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543eb9d0>
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a83e0fd1-5b31-5398-90ed-f3506792a1a5/a83e0fd1-5b31-5398-90ed-f3506792a1a5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK59LFU%252F699010713%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010713/600 saved to cache
2026-03-28 22:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a83e0fd1-5b31-5398-90ed-f3506792a1a5
2026-03-28 22:06:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a83e0fd1-5b31-5398-90ed-f3506792a1a5, skipping ID generation
2026-03-28 22:06:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a83e0fd1-5b31-5398-90ed-f3506792a1a5 sending to next pipeline
2026-03-28 22:06:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a83e0fd1-5b31-5398-90ed-f3506792a1a5, identifier: LK59%20LFU
2026-03-28 22:06:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554856190>
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd277234-4dc4-5636-a402-27f6b3385c96/cd277234-4dc4-5636-a402-27f6b3385c96_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX69OHK%252F699015690%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015690/600 saved to cache
2026-03-28 22:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cd277234-4dc4-5636-a402-27f6b3385c96
2026-03-28 22:06:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544c9c50>
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab00141-98d7-507d-a35a-585edf20fde4/bab00141-98d7-507d-a35a-585edf20fde4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV18MMU%252F699015829%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015829/600 saved to cache
2026-03-28 22:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bab00141-98d7-507d-a35a-585edf20fde4
2026-03-28 22:06:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a83e0fd1-5b31-5398-90ed-f3506792a1a5 with identifier: LK59%20LFU
2026-03-28 22:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a83e0fd1-5b31-5398-90ed-f3506792a1a5 with identifier: LK59%20LFU
2026-03-28 22:06:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a83e0fd1-5b31-5398-90ed-f3506792a1a5 with identifier: LK59%20LFU to the API
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010713/600>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a83e0fd1-5b31-5398-90ed-f3506792a1a5/a83e0fd1-5b31-5398-90ed-f3506792a1a5_expert_report_file_b6fefe72-39e9-448b-b270-52c019e40786.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LK59%20LFU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a83e0fd1-5b31-5398-90ed-f3506792a1a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LK59 LFU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LK59%20LFU&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'PEUGEOT',
'model': '207',
'odometer': 102050,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a83e0fd1-5b31-5398-90ed-f3506792a1a5/a83e0fd1-5b31-5398-90ed-f3506792a1a5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49579,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010713/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a83e0fd1-5b31-5398-90ed-f3506792a1a5/a83e0fd1-5b31-5398-90ed-f3506792a1a5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47179,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010729/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a83e0fd1-5b31-5398-90ed-f3506792a1a5/a83e0fd1-5b31-5398-90ed-f3506792a1a5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46158,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010751/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a83e0fd1-5b31-5398-90ed-f3506792a1a5/a83e0fd1-5b31-5398-90ed-f3506792a1a5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44421,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010772/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a83e0fd1-5b31-5398-90ed-f3506792a1a5/a83e0fd1-5b31-5398-90ed-f3506792a1a5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43528,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010802/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a83e0fd1-5b31-5398-90ed-f3506792a1a5/a83e0fd1-5b31-5398-90ed-f3506792a1a5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42977,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010832/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a83e0fd1-5b31-5398-90ed-f3506792a1a5/a83e0fd1-5b31-5398-90ed-f3506792a1a5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84694,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010872/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a83e0fd1-5b31-5398-90ed-f3506792a1a5/a83e0fd1-5b31-5398-90ed-f3506792a1a5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68671,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010908/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a83e0fd1-5b31-5398-90ed-f3506792a1a5/a83e0fd1-5b31-5398-90ed-f3506792a1a5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90465,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010931/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a83e0fd1-5b31-5398-90ed-f3506792a1a5/a83e0fd1-5b31-5398-90ed-f3506792a1a5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94086,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK59LFU/699010959/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'PEUGEOT 207 1.4 VERVE Hatchback',
'transmission': 'manual',
'trim': 'VERVE',
'vin': 'VF3WAKFT09W089008',
'year': 2009}
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK59%2520LFU%27 HTTP/1.1" 200 None
2026-03-28 22:06:47 [bca.uk] INFO: Saving data for LK59%20LFU: {'created_time': 1774735607.540094, 'last_price_update_time': 1774735607.540105, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LK59%2520LFU') HTTP/1.1" 204 0
2026-03-28 22:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015630/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV18MMU/42810984?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=awaP9bI91lSo%2Fl13T4OiJNtRsbOn8slS8eNX2y8Uzxg%3D)
2026-03-28 22:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015638/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BV18MMU/42810984?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=awaP9bI91lSo%2Fl13T4OiJNtRsbOn8slS8eNX2y8Uzxg%3D)
2026-03-28 22:06:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024879/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024879>
2026-03-28 22:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015654/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX69OHK/42810977?sv=2020-08-04&st=2026-03-28T22%3A06%3A29Z&se=2026-03-28T22%3A31%3A29Z&sr=b&sp=r&sig=0qs50uo1a%2B8v5oQ9QTDhOMr8kra3CfYpsPyh51WuzC4%3D)
2026-03-28 22:06:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269192/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699269192>
2026-03-28 22:06:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK67LGN/42807095?sv=2020-08-04&st=2026-03-28T22%3A06%3A47Z&se=2026-03-28T22%3A31%3A47Z&sr=b&sp=r&sig=B%2FYHzNbkypsk9Vk4GDgw38I9t41n7LDGOKEeGLzozuo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK67%20LGN-GB>
2026-03-28 22:06:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333398/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699333398>
2026-03-28 22:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269219/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND05TWY/42810553?sv=2020-08-04&st=2026-03-28T22%3A05%3A04Z&se=2026-03-28T22%3A30%3A04Z&sr=b&sp=r&sig=BZ8%2B%2FUFxkJjjZzPfJFab4MBTncPmbBPd%2BnKXlbO2wps%3D)
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b40c90>
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab00141-98d7-507d-a35a-585edf20fde4/bab00141-98d7-507d-a35a-585edf20fde4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV18MMU%252F699015726%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015726/600 saved to cache
2026-03-28 22:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bab00141-98d7-507d-a35a-585edf20fde4
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555030850>
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd277234-4dc4-5636-a402-27f6b3385c96/cd277234-4dc4-5636-a402-27f6b3385c96_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX69OHK%252F699015677%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015677/600 saved to cache
2026-03-28 22:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cd277234-4dc4-5636-a402-27f6b3385c96
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554405590>
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd277234-4dc4-5636-a402-27f6b3385c96/cd277234-4dc4-5636-a402-27f6b3385c96_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX69OHK%252F699015670%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015670/600 saved to cache
2026-03-28 22:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cd277234-4dc4-5636-a402-27f6b3385c96
2026-03-28 22:06:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX15ZPR/699330962/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330962>
2026-03-28 22:06:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YJ63VCM/42809703?sv=2020-08-04&st=2026-03-28T22%3A06%3A47Z&se=2026-03-28T22%3A31%3A47Z&sr=b&sp=r&sig=N9qg9kdn8V%2FlXiT4%2BFnkQLDkgTs3TIHdpTtYI6Y8MNc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YJ63%20VCM-GB>
2026-03-28 22:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX15ZPR/699330969/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX15ZPR/42810594?sv=2020-08-04&st=2026-03-28T22%3A05%3A03Z&se=2026-03-28T22%3A30%3A03Z&sr=b&sp=r&sig=4Xkg21iEljq20iTBfMl%2BtSswF985h8gnTDKxLA91BF8%3D)
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5550320d0>
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab00141-98d7-507d-a35a-585edf20fde4/bab00141-98d7-507d-a35a-585edf20fde4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV18MMU%252F699015630%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015630/600 saved to cache
2026-03-28 22:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bab00141-98d7-507d-a35a-585edf20fde4
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b5ac50>
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab00141-98d7-507d-a35a-585edf20fde4/bab00141-98d7-507d-a35a-585edf20fde4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBV18MMU%252F699015638%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015638/600 saved to cache
2026-03-28 22:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bab00141-98d7-507d-a35a-585edf20fde4
2026-03-28 22:06:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bab00141-98d7-507d-a35a-585edf20fde4, skipping ID generation
2026-03-28 22:06:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bab00141-98d7-507d-a35a-585edf20fde4 sending to next pipeline
2026-03-28 22:06:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bab00141-98d7-507d-a35a-585edf20fde4, identifier: BV18%20MMU
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474e2b10>
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd277234-4dc4-5636-a402-27f6b3385c96/cd277234-4dc4-5636-a402-27f6b3385c96_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX69OHK%252F699015654%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015654/600 saved to cache
2026-03-28 22:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cd277234-4dc4-5636-a402-27f6b3385c96
2026-03-28 22:06:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cd277234-4dc4-5636-a402-27f6b3385c96, skipping ID generation
2026-03-28 22:06:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cd277234-4dc4-5636-a402-27f6b3385c96 sending to next pipeline
2026-03-28 22:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cd277234-4dc4-5636-a402-27f6b3385c96, identifier: GX69%20OHK
2026-03-28 22:06:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fd4a90>
2026-03-28 22:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7d66be-49b7-5d86-a859-5c899ed35afc/8f7d66be-49b7-5d86-a859-5c899ed35afc_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND05TWY%252F699269219%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269219/600 saved to cache
2026-03-28 22:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8f7d66be-49b7-5d86-a859-5c899ed35afc
2026-03-28 22:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bab00141-98d7-507d-a35a-585edf20fde4 with identifier: BV18%20MMU
2026-03-28 22:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bab00141-98d7-507d-a35a-585edf20fde4 with identifier: BV18%20MMU
2026-03-28 22:06:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bab00141-98d7-507d-a35a-585edf20fde4 with identifier: BV18%20MMU to the API
2026-03-28 22:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015638/600>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab00141-98d7-507d-a35a-585edf20fde4/bab00141-98d7-507d-a35a-585edf20fde4_expert_report_file_ad06c7b2-4a1f-443d-a750-c6bbc27f50c9.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BV18%20MMU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bab00141-98d7-507d-a35a-585edf20fde4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BV18 MMU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BV18%20MMU&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'SEAT',
'model': 'LEON',
'odometer': 71532,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab00141-98d7-507d-a35a-585edf20fde4/bab00141-98d7-507d-a35a-585edf20fde4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38304,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015630/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab00141-98d7-507d-a35a-585edf20fde4/bab00141-98d7-507d-a35a-585edf20fde4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38709,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015635/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab00141-98d7-507d-a35a-585edf20fde4/bab00141-98d7-507d-a35a-585edf20fde4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37421,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015638/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab00141-98d7-507d-a35a-585edf20fde4/bab00141-98d7-507d-a35a-585edf20fde4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36574,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015726/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab00141-98d7-507d-a35a-585edf20fde4/bab00141-98d7-507d-a35a-585edf20fde4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33279,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015753/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab00141-98d7-507d-a35a-585edf20fde4/bab00141-98d7-507d-a35a-585edf20fde4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33184,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015765/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab00141-98d7-507d-a35a-585edf20fde4/bab00141-98d7-507d-a35a-585edf20fde4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71590,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015799/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab00141-98d7-507d-a35a-585edf20fde4/bab00141-98d7-507d-a35a-585edf20fde4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57527,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015829/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab00141-98d7-507d-a35a-585edf20fde4/bab00141-98d7-507d-a35a-585edf20fde4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79291,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015873/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab00141-98d7-507d-a35a-585edf20fde4/bab00141-98d7-507d-a35a-585edf20fde4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76484,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BV18MMU/699015896/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'SEAT LEON 1.8 TSI 180 FR TECHNOLOGY DSG Hatchback',
'transmission': 'automatic',
'trim': 'TSI 180 FR TECHNOLOGY DSG',
'vin': 'VSSZZZ5FZJR175567',
'year': 2018}
2026-03-28 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV18%2520MMU%27 HTTP/1.1" 200 None
2026-03-28 22:06:48 [bca.uk] INFO: Saving data for BV18%20MMU: {'created_time': 1774735608.481855, 'last_price_update_time': 1774735608.481866, 'auction_closing_time': 1774864800.0}
2026-03-28 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BV18%2520MMU') HTTP/1.1" 204 0
2026-03-28 22:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cd277234-4dc4-5636-a402-27f6b3385c96 with identifier: GX69%20OHK
2026-03-28 22:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cd277234-4dc4-5636-a402-27f6b3385c96 with identifier: GX69%20OHK
2026-03-28 22:06:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cd277234-4dc4-5636-a402-27f6b3385c96 with identifier: GX69%20OHK to the API
2026-03-28 22:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015654/600>
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd277234-4dc4-5636-a402-27f6b3385c96/cd277234-4dc4-5636-a402-27f6b3385c96_expert_report_file_6e68b8ac-c89c-4cb7-a2ed-3e1d89571beb.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GX69%20OHK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.3L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'cd277234-4dc4-5636-a402-27f6b3385c96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GX69 OHK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GX69%20OHK&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'MERCEDES-BENZ',
'model': 'A200',
'odometer': 37404,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd277234-4dc4-5636-a402-27f6b3385c96/cd277234-4dc4-5636-a402-27f6b3385c96_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39672,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015647/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd277234-4dc4-5636-a402-27f6b3385c96/cd277234-4dc4-5636-a402-27f6b3385c96_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39588,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015654/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd277234-4dc4-5636-a402-27f6b3385c96/cd277234-4dc4-5636-a402-27f6b3385c96_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38091,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015659/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd277234-4dc4-5636-a402-27f6b3385c96/cd277234-4dc4-5636-a402-27f6b3385c96_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36210,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015667/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd277234-4dc4-5636-a402-27f6b3385c96/cd277234-4dc4-5636-a402-27f6b3385c96_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31529,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015670/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd277234-4dc4-5636-a402-27f6b3385c96/cd277234-4dc4-5636-a402-27f6b3385c96_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31559,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015677/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd277234-4dc4-5636-a402-27f6b3385c96/cd277234-4dc4-5636-a402-27f6b3385c96_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61014,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015690/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd277234-4dc4-5636-a402-27f6b3385c96/cd277234-4dc4-5636-a402-27f6b3385c96_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55792,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015707/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd277234-4dc4-5636-a402-27f6b3385c96/cd277234-4dc4-5636-a402-27f6b3385c96_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72805,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015740/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd277234-4dc4-5636-a402-27f6b3385c96/cd277234-4dc4-5636-a402-27f6b3385c96_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67373,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX69OHK/699015774/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A200 1.3 AMG LINE DCT Saloon',
'transmission': 'automatic',
'trim': 'AMG LINE DCT',
'vin': 'WDD1771872J134679',
'year': 2019}
2026-03-28 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX69%2520OHK%27 HTTP/1.1" 200 None
2026-03-28 22:06:48 [bca.uk] INFO: Saving data for GX69%20OHK: {'created_time': 1774735608.871115, 'last_price_update_time': 1774735608.871127, 'auction_closing_time': 1774864800.0}
2026-03-28 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GX69%2520OHK') HTTP/1.1" 204 0
2026-03-28 22:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333402/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG66TXM/42810151?sv=2020-08-04&st=2026-03-28T22%3A05%3A05Z&se=2026-03-28T22%3A30%3A05Z&sr=b&sp=r&sig=C1vsp95R4gOA7T0iHNFs%2BZs12NdBkOHyJYbnRQXqRtM%3D)
2026-03-28 22:06:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD18RFJ/698971835/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971835>
2026-03-28 22:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333398/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG66TXM/42810151?sv=2020-08-04&st=2026-03-28T22%3A05%3A05Z&se=2026-03-28T22%3A30%3A05Z&sr=b&sp=r&sig=C1vsp95R4gOA7T0iHNFs%2BZs12NdBkOHyJYbnRQXqRtM%3D)
2026-03-28 22:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD18RFJ/698971848/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD18RFJ/42810641?sv=2020-08-04&st=2026-03-28T22%3A05%3A04Z&se=2026-03-28T22%3A30%3A04Z&sr=b&sp=r&sig=OeX5io3h9yL0VeL9tAHDCwF2HomNIHfIARYDa4NdS30%3D)
2026-03-28 22:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269192/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND05TWY/42810553?sv=2020-08-04&st=2026-03-28T22%3A05%3A04Z&se=2026-03-28T22%3A30%3A04Z&sr=b&sp=r&sig=BZ8%2B%2FUFxkJjjZzPfJFab4MBTncPmbBPd%2BnKXlbO2wps%3D)
2026-03-28 22:06:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5476d9a10>
2026-03-28 22:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_867b722d-9875-5e9c-b6b5-4614e36a0cad/867b722d-9875-5e9c-b6b5-4614e36a0cad_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPX15ZPR%252F699330969%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX15ZPR/699330969/600 saved to cache
2026-03-28 22:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 867b722d-9875-5e9c-b6b5-4614e36a0cad
2026-03-28 22:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK67LGN/42807095?sv=2020-08-04&st=2026-03-28T22%3A06%3A47Z&se=2026-03-28T22%3A31%3A47Z&sr=b&sp=r&sig=B%2FYHzNbkypsk9Vk4GDgw38I9t41n7LDGOKEeGLzozuo%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA06YTM/42810893?sv=2020-08-04&st=2026-03-28T22%3A06%3A46Z&se=2026-03-28T22%3A31%3A46Z&sr=b&sp=r&sig=nyYfmAfMU%2Bgfo%2Fr0LXXhL%2Bloa6zNH%2FTmTn3vJ%2FzTyJM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE55ACX/42810638?sv=2020-08-04&st=2026-03-28T22%3A06%3A46Z&se=2026-03-28T22%3A31%3A46Z&sr=b&sp=r&sig=Riislef1FM3HPBxrD0vvNR2RRo%2FNoFl6E6%2FfFWY7nLw%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024879/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YX16OWF/42810933?sv=2020-08-04&st=2026-03-28T22%3A05%3A09Z&se=2026-03-28T22%3A30%3A09Z&sr=b&sp=r&sig=3EOZGDetp00%2FdUCWDR68oq2Rwg5gxQSyaFaneq5tB70%3D)
2026-03-28 22:06:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD17FAM/699285808/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285808>
2026-03-28 22:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548276d0>
2026-03-28 22:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48ea9338-f3dd-5ad7-81bd-c3333cd89421/48ea9338-f3dd-5ad7-81bd-c3333cd89421_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG66TXM%252F699333402%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333402/600 saved to cache
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 48ea9338-f3dd-5ad7-81bd-c3333cd89421
2026-03-28 22:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024876/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024876>
2026-03-28 22:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333396/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699333396>
2026-03-28 22:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LF18AUM/42801914?sv=2020-08-04&st=2026-03-28T22%3A06%3A48Z&se=2026-03-28T22%3A31%3A48Z&sr=b&sp=r&sig=oYTLlDUnLi4Hc5mT4cv1Q26PIJWnHH5lV65UPCotNYQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LF18%20AUM-GB>
2026-03-28 22:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD14AUA/42809648?sv=2020-08-04&st=2026-03-28T22%3A06%3A48Z&se=2026-03-28T22%3A31%3A48Z&sr=b&sp=r&sig=Wm4zSZCCXBpqZHbZ%2B715uXy%2BsIoOmWFmsxwRHQ4IDag%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD14%20AUA-GB>
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543fefd0>
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48ea9338-f3dd-5ad7-81bd-c3333cd89421/48ea9338-f3dd-5ad7-81bd-c3333cd89421_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG66TXM%252F699333398%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333398/600 saved to cache
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 48ea9338-f3dd-5ad7-81bd-c3333cd89421
2026-03-28 22:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX15ZPR/699330962/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX15ZPR/42810594?sv=2020-08-04&st=2026-03-28T22%3A05%3A03Z&se=2026-03-28T22%3A30%3A03Z&sr=b&sp=r&sig=4Xkg21iEljq20iTBfMl%2BtSswF985h8gnTDKxLA91BF8%3D)
2026-03-28 22:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX15ZPR/699330958/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330958>
2026-03-28 22:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD18RFJ/698971835/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD18RFJ/42810641?sv=2020-08-04&st=2026-03-28T22%3A05%3A04Z&se=2026-03-28T22%3A30%3A04Z&sr=b&sp=r&sig=OeX5io3h9yL0VeL9tAHDCwF2HomNIHfIARYDa4NdS30%3D)
2026-03-28 22:06:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555c6dd50>
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ba24d3-8587-5eee-9f39-5a8e165a6cdc/f0ba24d3-8587-5eee-9f39-5a8e165a6cdc_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD18RFJ%252F698971848%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD18RFJ/698971848/600 saved to cache
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f0ba24d3-8587-5eee-9f39-5a8e165a6cdc
2026-03-28 22:06:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a47890>
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7d66be-49b7-5d86-a859-5c899ed35afc/8f7d66be-49b7-5d86-a859-5c899ed35afc_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND05TWY%252F699269192%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269192/600 saved to cache
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f7d66be-49b7-5d86-a859-5c899ed35afc
2026-03-28 22:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD17FAM/699285792/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285792>
2026-03-28 22:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB15DHF/698970677/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970677>
2026-03-28 22:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ67HWW/698994737/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994737>
2026-03-28 22:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD18RFJ/698971810/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971810>
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472a2850>
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4177a308-7aae-587d-bd3e-07268dbbb6a0/4177a308-7aae-587d-bd3e-07268dbbb6a0_expert_report_file_b31a998f-0064-4f0a-af92-5a8f3b5b2d76.pdf HTTP/1.1" 201 0
2026-03-28 22:06:49 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4177a308-7aae-587d-bd3e-07268dbbb6a0
2026-03-28 22:06:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4177a308-7aae-587d-bd3e-07268dbbb6a0, skipping ID generation
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4177a308-7aae-587d-bd3e-07268dbbb6a0
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHK67LGN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HK67LGN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554ae2710>
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b735ecb-b987-5f51-9978-b14a854ed6a5/6b735ecb-b987-5f51-9978-b14a854ed6a5_expert_report_file_1d285c6d-4ec1-4a7d-ab79-16b540e5520f.pdf HTTP/1.1" 201 0
2026-03-28 22:06:49 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6b735ecb-b987-5f51-9978-b14a854ed6a5
2026-03-28 22:06:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b735ecb-b987-5f51-9978-b14a854ed6a5, skipping ID generation
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b735ecb-b987-5f51-9978-b14a854ed6a5
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCA06YTM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CA06YTM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5541fd750>
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa39713-14e5-5c88-b2a8-4efb5721d2c2/bfa39713-14e5-5c88-b2a8-4efb5721d2c2_expert_report_file_127c964c-bc5c-464f-b1e1-beab513a5082.pdf HTTP/1.1" 201 0
2026-03-28 22:06:49 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item bfa39713-14e5-5c88-b2a8-4efb5721d2c2
2026-03-28 22:06:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bfa39713-14e5-5c88-b2a8-4efb5721d2c2, skipping ID generation
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bfa39713-14e5-5c88-b2a8-4efb5721d2c2
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFE55ACX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FE55ACX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555033650>
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12dd3ce3-5de5-5fe4-88d0-7054e427658d/12dd3ce3-5de5-5fe4-88d0-7054e427658d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYX16OWF%252F699024879%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024879/600 saved to cache
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 12dd3ce3-5de5-5fe4-88d0-7054e427658d
2026-03-28 22:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YJ63VCM/42809703?sv=2020-08-04&st=2026-03-28T22%3A06%3A47Z&se=2026-03-28T22%3A31%3A47Z&sr=b&sp=r&sig=N9qg9kdn8V%2FlXiT4%2BFnkQLDkgTs3TIHdpTtYI6Y8MNc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269162/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699269162>
2026-03-28 22:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS67XUM/42807715?sv=2020-08-04&st=2026-03-28T22%3A06%3A49Z&se=2026-03-28T22%3A31%3A49Z&sr=b&sp=r&sig=9ijgKTkHMSlkKAjeeQgoMMe29lAKtjTp2mF1ojKOw68%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KS67%20XUM-GB>
2026-03-28 22:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD18RFJ/698971789/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971789>
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188868%27 HTTP/1.1" 200 None
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188868 not downloaded yet
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023460%27 HTTP/1.1" 200 None
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023460 not downloaded yet
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994386%27 HTTP/1.1" 200 None
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994386 not downloaded yet
2026-03-28 22:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333396/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG66TXM/42810151?sv=2020-08-04&st=2026-03-28T22%3A05%3A05Z&se=2026-03-28T22%3A30%3A05Z&sr=b&sp=r&sig=C1vsp95R4gOA7T0iHNFs%2BZs12NdBkOHyJYbnRQXqRtM%3D)
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188878%27 HTTP/1.1" 200 None
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188878 not downloaded yet
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023471%27 HTTP/1.1" 200 None
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023471 not downloaded yet
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994402%27 HTTP/1.1" 200 None
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994402 not downloaded yet
2026-03-28 22:06:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544ca910>
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_867b722d-9875-5e9c-b6b5-4614e36a0cad/867b722d-9875-5e9c-b6b5-4614e36a0cad_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPX15ZPR%252F699330962%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX15ZPR/699330962/600 saved to cache
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 867b722d-9875-5e9c-b6b5-4614e36a0cad
2026-03-28 22:06:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554279290>
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ba24d3-8587-5eee-9f39-5a8e165a6cdc/f0ba24d3-8587-5eee-9f39-5a8e165a6cdc_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD18RFJ%252F698971835%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD18RFJ/698971835/600 saved to cache
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f0ba24d3-8587-5eee-9f39-5a8e165a6cdc
2026-03-28 22:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD17FAM/699285808/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD17FAM/42810230?sv=2020-08-04&st=2026-03-28T22%3A05%3A03Z&se=2026-03-28T22%3A30%3A03Z&sr=b&sp=r&sig=%2FfBqToERqV4%2B1yskCr4WrQIIYBY5obdbLLah9TxlYo4%3D)
2026-03-28 22:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX15ZPR/699330958/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX15ZPR/42810594?sv=2020-08-04&st=2026-03-28T22%3A05%3A03Z&se=2026-03-28T22%3A30%3A03Z&sr=b&sp=r&sig=4Xkg21iEljq20iTBfMl%2BtSswF985h8gnTDKxLA91BF8%3D)
2026-03-28 22:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024876/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YX16OWF/42810933?sv=2020-08-04&st=2026-03-28T22%3A05%3A09Z&se=2026-03-28T22%3A30%3A09Z&sr=b&sp=r&sig=3EOZGDetp00%2FdUCWDR68oq2Rwg5gxQSyaFaneq5tB70%3D)
2026-03-28 22:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ67HWW/698994619/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994619>
2026-03-28 22:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD17FAM/699285771/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285771>
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188886%27 HTTP/1.1" 200 None
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188886 not downloaded yet
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023481%27 HTTP/1.1" 200 None
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023481 not downloaded yet
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994417%27 HTTP/1.1" 200 None
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994417 not downloaded yet
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471c2f90>
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c202ec85-ff2c-5425-bb13-378c8faf73ed/c202ec85-ff2c-5425-bb13-378c8faf73ed_expert_report_file_5966b3de-4dad-4423-9806-ba274329c3cd.pdf HTTP/1.1" 201 0
2026-03-28 22:06:49 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c202ec85-ff2c-5425-bb13-378c8faf73ed
2026-03-28 22:06:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c202ec85-ff2c-5425-bb13-378c8faf73ed, skipping ID generation
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c202ec85-ff2c-5425-bb13-378c8faf73ed
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYJ63VCM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YJ63VCM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD14AUA/42809648?sv=2020-08-04&st=2026-03-28T22%3A06%3A48Z&se=2026-03-28T22%3A31%3A48Z&sr=b&sp=r&sig=Wm4zSZCCXBpqZHbZ%2B715uXy%2BsIoOmWFmsxwRHQ4IDag%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LF18AUM/42801914?sv=2020-08-04&st=2026-03-28T22%3A06%3A48Z&se=2026-03-28T22%3A31%3A48Z&sr=b&sp=r&sig=oYTLlDUnLi4Hc5mT4cv1Q26PIJWnHH5lV65UPCotNYQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188897%27 HTTP/1.1" 200 None
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188897 not downloaded yet
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023492%27 HTTP/1.1" 200 None
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023492 not downloaded yet
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994425%27 HTTP/1.1" 200 None
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994425 not downloaded yet
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253773%27 HTTP/1.1" 200 None
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253773 not downloaded yet
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547254510>
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48ea9338-f3dd-5ad7-81bd-c3333cd89421/48ea9338-f3dd-5ad7-81bd-c3333cd89421_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG66TXM%252F699333396%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333396/600 saved to cache
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 48ea9338-f3dd-5ad7-81bd-c3333cd89421
2026-03-28 22:06:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 48ea9338-f3dd-5ad7-81bd-c3333cd89421, skipping ID generation
2026-03-28 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 48ea9338-f3dd-5ad7-81bd-c3333cd89421 sending to next pipeline
2026-03-28 22:06:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 48ea9338-f3dd-5ad7-81bd-c3333cd89421, identifier: BG66%20TXM
2026-03-28 22:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD18RFJ/698971810/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD18RFJ/42810641?sv=2020-08-04&st=2026-03-28T22%3A05%3A04Z&se=2026-03-28T22%3A30%3A04Z&sr=b&sp=r&sig=OeX5io3h9yL0VeL9tAHDCwF2HomNIHfIARYDa4NdS30%3D)
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188904%27 HTTP/1.1" 200 None
2026-03-28 22:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188904 not downloaded yet
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023496%27 HTTP/1.1" 200 None
2026-03-28 22:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023496 not downloaded yet
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994438%27 HTTP/1.1" 200 None
2026-03-28 22:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994438 not downloaded yet
2026-03-28 22:06:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 48ea9338-f3dd-5ad7-81bd-c3333cd89421 with identifier: BG66%20TXM
2026-03-28 22:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 48ea9338-f3dd-5ad7-81bd-c3333cd89421 with identifier: BG66%20TXM
2026-03-28 22:06:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 48ea9338-f3dd-5ad7-81bd-c3333cd89421 with identifier: BG66%20TXM to the API
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333396/600>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48ea9338-f3dd-5ad7-81bd-c3333cd89421/48ea9338-f3dd-5ad7-81bd-c3333cd89421_expert_report_file_53d2c5cc-e179-4306-88bb-e8ae308b587b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BG66%20TXM-GB',
'category': 'Car',
'color': 'yellow',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '48ea9338-f3dd-5ad7-81bd-c3333cd89421',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BG66 TXM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BG66%20TXM&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 26076,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48ea9338-f3dd-5ad7-81bd-c3333cd89421/48ea9338-f3dd-5ad7-81bd-c3333cd89421_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38907,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333386/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48ea9338-f3dd-5ad7-81bd-c3333cd89421/48ea9338-f3dd-5ad7-81bd-c3333cd89421_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37740,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333391/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48ea9338-f3dd-5ad7-81bd-c3333cd89421/48ea9338-f3dd-5ad7-81bd-c3333cd89421_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40375,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333393/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48ea9338-f3dd-5ad7-81bd-c3333cd89421/48ea9338-f3dd-5ad7-81bd-c3333cd89421_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38044,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333396/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48ea9338-f3dd-5ad7-81bd-c3333cd89421/48ea9338-f3dd-5ad7-81bd-c3333cd89421_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36402,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333398/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48ea9338-f3dd-5ad7-81bd-c3333cd89421/48ea9338-f3dd-5ad7-81bd-c3333cd89421_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35499,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333402/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48ea9338-f3dd-5ad7-81bd-c3333cd89421/48ea9338-f3dd-5ad7-81bd-c3333cd89421_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65579,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333407/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48ea9338-f3dd-5ad7-81bd-c3333cd89421/48ea9338-f3dd-5ad7-81bd-c3333cd89421_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66932,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333412/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48ea9338-f3dd-5ad7-81bd-c3333cd89421/48ea9338-f3dd-5ad7-81bd-c3333cd89421_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97751,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333420/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48ea9338-f3dd-5ad7-81bd-c3333cd89421/48ea9338-f3dd-5ad7-81bd-c3333cd89421_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84193,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG66TXM/699333428/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.5 DCI TEKNA Hatchback',
'transmission': 'manual',
'trim': 'DCI TEKNA',
'vin': 'SJNFCAF15U7299965',
'year': 2016}
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG66%2520TXM%27 HTTP/1.1" 200 None
2026-03-28 22:06:50 [bca.uk] INFO: Saving data for BG66%20TXM: {'created_time': 1774735610.44966, 'last_price_update_time': 1774735610.449672, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BG66%2520TXM') HTTP/1.1" 204 0
2026-03-28 22:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269162/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND05TWY/42810553?sv=2020-08-04&st=2026-03-28T22%3A05%3A04Z&se=2026-03-28T22%3A30%3A04Z&sr=b&sp=r&sig=BZ8%2B%2FUFxkJjjZzPfJFab4MBTncPmbBPd%2BnKXlbO2wps%3D)
2026-03-28 22:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994360/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FE55ACX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ67HWW/698994737/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ67HWW/42810839?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=bCH4BiUF13obmrAOV4AiGB4NLH07S%2Bo99SNbSt0wxEM%3D)
2026-03-28 22:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD17FAM/699285792/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD17FAM/42810230?sv=2020-08-04&st=2026-03-28T22%3A05%3A03Z&se=2026-03-28T22%3A30%3A03Z&sr=b&sp=r&sig=%2FfBqToERqV4%2B1yskCr4WrQIIYBY5obdbLLah9TxlYo4%3D)
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253779%27 HTTP/1.1" 200 None
2026-03-28 22:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253779 not downloaded yet
2026-03-28 22:06:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554274290>
2026-03-28 22:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4494bc-d302-5d25-af44-49f73fc6f3e8/3b4494bc-d302-5d25-af44-49f73fc6f3e8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD17FAM%252F699285808%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD17FAM/699285808/600 saved to cache
2026-03-28 22:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b4494bc-d302-5d25-af44-49f73fc6f3e8
2026-03-28 22:06:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54744c590>
2026-03-28 22:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_867b722d-9875-5e9c-b6b5-4614e36a0cad/867b722d-9875-5e9c-b6b5-4614e36a0cad_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPX15ZPR%252F699330958%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX15ZPR/699330958/600 saved to cache
2026-03-28 22:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 867b722d-9875-5e9c-b6b5-4614e36a0cad
2026-03-28 22:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556fadb90>
2026-03-28 22:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12dd3ce3-5de5-5fe4-88d0-7054e427658d/12dd3ce3-5de5-5fe4-88d0-7054e427658d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYX16OWF%252F699024876%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024876/600 saved to cache
2026-03-28 22:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 12dd3ce3-5de5-5fe4-88d0-7054e427658d
2026-03-28 22:06:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12dd3ce3-5de5-5fe4-88d0-7054e427658d, skipping ID generation
2026-03-28 22:06:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 12dd3ce3-5de5-5fe4-88d0-7054e427658d sending to next pipeline
2026-03-28 22:06:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 12dd3ce3-5de5-5fe4-88d0-7054e427658d, identifier: YX16%20OWF
2026-03-28 22:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD18RFJ/698971789/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD18RFJ/42810641?sv=2020-08-04&st=2026-03-28T22%3A05%3A04Z&se=2026-03-28T22%3A30%3A04Z&sr=b&sp=r&sig=OeX5io3h9yL0VeL9tAHDCwF2HomNIHfIARYDa4NdS30%3D)
2026-03-28 22:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB15DHF/698970677/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB15DHF/42810688?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=z80RjqPqkscTGhJimgx1YcejekegApPhOp4js7HWGmI%3D)
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188917%27 HTTP/1.1" 200 None
2026-03-28 22:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188917 not downloaded yet
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023517%27 HTTP/1.1" 200 None
2026-03-28 22:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023517 not downloaded yet
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994466%27 HTTP/1.1" 200 None
2026-03-28 22:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994466 not downloaded yet
2026-03-28 22:06:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 12dd3ce3-5de5-5fe4-88d0-7054e427658d with identifier: YX16%20OWF
2026-03-28 22:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 12dd3ce3-5de5-5fe4-88d0-7054e427658d with identifier: YX16%20OWF
2026-03-28 22:06:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 12dd3ce3-5de5-5fe4-88d0-7054e427658d with identifier: YX16%20OWF to the API
2026-03-28 22:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024876/600>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12dd3ce3-5de5-5fe4-88d0-7054e427658d/12dd3ce3-5de5-5fe4-88d0-7054e427658d_expert_report_file_11563098-af30-4ba6-ad32-451d802b82c9.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YX16%20OWF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '12dd3ce3-5de5-5fe4-88d0-7054e427658d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YX16 OWF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YX16%20OWF&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'VAUXHALL',
'model': 'ADAM',
'odometer': 24684,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12dd3ce3-5de5-5fe4-88d0-7054e427658d/12dd3ce3-5de5-5fe4-88d0-7054e427658d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36531,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024871/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12dd3ce3-5de5-5fe4-88d0-7054e427658d/12dd3ce3-5de5-5fe4-88d0-7054e427658d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33518,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024876/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12dd3ce3-5de5-5fe4-88d0-7054e427658d/12dd3ce3-5de5-5fe4-88d0-7054e427658d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37301,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024879/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12dd3ce3-5de5-5fe4-88d0-7054e427658d/12dd3ce3-5de5-5fe4-88d0-7054e427658d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35755,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024882/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12dd3ce3-5de5-5fe4-88d0-7054e427658d/12dd3ce3-5de5-5fe4-88d0-7054e427658d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33501,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024887/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12dd3ce3-5de5-5fe4-88d0-7054e427658d/12dd3ce3-5de5-5fe4-88d0-7054e427658d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32936,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024888/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12dd3ce3-5de5-5fe4-88d0-7054e427658d/12dd3ce3-5de5-5fe4-88d0-7054e427658d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78737,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024891/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12dd3ce3-5de5-5fe4-88d0-7054e427658d/12dd3ce3-5de5-5fe4-88d0-7054e427658d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65447,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024894/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12dd3ce3-5de5-5fe4-88d0-7054e427658d/12dd3ce3-5de5-5fe4-88d0-7054e427658d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82485,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024897/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12dd3ce3-5de5-5fe4-88d0-7054e427658d/12dd3ce3-5de5-5fe4-88d0-7054e427658d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99626,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX16OWF/699024901/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VAUXHALL ADAM 1.2 VVT 70 GLAM Hatchback',
'transmission': 'manual',
'trim': 'VVT 70 GLAM',
'vin': 'W0L0MAP08F6096764',
'year': 2016}
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX16%2520OWF%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [bca.uk] INFO: Saving data for YX16%20OWF: {'created_time': 1774735611.157602, 'last_price_update_time': 1774735611.157618, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YX16%2520OWF') HTTP/1.1" 204 0
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253788%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253788 not downloaded yet
2026-03-28 22:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS67XUM/42807715?sv=2020-08-04&st=2026-03-28T22%3A06%3A49Z&se=2026-03-28T22%3A31%3A49Z&sr=b&sp=r&sig=9ijgKTkHMSlkKAjeeQgoMMe29lAKtjTp2mF1ojKOw68%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994386/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994386>
2026-03-28 22:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994402/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994402>
2026-03-28 22:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023471/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023471>
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188933%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188933 not downloaded yet
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023538%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023538 not downloaded yet
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994497%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994497 not downloaded yet
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547169b90>
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44030eb3-dbb1-5194-a010-c4fe60817cb4/44030eb3-dbb1-5194-a010-c4fe60817cb4_expert_report_file_23aa9c87-9230-4f6e-8631-d05b863910f2.pdf HTTP/1.1" 201 0
2026-03-28 22:06:51 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 44030eb3-dbb1-5194-a010-c4fe60817cb4
2026-03-28 22:06:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44030eb3-dbb1-5194-a010-c4fe60817cb4, skipping ID generation
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 44030eb3-dbb1-5194-a010-c4fe60817cb4
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYD14AUA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YD14AUA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f827d0>
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4585172c-c0e4-57f4-9c9a-ae29c1c09e8a/4585172c-c0e4-57f4-9c9a-ae29c1c09e8a_expert_report_file_94d53216-6943-4940-a638-70418fb44bb8.pdf HTTP/1.1" 201 0
2026-03-28 22:06:51 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4585172c-c0e4-57f4-9c9a-ae29c1c09e8a
2026-03-28 22:06:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4585172c-c0e4-57f4-9c9a-ae29c1c09e8a, skipping ID generation
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4585172c-c0e4-57f4-9c9a-ae29c1c09e8a
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLF18AUM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LF18AUM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477e6010>
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ba24d3-8587-5eee-9f39-5a8e165a6cdc/f0ba24d3-8587-5eee-9f39-5a8e165a6cdc_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD18RFJ%252F698971810%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD18RFJ/698971810/600 saved to cache
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f0ba24d3-8587-5eee-9f39-5a8e165a6cdc
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554382850>
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7d66be-49b7-5d86-a859-5c899ed35afc/8f7d66be-49b7-5d86-a859-5c899ed35afc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND05TWY%252F699269162%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269162/600 saved to cache
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f7d66be-49b7-5d86-a859-5c899ed35afc
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f97a50>
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e220b51-e3aa-5dfc-97bc-648f804c494e/2e220b51-e3aa-5dfc-97bc-648f804c494e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ67HWW%252F698994737%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ67HWW/698994737/600 saved to cache
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2e220b51-e3aa-5dfc-97bc-648f804c494e
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554314b50>
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4494bc-d302-5d25-af44-49f73fc6f3e8/3b4494bc-d302-5d25-af44-49f73fc6f3e8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD17FAM%252F699285792%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD17FAM/699285792/600 saved to cache
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b4494bc-d302-5d25-af44-49f73fc6f3e8
2026-03-28 22:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD17FAM/699285771/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD17FAM/42810230?sv=2020-08-04&st=2026-03-28T22%3A05%3A03Z&se=2026-03-28T22%3A30%3A03Z&sr=b&sp=r&sig=%2FfBqToERqV4%2B1yskCr4WrQIIYBY5obdbLLah9TxlYo4%3D)
2026-03-28 22:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ67HWW/698994619/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ67HWW/42810839?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=bCH4BiUF13obmrAOV4AiGB4NLH07S%2Bo99SNbSt0wxEM%3D)
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253797%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253797 not downloaded yet
2026-03-28 22:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994417/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994417>
2026-03-28 22:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188878/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188878>
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188946%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188946 not downloaded yet
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023568%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023568 not downloaded yet
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994519%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994519 not downloaded yet
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253616%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253616 not downloaded yet
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189033%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189033 not downloaded yet
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b22810>
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ba24d3-8587-5eee-9f39-5a8e165a6cdc/f0ba24d3-8587-5eee-9f39-5a8e165a6cdc_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD18RFJ%252F698971789%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD18RFJ/698971789/600 saved to cache
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f0ba24d3-8587-5eee-9f39-5a8e165a6cdc
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554fa9c10>
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d/d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB15DHF%252F698970677%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB15DHF/698970677/600 saved to cache
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253804%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253804 not downloaded yet
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54778bd50>
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae3858f1-1a30-58b6-b115-1b6051bc84a2/ae3858f1-1a30-58b6-b115-1b6051bc84a2_expert_report_file_4e359e98-97a4-4d43-8b2b-67e1bec3a64b.pdf HTTP/1.1" 201 0
2026-03-28 22:06:51 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ae3858f1-1a30-58b6-b115-1b6051bc84a2
2026-03-28 22:06:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae3858f1-1a30-58b6-b115-1b6051bc84a2, skipping ID generation
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae3858f1-1a30-58b6-b115-1b6051bc84a2
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKS67XUM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KS67XUM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994360/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE55ACX/42810638?sv=2020-08-04&st=2026-03-28T22%3A06%3A46Z&se=2026-03-28T22%3A31%3A46Z&sr=b&sp=r&sig=Riislef1FM3HPBxrD0vvNR2RRo%2FNoFl6E6%2FfFWY7nLw%3D)
2026-03-28 22:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994425/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994425>
2026-03-28 22:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023481/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023481>
2026-03-28 22:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253773/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253773>
2026-03-28 22:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023492/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023492>
2026-03-28 22:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188897/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188897>
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188963%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188963 not downloaded yet
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023596%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023596 not downloaded yet
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994538%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994538 not downloaded yet
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253627%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253627 not downloaded yet
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189041%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189041 not downloaded yet
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253823%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253823 not downloaded yet
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189002%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189002 not downloaded yet
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557298e50>
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4494bc-d302-5d25-af44-49f73fc6f3e8/3b4494bc-d302-5d25-af44-49f73fc6f3e8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD17FAM%252F699285771%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD17FAM/699285771/600 saved to cache
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b4494bc-d302-5d25-af44-49f73fc6f3e8
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554ae2750>
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e220b51-e3aa-5dfc-97bc-648f804c494e/2e220b51-e3aa-5dfc-97bc-648f804c494e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ67HWW%252F698994619%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ67HWW/698994619/600 saved to cache
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2e220b51-e3aa-5dfc-97bc-648f804c494e
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253636%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253636 not downloaded yet
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189048%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189048 not downloaded yet
2026-03-28 22:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994438/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994438>
2026-03-28 22:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023496/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023496>
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253844%27 HTTP/1.1" 200 None
2026-03-28 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253844 not downloaded yet
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189005%27 HTTP/1.1" 200 None
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189005 not downloaded yet
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253643%27 HTTP/1.1" 200 None
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253643 not downloaded yet
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189055%27 HTTP/1.1" 200 None
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189055 not downloaded yet
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54739ff10>
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa39713-14e5-5c88-b2a8-4efb5721d2c2/bfa39713-14e5-5c88-b2a8-4efb5721d2c2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE55ACX%252F698994360%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994360/600 saved to cache
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bfa39713-14e5-5c88-b2a8-4efb5721d2c2
2026-03-28 22:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994386/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE55ACX/42810638?sv=2020-08-04&st=2026-03-28T22%3A06%3A46Z&se=2026-03-28T22%3A31%3A46Z&sr=b&sp=r&sig=Riislef1FM3HPBxrD0vvNR2RRo%2FNoFl6E6%2FfFWY7nLw%3D)
2026-03-28 22:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023471/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA06YTM/42810893?sv=2020-08-04&st=2026-03-28T22%3A06%3A46Z&se=2026-03-28T22%3A31%3A46Z&sr=b&sp=r&sig=nyYfmAfMU%2Bgfo%2Fr0LXXhL%2Bloa6zNH%2FTmTn3vJ%2FzTyJM%3D)
2026-03-28 22:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994402/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE55ACX/42810638?sv=2020-08-04&st=2026-03-28T22%3A06%3A46Z&se=2026-03-28T22%3A31%3A46Z&sr=b&sp=r&sig=Riislef1FM3HPBxrD0vvNR2RRo%2FNoFl6E6%2FfFWY7nLw%3D)
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253857%27 HTTP/1.1" 200 None
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253857 not downloaded yet
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189013%27 HTTP/1.1" 200 None
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189013 not downloaded yet
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253652%27 HTTP/1.1" 200 None
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253652 not downloaded yet
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189062%27 HTTP/1.1" 200 None
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189062 not downloaded yet
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253873%27 HTTP/1.1" 200 None
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253873 not downloaded yet
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189017%27 HTTP/1.1" 200 None
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189017 not downloaded yet
2026-03-28 22:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994417/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE55ACX/42810638?sv=2020-08-04&st=2026-03-28T22%3A06%3A46Z&se=2026-03-28T22%3A31%3A46Z&sr=b&sp=r&sig=Riislef1FM3HPBxrD0vvNR2RRo%2FNoFl6E6%2FfFWY7nLw%3D)
2026-03-28 22:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188878/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK67LGN/42807095?sv=2020-08-04&st=2026-03-28T22%3A06%3A47Z&se=2026-03-28T22%3A31%3A47Z&sr=b&sp=r&sig=B%2FYHzNbkypsk9Vk4GDgw38I9t41n7LDGOKEeGLzozuo%3D)
2026-03-28 22:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023517/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023517>
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253668%27 HTTP/1.1" 200 None
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253668 not downloaded yet
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189072%27 HTTP/1.1" 200 None
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189072 not downloaded yet
2026-03-28 22:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253788/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253788>
2026-03-28 22:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994466/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994466>
2026-03-28 22:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253773/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YJ63VCM/42809703?sv=2020-08-04&st=2026-03-28T22%3A06%3A47Z&se=2026-03-28T22%3A31%3A47Z&sr=b&sp=r&sig=N9qg9kdn8V%2FlXiT4%2BFnkQLDkgTs3TIHdpTtYI6Y8MNc%3D)
2026-03-28 22:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023492/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA06YTM/42810893?sv=2020-08-04&st=2026-03-28T22%3A06%3A46Z&se=2026-03-28T22%3A31%3A46Z&sr=b&sp=r&sig=nyYfmAfMU%2Bgfo%2Fr0LXXhL%2Bloa6zNH%2FTmTn3vJ%2FzTyJM%3D)
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189025%27 HTTP/1.1" 200 None
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189025 not downloaded yet
2026-03-28 22:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188897/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK67LGN/42807095?sv=2020-08-04&st=2026-03-28T22%3A06%3A47Z&se=2026-03-28T22%3A31%3A47Z&sr=b&sp=r&sig=B%2FYHzNbkypsk9Vk4GDgw38I9t41n7LDGOKEeGLzozuo%3D)
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253686%27 HTTP/1.1" 200 None
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253686 not downloaded yet
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189087%27 HTTP/1.1" 200 None
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189087 not downloaded yet
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543a4ed0>
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa39713-14e5-5c88-b2a8-4efb5721d2c2/bfa39713-14e5-5c88-b2a8-4efb5721d2c2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE55ACX%252F698994386%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994386/600 saved to cache
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bfa39713-14e5-5c88-b2a8-4efb5721d2c2
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554faa790>
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b735ecb-b987-5f51-9978-b14a854ed6a5/6b735ecb-b987-5f51-9978-b14a854ed6a5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA06YTM%252F699023471%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023471/600 saved to cache
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b735ecb-b987-5f51-9978-b14a854ed6a5
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543201d0>
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa39713-14e5-5c88-b2a8-4efb5721d2c2/bfa39713-14e5-5c88-b2a8-4efb5721d2c2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE55ACX%252F698994402%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994402/600 saved to cache
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bfa39713-14e5-5c88-b2a8-4efb5721d2c2
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189035%27 HTTP/1.1" 200 None
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189035 not downloaded yet
2026-03-28 22:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023481/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA06YTM/42810893?sv=2020-08-04&st=2026-03-28T22%3A06%3A46Z&se=2026-03-28T22%3A31%3A46Z&sr=b&sp=r&sig=nyYfmAfMU%2Bgfo%2Fr0LXXhL%2Bloa6zNH%2FTmTn3vJ%2FzTyJM%3D)
2026-03-28 22:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994425/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE55ACX/42810638?sv=2020-08-04&st=2026-03-28T22%3A06%3A46Z&se=2026-03-28T22%3A31%3A46Z&sr=b&sp=r&sig=Riislef1FM3HPBxrD0vvNR2RRo%2FNoFl6E6%2FfFWY7nLw%3D)
2026-03-28 22:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699188996/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KS67XUM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253704%27 HTTP/1.1" 200 None
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253704 not downloaded yet
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189099%27 HTTP/1.1" 200 None
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189099 not downloaded yet
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189047%27 HTTP/1.1" 200 None
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189047 not downloaded yet
2026-03-28 22:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994438/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE55ACX/42810638?sv=2020-08-04&st=2026-03-28T22%3A06%3A46Z&se=2026-03-28T22%3A31%3A46Z&sr=b&sp=r&sig=Riislef1FM3HPBxrD0vvNR2RRo%2FNoFl6E6%2FfFWY7nLw%3D)
2026-03-28 22:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023496/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA06YTM/42810893?sv=2020-08-04&st=2026-03-28T22%3A06%3A46Z&se=2026-03-28T22%3A31%3A46Z&sr=b&sp=r&sig=nyYfmAfMU%2Bgfo%2Fr0LXXhL%2Bloa6zNH%2FTmTn3vJ%2FzTyJM%3D)
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253718%27 HTTP/1.1" 200 None
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253718 not downloaded yet
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189111%27 HTTP/1.1" 200 None
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189111 not downloaded yet
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189063%27 HTTP/1.1" 200 None
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189063 not downloaded yet
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5477291d0>
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa39713-14e5-5c88-b2a8-4efb5721d2c2/bfa39713-14e5-5c88-b2a8-4efb5721d2c2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE55ACX%252F698994417%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994417/600 saved to cache
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bfa39713-14e5-5c88-b2a8-4efb5721d2c2
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a8b350>
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4177a308-7aae-587d-bd3e-07268dbbb6a0/4177a308-7aae-587d-bd3e-07268dbbb6a0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK67LGN%252F699188878%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188878/600 saved to cache
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4177a308-7aae-587d-bd3e-07268dbbb6a0
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554383210>
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c202ec85-ff2c-5425-bb13-378c8faf73ed/c202ec85-ff2c-5425-bb13-378c8faf73ed_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYJ63VCM%252F699253773%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253773/600 saved to cache
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c202ec85-ff2c-5425-bb13-378c8faf73ed
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554413bd0>
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b735ecb-b987-5f51-9978-b14a854ed6a5/6b735ecb-b987-5f51-9978-b14a854ed6a5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA06YTM%252F699023492%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023492/600 saved to cache
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b735ecb-b987-5f51-9978-b14a854ed6a5
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548dff50>
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4177a308-7aae-587d-bd3e-07268dbbb6a0/4177a308-7aae-587d-bd3e-07268dbbb6a0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK67LGN%252F699188897%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188897/600 saved to cache
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4177a308-7aae-587d-bd3e-07268dbbb6a0
2026-03-28 22:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189048/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189048>
2026-03-28 22:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189005/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189005>
2026-03-28 22:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253844/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253844>
2026-03-28 22:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253652/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253652>
2026-03-28 22:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189062/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189062>
2026-03-28 22:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023517/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA06YTM/42810893?sv=2020-08-04&st=2026-03-28T22%3A06%3A46Z&se=2026-03-28T22%3A31%3A46Z&sr=b&sp=r&sig=nyYfmAfMU%2Bgfo%2Fr0LXXhL%2Bloa6zNH%2FTmTn3vJ%2FzTyJM%3D)
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189076%27 HTTP/1.1" 200 None
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189076 not downloaded yet
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473db890>
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b735ecb-b987-5f51-9978-b14a854ed6a5/6b735ecb-b987-5f51-9978-b14a854ed6a5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA06YTM%252F699023481%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023481/600 saved to cache
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b735ecb-b987-5f51-9978-b14a854ed6a5
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473da190>
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa39713-14e5-5c88-b2a8-4efb5721d2c2/bfa39713-14e5-5c88-b2a8-4efb5721d2c2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE55ACX%252F698994425%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994425/600 saved to cache
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bfa39713-14e5-5c88-b2a8-4efb5721d2c2
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554849a90>
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa39713-14e5-5c88-b2a8-4efb5721d2c2/bfa39713-14e5-5c88-b2a8-4efb5721d2c2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE55ACX%252F698994438%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994438/600 saved to cache
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bfa39713-14e5-5c88-b2a8-4efb5721d2c2
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554848f90>
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b735ecb-b987-5f51-9978-b14a854ed6a5/6b735ecb-b987-5f51-9978-b14a854ed6a5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA06YTM%252F699023496%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023496/600 saved to cache
2026-03-28 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b735ecb-b987-5f51-9978-b14a854ed6a5
2026-03-28 22:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253788/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YJ63VCM/42809703?sv=2020-08-04&st=2026-03-28T22%3A06%3A47Z&se=2026-03-28T22%3A31%3A47Z&sr=b&sp=r&sig=N9qg9kdn8V%2FlXiT4%2BFnkQLDkgTs3TIHdpTtYI6Y8MNc%3D)
2026-03-28 22:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189072/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189072>
2026-03-28 22:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189017/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189017>
2026-03-28 22:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253668/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253668>
2026-03-28 22:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994466/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE55ACX/42810638?sv=2020-08-04&st=2026-03-28T22%3A06%3A46Z&se=2026-03-28T22%3A31%3A46Z&sr=b&sp=r&sig=Riislef1FM3HPBxrD0vvNR2RRo%2FNoFl6E6%2FfFWY7nLw%3D)
2026-03-28 22:06:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55484b790>
2026-03-28 22:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b735ecb-b987-5f51-9978-b14a854ed6a5/6b735ecb-b987-5f51-9978-b14a854ed6a5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA06YTM%252F699023517%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023517/600 saved to cache
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b735ecb-b987-5f51-9978-b14a854ed6a5
2026-03-28 22:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253686/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253686>
2026-03-28 22:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189087/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189087>
2026-03-28 22:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699188996/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS67XUM/42807715?sv=2020-08-04&st=2026-03-28T22%3A06%3A49Z&se=2026-03-28T22%3A31%3A49Z&sr=b&sp=r&sig=9ijgKTkHMSlkKAjeeQgoMMe29lAKtjTp2mF1ojKOw68%3D)
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55430e650>
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c202ec85-ff2c-5425-bb13-378c8faf73ed/c202ec85-ff2c-5425-bb13-378c8faf73ed_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYJ63VCM%252F699253788%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253788/600 saved to cache
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c202ec85-ff2c-5425-bb13-378c8faf73ed
2026-03-28 22:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189048/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LF18AUM/42801914?sv=2020-08-04&st=2026-03-28T22%3A06%3A48Z&se=2026-03-28T22%3A31%3A48Z&sr=b&sp=r&sig=oYTLlDUnLi4Hc5mT4cv1Q26PIJWnHH5lV65UPCotNYQ%3D)
2026-03-28 22:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189005/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS67XUM/42807715?sv=2020-08-04&st=2026-03-28T22%3A06%3A49Z&se=2026-03-28T22%3A31%3A49Z&sr=b&sp=r&sig=9ijgKTkHMSlkKAjeeQgoMMe29lAKtjTp2mF1ojKOw68%3D)
2026-03-28 22:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189062/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LF18AUM/42801914?sv=2020-08-04&st=2026-03-28T22%3A06%3A48Z&se=2026-03-28T22%3A31%3A48Z&sr=b&sp=r&sig=oYTLlDUnLi4Hc5mT4cv1Q26PIJWnHH5lV65UPCotNYQ%3D)
2026-03-28 22:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189099/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189099>
2026-03-28 22:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253652/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD14AUA/42809648?sv=2020-08-04&st=2026-03-28T22%3A06%3A48Z&se=2026-03-28T22%3A31%3A48Z&sr=b&sp=r&sig=Wm4zSZCCXBpqZHbZ%2B715uXy%2BsIoOmWFmsxwRHQ4IDag%3D)
2026-03-28 22:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189047/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189047>
2026-03-28 22:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189063/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189063>
2026-03-28 22:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253844/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YJ63VCM/42809703?sv=2020-08-04&st=2026-03-28T22%3A06%3A47Z&se=2026-03-28T22%3A31%3A47Z&sr=b&sp=r&sig=N9qg9kdn8V%2FlXiT4%2BFnkQLDkgTs3TIHdpTtYI6Y8MNc%3D)
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f83b50>
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa39713-14e5-5c88-b2a8-4efb5721d2c2/bfa39713-14e5-5c88-b2a8-4efb5721d2c2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE55ACX%252F698994466%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994466/600 saved to cache
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bfa39713-14e5-5c88-b2a8-4efb5721d2c2
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547479c50>
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae3858f1-1a30-58b6-b115-1b6051bc84a2/ae3858f1-1a30-58b6-b115-1b6051bc84a2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS67XUM%252F699188996%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699188996/600 saved to cache
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae3858f1-1a30-58b6-b115-1b6051bc84a2
2026-03-28 22:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189017/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS67XUM/42807715?sv=2020-08-04&st=2026-03-28T22%3A06%3A49Z&se=2026-03-28T22%3A31%3A49Z&sr=b&sp=r&sig=9ijgKTkHMSlkKAjeeQgoMMe29lAKtjTp2mF1ojKOw68%3D)
2026-03-28 22:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189111/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189111>
2026-03-28 22:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189076/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189076>
2026-03-28 22:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253668/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD14AUA/42809648?sv=2020-08-04&st=2026-03-28T22%3A06%3A48Z&se=2026-03-28T22%3A31%3A48Z&sr=b&sp=r&sig=Wm4zSZCCXBpqZHbZ%2B715uXy%2BsIoOmWFmsxwRHQ4IDag%3D)
2026-03-28 22:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189087/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LF18AUM/42801914?sv=2020-08-04&st=2026-03-28T22%3A06%3A48Z&se=2026-03-28T22%3A31%3A48Z&sr=b&sp=r&sig=oYTLlDUnLi4Hc5mT4cv1Q26PIJWnHH5lV65UPCotNYQ%3D)
2026-03-28 22:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253718/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253718>
2026-03-28 22:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189072/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LF18AUM/42801914?sv=2020-08-04&st=2026-03-28T22%3A06%3A48Z&se=2026-03-28T22%3A31%3A48Z&sr=b&sp=r&sig=oYTLlDUnLi4Hc5mT4cv1Q26PIJWnHH5lV65UPCotNYQ%3D)
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544e0390>
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4585172c-c0e4-57f4-9c9a-ae29c1c09e8a/4585172c-c0e4-57f4-9c9a-ae29c1c09e8a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLF18AUM%252F699189048%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189048/600 saved to cache
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4585172c-c0e4-57f4-9c9a-ae29c1c09e8a
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554405290>
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae3858f1-1a30-58b6-b115-1b6051bc84a2/ae3858f1-1a30-58b6-b115-1b6051bc84a2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS67XUM%252F699189005%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189005/600 saved to cache
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ae3858f1-1a30-58b6-b115-1b6051bc84a2
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55485b8d0>
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4585172c-c0e4-57f4-9c9a-ae29c1c09e8a/4585172c-c0e4-57f4-9c9a-ae29c1c09e8a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLF18AUM%252F699189062%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189062/600 saved to cache
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4585172c-c0e4-57f4-9c9a-ae29c1c09e8a
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554407890>
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44030eb3-dbb1-5194-a010-c4fe60817cb4/44030eb3-dbb1-5194-a010-c4fe60817cb4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD14AUA%252F699253652%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253652/600 saved to cache
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 44030eb3-dbb1-5194-a010-c4fe60817cb4
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b21b50>
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c202ec85-ff2c-5425-bb13-378c8faf73ed/c202ec85-ff2c-5425-bb13-378c8faf73ed_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYJ63VCM%252F699253844%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253844/600 saved to cache
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c202ec85-ff2c-5425-bb13-378c8faf73ed
2026-03-28 22:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253686/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD14AUA/42809648?sv=2020-08-04&st=2026-03-28T22%3A06%3A48Z&se=2026-03-28T22%3A31%3A48Z&sr=b&sp=r&sig=Wm4zSZCCXBpqZHbZ%2B715uXy%2BsIoOmWFmsxwRHQ4IDag%3D)
2026-03-28 22:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189047/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS67XUM/42807715?sv=2020-08-04&st=2026-03-28T22%3A06%3A49Z&se=2026-03-28T22%3A31%3A49Z&sr=b&sp=r&sig=9ijgKTkHMSlkKAjeeQgoMMe29lAKtjTp2mF1ojKOw68%3D)
2026-03-28 22:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253704/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253704>
2026-03-28 22:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189025/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189025>
2026-03-28 22:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189035/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189035>
2026-03-28 22:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189063/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS67XUM/42807715?sv=2020-08-04&st=2026-03-28T22%3A06%3A49Z&se=2026-03-28T22%3A31%3A49Z&sr=b&sp=r&sig=9ijgKTkHMSlkKAjeeQgoMMe29lAKtjTp2mF1ojKOw68%3D)
2026-03-28 22:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189099/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LF18AUM/42801914?sv=2020-08-04&st=2026-03-28T22%3A06%3A48Z&se=2026-03-28T22%3A31%3A48Z&sr=b&sp=r&sig=oYTLlDUnLi4Hc5mT4cv1Q26PIJWnHH5lV65UPCotNYQ%3D)
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b02c10>
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae3858f1-1a30-58b6-b115-1b6051bc84a2/ae3858f1-1a30-58b6-b115-1b6051bc84a2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS67XUM%252F699189017%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189017/600 saved to cache
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ae3858f1-1a30-58b6-b115-1b6051bc84a2
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54717c050>
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44030eb3-dbb1-5194-a010-c4fe60817cb4/44030eb3-dbb1-5194-a010-c4fe60817cb4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD14AUA%252F699253668%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253668/600 saved to cache
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 44030eb3-dbb1-5194-a010-c4fe60817cb4
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474f4590>
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4585172c-c0e4-57f4-9c9a-ae29c1c09e8a/4585172c-c0e4-57f4-9c9a-ae29c1c09e8a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLF18AUM%252F699189087%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189087/600 saved to cache
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4585172c-c0e4-57f4-9c9a-ae29c1c09e8a
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a89ed0>
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4585172c-c0e4-57f4-9c9a-ae29c1c09e8a/4585172c-c0e4-57f4-9c9a-ae29c1c09e8a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLF18AUM%252F699189072%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189072/600 saved to cache
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4585172c-c0e4-57f4-9c9a-ae29c1c09e8a
2026-03-28 22:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253873/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253873>
2026-03-28 22:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189055/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189055>
2026-03-28 22:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189013/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189013>
2026-03-28 22:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253857/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253857>
2026-03-28 22:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253643/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253643>
2026-03-28 22:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253718/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD14AUA/42809648?sv=2020-08-04&st=2026-03-28T22%3A06%3A48Z&se=2026-03-28T22%3A31%3A48Z&sr=b&sp=r&sig=Wm4zSZCCXBpqZHbZ%2B715uXy%2BsIoOmWFmsxwRHQ4IDag%3D)
2026-03-28 22:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189076/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS67XUM/42807715?sv=2020-08-04&st=2026-03-28T22%3A06%3A49Z&se=2026-03-28T22%3A31%3A49Z&sr=b&sp=r&sig=9ijgKTkHMSlkKAjeeQgoMMe29lAKtjTp2mF1ojKOw68%3D)
2026-03-28 22:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189111/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LF18AUM/42801914?sv=2020-08-04&st=2026-03-28T22%3A06%3A48Z&se=2026-03-28T22%3A31%3A48Z&sr=b&sp=r&sig=oYTLlDUnLi4Hc5mT4cv1Q26PIJWnHH5lV65UPCotNYQ%3D)
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472262d0>
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44030eb3-dbb1-5194-a010-c4fe60817cb4/44030eb3-dbb1-5194-a010-c4fe60817cb4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD14AUA%252F699253686%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253686/600 saved to cache
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 44030eb3-dbb1-5194-a010-c4fe60817cb4
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55486ae10>
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae3858f1-1a30-58b6-b115-1b6051bc84a2/ae3858f1-1a30-58b6-b115-1b6051bc84a2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS67XUM%252F699189047%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189047/600 saved to cache
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ae3858f1-1a30-58b6-b115-1b6051bc84a2
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543fd390>
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae3858f1-1a30-58b6-b115-1b6051bc84a2/ae3858f1-1a30-58b6-b115-1b6051bc84a2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS67XUM%252F699189063%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189063/600 saved to cache
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ae3858f1-1a30-58b6-b115-1b6051bc84a2
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55486acd0>
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4585172c-c0e4-57f4-9c9a-ae29c1c09e8a/4585172c-c0e4-57f4-9c9a-ae29c1c09e8a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLF18AUM%252F699189099%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189099/600 saved to cache
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4585172c-c0e4-57f4-9c9a-ae29c1c09e8a
2026-03-28 22:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189025/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS67XUM/42807715?sv=2020-08-04&st=2026-03-28T22%3A06%3A49Z&se=2026-03-28T22%3A31%3A49Z&sr=b&sp=r&sig=9ijgKTkHMSlkKAjeeQgoMMe29lAKtjTp2mF1ojKOw68%3D)
2026-03-28 22:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189002/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189002>
2026-03-28 22:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253636/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253636>
2026-03-28 22:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189035/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS67XUM/42807715?sv=2020-08-04&st=2026-03-28T22%3A06%3A49Z&se=2026-03-28T22%3A31%3A49Z&sr=b&sp=r&sig=9ijgKTkHMSlkKAjeeQgoMMe29lAKtjTp2mF1ojKOw68%3D)
2026-03-28 22:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253704/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD14AUA/42809648?sv=2020-08-04&st=2026-03-28T22%3A06%3A48Z&se=2026-03-28T22%3A31%3A48Z&sr=b&sp=r&sig=Wm4zSZCCXBpqZHbZ%2B715uXy%2BsIoOmWFmsxwRHQ4IDag%3D)
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549adb50>
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44030eb3-dbb1-5194-a010-c4fe60817cb4/44030eb3-dbb1-5194-a010-c4fe60817cb4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD14AUA%252F699253718%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253718/600 saved to cache
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 44030eb3-dbb1-5194-a010-c4fe60817cb4
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f83150>
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae3858f1-1a30-58b6-b115-1b6051bc84a2/ae3858f1-1a30-58b6-b115-1b6051bc84a2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS67XUM%252F699189076%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189076/600 saved to cache
2026-03-28 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ae3858f1-1a30-58b6-b115-1b6051bc84a2
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547452950>
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4585172c-c0e4-57f4-9c9a-ae29c1c09e8a/4585172c-c0e4-57f4-9c9a-ae29c1c09e8a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLF18AUM%252F699189111%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189111/600 saved to cache
2026-03-28 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4585172c-c0e4-57f4-9c9a-ae29c1c09e8a
2026-03-28 22:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253627/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253627>
2026-03-28 22:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253643/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD14AUA/42809648?sv=2020-08-04&st=2026-03-28T22%3A06%3A48Z&se=2026-03-28T22%3A31%3A48Z&sr=b&sp=r&sig=Wm4zSZCCXBpqZHbZ%2B715uXy%2BsIoOmWFmsxwRHQ4IDag%3D)
2026-03-28 22:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189013/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS67XUM/42807715?sv=2020-08-04&st=2026-03-28T22%3A06%3A49Z&se=2026-03-28T22%3A31%3A49Z&sr=b&sp=r&sig=9ijgKTkHMSlkKAjeeQgoMMe29lAKtjTp2mF1ojKOw68%3D)
2026-03-28 22:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253823/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253823>
2026-03-28 22:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189041/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189041>
2026-03-28 22:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253857/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YJ63VCM/42809703?sv=2020-08-04&st=2026-03-28T22%3A06%3A47Z&se=2026-03-28T22%3A31%3A47Z&sr=b&sp=r&sig=N9qg9kdn8V%2FlXiT4%2BFnkQLDkgTs3TIHdpTtYI6Y8MNc%3D)
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f81d10>
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae3858f1-1a30-58b6-b115-1b6051bc84a2/ae3858f1-1a30-58b6-b115-1b6051bc84a2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS67XUM%252F699189025%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189025/600 saved to cache
2026-03-28 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ae3858f1-1a30-58b6-b115-1b6051bc84a2
2026-03-28 22:06:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549696d0>
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae3858f1-1a30-58b6-b115-1b6051bc84a2/ae3858f1-1a30-58b6-b115-1b6051bc84a2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS67XUM%252F699189035%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189035/600 saved to cache
2026-03-28 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ae3858f1-1a30-58b6-b115-1b6051bc84a2
2026-03-28 22:06:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471b1510>
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44030eb3-dbb1-5194-a010-c4fe60817cb4/44030eb3-dbb1-5194-a010-c4fe60817cb4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD14AUA%252F699253704%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253704/600 saved to cache
2026-03-28 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 44030eb3-dbb1-5194-a010-c4fe60817cb4
2026-03-28 22:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189055/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LF18AUM/42801914?sv=2020-08-04&st=2026-03-28T22%3A06%3A48Z&se=2026-03-28T22%3A31%3A48Z&sr=b&sp=r&sig=oYTLlDUnLi4Hc5mT4cv1Q26PIJWnHH5lV65UPCotNYQ%3D)
2026-03-28 22:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253636/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD14AUA/42809648?sv=2020-08-04&st=2026-03-28T22%3A06%3A48Z&se=2026-03-28T22%3A31%3A48Z&sr=b&sp=r&sig=Wm4zSZCCXBpqZHbZ%2B715uXy%2BsIoOmWFmsxwRHQ4IDag%3D)
2026-03-28 22:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189002/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS67XUM/42807715?sv=2020-08-04&st=2026-03-28T22%3A06%3A49Z&se=2026-03-28T22%3A31%3A49Z&sr=b&sp=r&sig=9ijgKTkHMSlkKAjeeQgoMMe29lAKtjTp2mF1ojKOw68%3D)
2026-03-28 22:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994538/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994538>
2026-03-28 22:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188963/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188963>
2026-03-28 22:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023596/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023596>
2026-03-28 22:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253873/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YJ63VCM/42809703?sv=2020-08-04&st=2026-03-28T22%3A06%3A47Z&se=2026-03-28T22%3A31%3A47Z&sr=b&sp=r&sig=N9qg9kdn8V%2FlXiT4%2BFnkQLDkgTs3TIHdpTtYI6Y8MNc%3D)
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f83f10>
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44030eb3-dbb1-5194-a010-c4fe60817cb4/44030eb3-dbb1-5194-a010-c4fe60817cb4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD14AUA%252F699253643%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253643/600 saved to cache
2026-03-28 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 44030eb3-dbb1-5194-a010-c4fe60817cb4
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a8a250>
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae3858f1-1a30-58b6-b115-1b6051bc84a2/ae3858f1-1a30-58b6-b115-1b6051bc84a2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS67XUM%252F699189013%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189013/600 saved to cache
2026-03-28 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ae3858f1-1a30-58b6-b115-1b6051bc84a2
2026-03-28 22:06:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5476648d0>
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c202ec85-ff2c-5425-bb13-378c8faf73ed/c202ec85-ff2c-5425-bb13-378c8faf73ed_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYJ63VCM%252F699253857%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253857/600 saved to cache
2026-03-28 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c202ec85-ff2c-5425-bb13-378c8faf73ed
2026-03-28 22:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253804/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253804>
2026-03-28 22:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253627/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD14AUA/42809648?sv=2020-08-04&st=2026-03-28T22%3A06%3A48Z&se=2026-03-28T22%3A31%3A48Z&sr=b&sp=r&sig=Wm4zSZCCXBpqZHbZ%2B715uXy%2BsIoOmWFmsxwRHQ4IDag%3D)
2026-03-28 22:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189041/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LF18AUM/42801914?sv=2020-08-04&st=2026-03-28T22%3A06%3A48Z&se=2026-03-28T22%3A31%3A48Z&sr=b&sp=r&sig=oYTLlDUnLi4Hc5mT4cv1Q26PIJWnHH5lV65UPCotNYQ%3D)
2026-03-28 22:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189033/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189033>
2026-03-28 22:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994519/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994519>
2026-03-28 22:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253616/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253616>
2026-03-28 22:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253823/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YJ63VCM/42809703?sv=2020-08-04&st=2026-03-28T22%3A06%3A47Z&se=2026-03-28T22%3A31%3A47Z&sr=b&sp=r&sig=N9qg9kdn8V%2FlXiT4%2BFnkQLDkgTs3TIHdpTtYI6Y8MNc%3D)
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55486a9d0>
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4585172c-c0e4-57f4-9c9a-ae29c1c09e8a/4585172c-c0e4-57f4-9c9a-ae29c1c09e8a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLF18AUM%252F699189055%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189055/600 saved to cache
2026-03-28 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4585172c-c0e4-57f4-9c9a-ae29c1c09e8a
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55430e810>
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44030eb3-dbb1-5194-a010-c4fe60817cb4/44030eb3-dbb1-5194-a010-c4fe60817cb4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD14AUA%252F699253636%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253636/600 saved to cache
2026-03-28 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 44030eb3-dbb1-5194-a010-c4fe60817cb4
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554aa5010>
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae3858f1-1a30-58b6-b115-1b6051bc84a2/ae3858f1-1a30-58b6-b115-1b6051bc84a2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS67XUM%252F699189002%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189002/600 saved to cache
2026-03-28 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ae3858f1-1a30-58b6-b115-1b6051bc84a2
2026-03-28 22:06:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae3858f1-1a30-58b6-b115-1b6051bc84a2, skipping ID generation
2026-03-28 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae3858f1-1a30-58b6-b115-1b6051bc84a2 sending to next pipeline
2026-03-28 22:06:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ae3858f1-1a30-58b6-b115-1b6051bc84a2, identifier: KS67%20XUM
2026-03-28 22:06:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5578dc050>
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c202ec85-ff2c-5425-bb13-378c8faf73ed/c202ec85-ff2c-5425-bb13-378c8faf73ed_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYJ63VCM%252F699253873%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253873/600 saved to cache
2026-03-28 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c202ec85-ff2c-5425-bb13-378c8faf73ed
2026-03-28 22:06:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ae3858f1-1a30-58b6-b115-1b6051bc84a2 with identifier: KS67%20XUM
2026-03-28 22:06:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ae3858f1-1a30-58b6-b115-1b6051bc84a2 with identifier: KS67%20XUM
2026-03-28 22:06:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ae3858f1-1a30-58b6-b115-1b6051bc84a2 with identifier: KS67%20XUM to the API
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189002/600>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae3858f1-1a30-58b6-b115-1b6051bc84a2/ae3858f1-1a30-58b6-b115-1b6051bc84a2_expert_report_file_4e359e98-97a4-4d43-8b2b-67e1bec3a64b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KS67%20XUM-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Electric',
'id': 'ae3858f1-1a30-58b6-b115-1b6051bc84a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KS67 XUM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KS67%20XUM&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'RENAULT',
'model': 'ZOE',
'odometer': 47639,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae3858f1-1a30-58b6-b115-1b6051bc84a2/ae3858f1-1a30-58b6-b115-1b6051bc84a2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38582,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699188996/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae3858f1-1a30-58b6-b115-1b6051bc84a2/ae3858f1-1a30-58b6-b115-1b6051bc84a2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39508,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189002/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae3858f1-1a30-58b6-b115-1b6051bc84a2/ae3858f1-1a30-58b6-b115-1b6051bc84a2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37515,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189005/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae3858f1-1a30-58b6-b115-1b6051bc84a2/ae3858f1-1a30-58b6-b115-1b6051bc84a2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38137,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189013/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae3858f1-1a30-58b6-b115-1b6051bc84a2/ae3858f1-1a30-58b6-b115-1b6051bc84a2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37819,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189017/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae3858f1-1a30-58b6-b115-1b6051bc84a2/ae3858f1-1a30-58b6-b115-1b6051bc84a2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37313,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189025/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae3858f1-1a30-58b6-b115-1b6051bc84a2/ae3858f1-1a30-58b6-b115-1b6051bc84a2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86567,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189035/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae3858f1-1a30-58b6-b115-1b6051bc84a2/ae3858f1-1a30-58b6-b115-1b6051bc84a2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53842,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189047/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae3858f1-1a30-58b6-b115-1b6051bc84a2/ae3858f1-1a30-58b6-b115-1b6051bc84a2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68237,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189063/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae3858f1-1a30-58b6-b115-1b6051bc84a2/ae3858f1-1a30-58b6-b115-1b6051bc84a2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71580,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS67XUM/699189076/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'RENAULT ZOE 92 I-DYNAMIQUE Hatchback',
'transmission': 'automatic',
'trim': '92 I-DYNAMIQUE',
'vin': 'VF1AGVYF058981557',
'year': 2017}
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS67%2520XUM%27 HTTP/1.1" 200 None
2026-03-28 22:06:55 [bca.uk] INFO: Saving data for KS67%20XUM: {'created_time': 1774735615.287125, 'last_price_update_time': 1774735615.287134, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KS67%2520XUM') HTTP/1.1" 204 0
2026-03-28 22:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023568/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023568>
2026-03-28 22:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188946/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188946>
2026-03-28 22:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253797/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253797>
2026-03-28 22:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189027/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LF18AUM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253608/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YD14AUA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994538/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE55ACX/42810638?sv=2020-08-04&st=2026-03-28T22%3A06%3A46Z&se=2026-03-28T22%3A31%3A46Z&sr=b&sp=r&sig=Riislef1FM3HPBxrD0vvNR2RRo%2FNoFl6E6%2FfFWY7nLw%3D)
2026-03-28 22:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023596/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA06YTM/42810893?sv=2020-08-04&st=2026-03-28T22%3A06%3A46Z&se=2026-03-28T22%3A31%3A46Z&sr=b&sp=r&sig=nyYfmAfMU%2Bgfo%2Fr0LXXhL%2Bloa6zNH%2FTmTn3vJ%2FzTyJM%3D)
2026-03-28 22:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188963/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK67LGN/42807095?sv=2020-08-04&st=2026-03-28T22%3A06%3A47Z&se=2026-03-28T22%3A31%3A47Z&sr=b&sp=r&sig=B%2FYHzNbkypsk9Vk4GDgw38I9t41n7LDGOKEeGLzozuo%3D)
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555c50690>
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44030eb3-dbb1-5194-a010-c4fe60817cb4/44030eb3-dbb1-5194-a010-c4fe60817cb4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD14AUA%252F699253627%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253627/600 saved to cache
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 44030eb3-dbb1-5194-a010-c4fe60817cb4
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473bbd50>
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4585172c-c0e4-57f4-9c9a-ae29c1c09e8a/4585172c-c0e4-57f4-9c9a-ae29c1c09e8a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLF18AUM%252F699189041%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189041/600 saved to cache
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4585172c-c0e4-57f4-9c9a-ae29c1c09e8a
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474b8250>
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c202ec85-ff2c-5425-bb13-378c8faf73ed/c202ec85-ff2c-5425-bb13-378c8faf73ed_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYJ63VCM%252F699253823%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253823/600 saved to cache
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c202ec85-ff2c-5425-bb13-378c8faf73ed
2026-03-28 22:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253616/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD14AUA/42809648?sv=2020-08-04&st=2026-03-28T22%3A06%3A48Z&se=2026-03-28T22%3A31%3A48Z&sr=b&sp=r&sig=Wm4zSZCCXBpqZHbZ%2B715uXy%2BsIoOmWFmsxwRHQ4IDag%3D)
2026-03-28 22:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189033/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LF18AUM/42801914?sv=2020-08-04&st=2026-03-28T22%3A06%3A48Z&se=2026-03-28T22%3A31%3A48Z&sr=b&sp=r&sig=oYTLlDUnLi4Hc5mT4cv1Q26PIJWnHH5lV65UPCotNYQ%3D)
2026-03-28 22:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994497/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994497>
2026-03-28 22:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994519/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE55ACX/42810638?sv=2020-08-04&st=2026-03-28T22%3A06%3A46Z&se=2026-03-28T22%3A31%3A46Z&sr=b&sp=r&sig=Riislef1FM3HPBxrD0vvNR2RRo%2FNoFl6E6%2FfFWY7nLw%3D)
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b5b1d0>
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa39713-14e5-5c88-b2a8-4efb5721d2c2/bfa39713-14e5-5c88-b2a8-4efb5721d2c2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE55ACX%252F698994538%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994538/600 saved to cache
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bfa39713-14e5-5c88-b2a8-4efb5721d2c2
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473b7ad0>
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b735ecb-b987-5f51-9978-b14a854ed6a5/6b735ecb-b987-5f51-9978-b14a854ed6a5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA06YTM%252F699023596%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023596/600 saved to cache
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6b735ecb-b987-5f51-9978-b14a854ed6a5
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55485a5d0>
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4177a308-7aae-587d-bd3e-07268dbbb6a0/4177a308-7aae-587d-bd3e-07268dbbb6a0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK67LGN%252F699188963%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188963/600 saved to cache
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4177a308-7aae-587d-bd3e-07268dbbb6a0
2026-03-28 22:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253804/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YJ63VCM/42809703?sv=2020-08-04&st=2026-03-28T22%3A06%3A47Z&se=2026-03-28T22%3A31%3A47Z&sr=b&sp=r&sig=N9qg9kdn8V%2FlXiT4%2BFnkQLDkgTs3TIHdpTtYI6Y8MNc%3D)
2026-03-28 22:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188933/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188933>
2026-03-28 22:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188917/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188917>
2026-03-28 22:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023538/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023538>
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54716a1d0>
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44030eb3-dbb1-5194-a010-c4fe60817cb4/44030eb3-dbb1-5194-a010-c4fe60817cb4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD14AUA%252F699253616%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253616/600 saved to cache
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 44030eb3-dbb1-5194-a010-c4fe60817cb4
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473b5010>
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4585172c-c0e4-57f4-9c9a-ae29c1c09e8a/4585172c-c0e4-57f4-9c9a-ae29c1c09e8a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLF18AUM%252F699189033%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189033/600 saved to cache
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4585172c-c0e4-57f4-9c9a-ae29c1c09e8a
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a62050>
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa39713-14e5-5c88-b2a8-4efb5721d2c2/bfa39713-14e5-5c88-b2a8-4efb5721d2c2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE55ACX%252F698994519%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994519/600 saved to cache
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bfa39713-14e5-5c88-b2a8-4efb5721d2c2
2026-03-28 22:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253797/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YJ63VCM/42809703?sv=2020-08-04&st=2026-03-28T22%3A06%3A47Z&se=2026-03-28T22%3A31%3A47Z&sr=b&sp=r&sig=N9qg9kdn8V%2FlXiT4%2BFnkQLDkgTs3TIHdpTtYI6Y8MNc%3D)
2026-03-28 22:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189027/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LF18AUM/42801914?sv=2020-08-04&st=2026-03-28T22%3A06%3A48Z&se=2026-03-28T22%3A31%3A48Z&sr=b&sp=r&sig=oYTLlDUnLi4Hc5mT4cv1Q26PIJWnHH5lV65UPCotNYQ%3D)
2026-03-28 22:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253608/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD14AUA/42809648?sv=2020-08-04&st=2026-03-28T22%3A06%3A48Z&se=2026-03-28T22%3A31%3A48Z&sr=b&sp=r&sig=Wm4zSZCCXBpqZHbZ%2B715uXy%2BsIoOmWFmsxwRHQ4IDag%3D)
2026-03-28 22:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188904/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188904>
2026-03-28 22:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253779/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253779>
2026-03-28 22:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253766/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YJ63VCM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023568/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA06YTM/42810893?sv=2020-08-04&st=2026-03-28T22%3A06%3A46Z&se=2026-03-28T22%3A31%3A46Z&sr=b&sp=r&sig=nyYfmAfMU%2Bgfo%2Fr0LXXhL%2Bloa6zNH%2FTmTn3vJ%2FzTyJM%3D)
2026-03-28 22:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188946/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK67LGN/42807095?sv=2020-08-04&st=2026-03-28T22%3A06%3A47Z&se=2026-03-28T22%3A31%3A47Z&sr=b&sp=r&sig=B%2FYHzNbkypsk9Vk4GDgw38I9t41n7LDGOKEeGLzozuo%3D)
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473da710>
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c202ec85-ff2c-5425-bb13-378c8faf73ed/c202ec85-ff2c-5425-bb13-378c8faf73ed_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYJ63VCM%252F699253804%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253804/600 saved to cache
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c202ec85-ff2c-5425-bb13-378c8faf73ed
2026-03-28 22:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188886/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188886>
2026-03-28 22:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994497/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE55ACX/42810638?sv=2020-08-04&st=2026-03-28T22%3A06%3A46Z&se=2026-03-28T22%3A31%3A46Z&sr=b&sp=r&sig=Riislef1FM3HPBxrD0vvNR2RRo%2FNoFl6E6%2FfFWY7nLw%3D)
2026-03-28 22:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188868/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188868>
2026-03-28 22:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023460/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023460>
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554277110>
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c202ec85-ff2c-5425-bb13-378c8faf73ed/c202ec85-ff2c-5425-bb13-378c8faf73ed_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYJ63VCM%252F699253797%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253797/600 saved to cache
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c202ec85-ff2c-5425-bb13-378c8faf73ed
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547278890>
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4585172c-c0e4-57f4-9c9a-ae29c1c09e8a/4585172c-c0e4-57f4-9c9a-ae29c1c09e8a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLF18AUM%252F699189027%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189027/600 saved to cache
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4585172c-c0e4-57f4-9c9a-ae29c1c09e8a
2026-03-28 22:06:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4585172c-c0e4-57f4-9c9a-ae29c1c09e8a, skipping ID generation
2026-03-28 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4585172c-c0e4-57f4-9c9a-ae29c1c09e8a sending to next pipeline
2026-03-28 22:06:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4585172c-c0e4-57f4-9c9a-ae29c1c09e8a, identifier: LF18%20AUM
2026-03-28 22:06:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4585172c-c0e4-57f4-9c9a-ae29c1c09e8a with identifier: LF18%20AUM
2026-03-28 22:06:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4585172c-c0e4-57f4-9c9a-ae29c1c09e8a with identifier: LF18%20AUM
2026-03-28 22:06:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4585172c-c0e4-57f4-9c9a-ae29c1c09e8a with identifier: LF18%20AUM to the API
2026-03-28 22:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189027/600>
{'auction_title': '',
'c_o_2_emission_value': 94,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4585172c-c0e4-57f4-9c9a-ae29c1c09e8a/4585172c-c0e4-57f4-9c9a-ae29c1c09e8a_expert_report_file_94d53216-6943-4940-a638-70418fb44bb8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LF18%20AUM-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4585172c-c0e4-57f4-9c9a-ae29c1c09e8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LF18 AUM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LF18%20AUM&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'KIA',
'model': 'CEED',
'odometer': 35237,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4585172c-c0e4-57f4-9c9a-ae29c1c09e8a/4585172c-c0e4-57f4-9c9a-ae29c1c09e8a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41641,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189027/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4585172c-c0e4-57f4-9c9a-ae29c1c09e8a/4585172c-c0e4-57f4-9c9a-ae29c1c09e8a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41566,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189033/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4585172c-c0e4-57f4-9c9a-ae29c1c09e8a/4585172c-c0e4-57f4-9c9a-ae29c1c09e8a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37742,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189041/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4585172c-c0e4-57f4-9c9a-ae29c1c09e8a/4585172c-c0e4-57f4-9c9a-ae29c1c09e8a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38961,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189048/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4585172c-c0e4-57f4-9c9a-ae29c1c09e8a/4585172c-c0e4-57f4-9c9a-ae29c1c09e8a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37479,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189055/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4585172c-c0e4-57f4-9c9a-ae29c1c09e8a/4585172c-c0e4-57f4-9c9a-ae29c1c09e8a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36224,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189062/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4585172c-c0e4-57f4-9c9a-ae29c1c09e8a/4585172c-c0e4-57f4-9c9a-ae29c1c09e8a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76894,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189072/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4585172c-c0e4-57f4-9c9a-ae29c1c09e8a/4585172c-c0e4-57f4-9c9a-ae29c1c09e8a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68380,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189087/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4585172c-c0e4-57f4-9c9a-ae29c1c09e8a/4585172c-c0e4-57f4-9c9a-ae29c1c09e8a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80043,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189099/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4585172c-c0e4-57f4-9c9a-ae29c1c09e8a/4585172c-c0e4-57f4-9c9a-ae29c1c09e8a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83928,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF18AUM/699189111/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'KIA CEED 1.6 CRDI 134 1 ISG Hatchback',
'transmission': 'manual',
'trim': 'CRDI 134 1 ISG',
'vin': 'U5YHM516LJL347165',
'year': 2018}
2026-03-28 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF18%2520AUM%27 HTTP/1.1" 200 None
2026-03-28 22:06:56 [bca.uk] INFO: Saving data for LF18%20AUM: {'created_time': 1774735616.40196, 'last_price_update_time': 1774735616.401971, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LF18%2520AUM') HTTP/1.1" 204 0
2026-03-28 22:06:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023442/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CA06YTM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253766/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YJ63VCM/42809703?sv=2020-08-04&st=2026-03-28T22%3A06%3A47Z&se=2026-03-28T22%3A31%3A47Z&sr=b&sp=r&sig=N9qg9kdn8V%2FlXiT4%2BFnkQLDkgTs3TIHdpTtYI6Y8MNc%3D)
2026-03-28 22:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253779/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YJ63VCM/42809703?sv=2020-08-04&st=2026-03-28T22%3A06%3A47Z&se=2026-03-28T22%3A31%3A47Z&sr=b&sp=r&sig=N9qg9kdn8V%2FlXiT4%2BFnkQLDkgTs3TIHdpTtYI6Y8MNc%3D)
2026-03-28 22:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188904/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK67LGN/42807095?sv=2020-08-04&st=2026-03-28T22%3A06%3A47Z&se=2026-03-28T22%3A31%3A47Z&sr=b&sp=r&sig=B%2FYHzNbkypsk9Vk4GDgw38I9t41n7LDGOKEeGLzozuo%3D)
2026-03-28 22:06:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188862/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HK67LGN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5473ba6d0>
2026-03-28 22:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44030eb3-dbb1-5194-a010-c4fe60817cb4/44030eb3-dbb1-5194-a010-c4fe60817cb4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD14AUA%252F699253608%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253608/600 saved to cache
2026-03-28 22:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44030eb3-dbb1-5194-a010-c4fe60817cb4
2026-03-28 22:06:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44030eb3-dbb1-5194-a010-c4fe60817cb4, skipping ID generation
2026-03-28 22:06:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44030eb3-dbb1-5194-a010-c4fe60817cb4 sending to next pipeline
2026-03-28 22:06:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 44030eb3-dbb1-5194-a010-c4fe60817cb4, identifier: YD14%20AUA
2026-03-28 22:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188917/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK67LGN/42807095?sv=2020-08-04&st=2026-03-28T22%3A06%3A47Z&se=2026-03-28T22%3A31%3A47Z&sr=b&sp=r&sig=B%2FYHzNbkypsk9Vk4GDgw38I9t41n7LDGOKEeGLzozuo%3D)
2026-03-28 22:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188933/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK67LGN/42807095?sv=2020-08-04&st=2026-03-28T22%3A06%3A47Z&se=2026-03-28T22%3A31%3A47Z&sr=b&sp=r&sig=B%2FYHzNbkypsk9Vk4GDgw38I9t41n7LDGOKEeGLzozuo%3D)
2026-03-28 22:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023538/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA06YTM/42810893?sv=2020-08-04&st=2026-03-28T22%3A06%3A46Z&se=2026-03-28T22%3A31%3A46Z&sr=b&sp=r&sig=nyYfmAfMU%2Bgfo%2Fr0LXXhL%2Bloa6zNH%2FTmTn3vJ%2FzTyJM%3D)
2026-03-28 22:06:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 44030eb3-dbb1-5194-a010-c4fe60817cb4 with identifier: YD14%20AUA
2026-03-28 22:06:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 44030eb3-dbb1-5194-a010-c4fe60817cb4 with identifier: YD14%20AUA
2026-03-28 22:06:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 44030eb3-dbb1-5194-a010-c4fe60817cb4 with identifier: YD14%20AUA to the API
2026-03-28 22:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253608/600>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44030eb3-dbb1-5194-a010-c4fe60817cb4/44030eb3-dbb1-5194-a010-c4fe60817cb4_expert_report_file_23aa9c87-9230-4f6e-8631-d05b863910f2.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD14%20AUA-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '44030eb3-dbb1-5194-a010-c4fe60817cb4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YD14 AUA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YD14%20AUA&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'CITROEN',
'model': 'C1',
'odometer': 45210,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44030eb3-dbb1-5194-a010-c4fe60817cb4/44030eb3-dbb1-5194-a010-c4fe60817cb4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40800,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253608/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44030eb3-dbb1-5194-a010-c4fe60817cb4/44030eb3-dbb1-5194-a010-c4fe60817cb4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41261,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253616/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44030eb3-dbb1-5194-a010-c4fe60817cb4/44030eb3-dbb1-5194-a010-c4fe60817cb4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42056,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253627/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44030eb3-dbb1-5194-a010-c4fe60817cb4/44030eb3-dbb1-5194-a010-c4fe60817cb4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41249,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253636/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44030eb3-dbb1-5194-a010-c4fe60817cb4/44030eb3-dbb1-5194-a010-c4fe60817cb4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38395,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253643/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44030eb3-dbb1-5194-a010-c4fe60817cb4/44030eb3-dbb1-5194-a010-c4fe60817cb4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38542,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253652/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44030eb3-dbb1-5194-a010-c4fe60817cb4/44030eb3-dbb1-5194-a010-c4fe60817cb4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111395,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253668/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44030eb3-dbb1-5194-a010-c4fe60817cb4/44030eb3-dbb1-5194-a010-c4fe60817cb4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87684,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253686/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44030eb3-dbb1-5194-a010-c4fe60817cb4/44030eb3-dbb1-5194-a010-c4fe60817cb4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96517,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253704/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44030eb3-dbb1-5194-a010-c4fe60817cb4/44030eb3-dbb1-5194-a010-c4fe60817cb4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78924,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD14AUA/699253718/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'CITROEN C1 1.0 EDITION Hatchback',
'transmission': 'manual',
'trim': 'EDITION',
'vin': 'VF7PNCFB4DR586636',
'year': 2014}
2026-03-28 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD14%2520AUA%27 HTTP/1.1" 200 None
2026-03-28 22:06:56 [bca.uk] INFO: Saving data for YD14%20AUA: {'created_time': 1774735616.961186, 'last_price_update_time': 1774735616.961197, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YD14%2520AUA') HTTP/1.1" 204 0
2026-03-28 22:06:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474442d0>
2026-03-28 22:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b735ecb-b987-5f51-9978-b14a854ed6a5/6b735ecb-b987-5f51-9978-b14a854ed6a5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA06YTM%252F699023568%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023568/600 saved to cache
2026-03-28 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b735ecb-b987-5f51-9978-b14a854ed6a5
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5541f4d10>
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4177a308-7aae-587d-bd3e-07268dbbb6a0/4177a308-7aae-587d-bd3e-07268dbbb6a0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK67LGN%252F699188946%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188946/600 saved to cache
2026-03-28 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4177a308-7aae-587d-bd3e-07268dbbb6a0
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f88910>
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa39713-14e5-5c88-b2a8-4efb5721d2c2/bfa39713-14e5-5c88-b2a8-4efb5721d2c2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE55ACX%252F698994497%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994497/600 saved to cache
2026-03-28 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bfa39713-14e5-5c88-b2a8-4efb5721d2c2
2026-03-28 22:06:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bfa39713-14e5-5c88-b2a8-4efb5721d2c2, skipping ID generation
2026-03-28 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bfa39713-14e5-5c88-b2a8-4efb5721d2c2 sending to next pipeline
2026-03-28 22:06:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bfa39713-14e5-5c88-b2a8-4efb5721d2c2, identifier: FE55%20ACX
2026-03-28 22:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188868/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK67LGN/42807095?sv=2020-08-04&st=2026-03-28T22%3A06%3A47Z&se=2026-03-28T22%3A31%3A47Z&sr=b&sp=r&sig=B%2FYHzNbkypsk9Vk4GDgw38I9t41n7LDGOKEeGLzozuo%3D)
2026-03-28 22:06:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB15DHF/698970664/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970664>
2026-03-28 22:06:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF67XMD/699332708/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699332708>
2026-03-28 22:06:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269154/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699269154>
2026-03-28 22:06:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LL18NDU/42800227?sv=2020-08-04&st=2026-03-28T22%3A06%3A56Z&se=2026-03-28T22%3A31%3A56Z&sr=b&sp=r&sig=6s6Bfq%2FXIKre40OElhghKlOi7vb%2BBrxhEncLEvGdU4k%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LL18%20NDU-GB>
2026-03-28 22:06:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bfa39713-14e5-5c88-b2a8-4efb5721d2c2 with identifier: FE55%20ACX
2026-03-28 22:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bfa39713-14e5-5c88-b2a8-4efb5721d2c2 with identifier: FE55%20ACX
2026-03-28 22:06:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bfa39713-14e5-5c88-b2a8-4efb5721d2c2 with identifier: FE55%20ACX to the API
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994497/600>
{'auction_title': '',
'c_o_2_emission_value': 163,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa39713-14e5-5c88-b2a8-4efb5721d2c2/bfa39713-14e5-5c88-b2a8-4efb5721d2c2_expert_report_file_127c964c-bc5c-464f-b1e1-beab513a5082.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FE55%20ACX-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bfa39713-14e5-5c88-b2a8-4efb5721d2c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FE55 ACX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FE55%20ACX&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 189343,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa39713-14e5-5c88-b2a8-4efb5721d2c2/bfa39713-14e5-5c88-b2a8-4efb5721d2c2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37713,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994360/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa39713-14e5-5c88-b2a8-4efb5721d2c2/bfa39713-14e5-5c88-b2a8-4efb5721d2c2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38340,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994386/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa39713-14e5-5c88-b2a8-4efb5721d2c2/bfa39713-14e5-5c88-b2a8-4efb5721d2c2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39287,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994402/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa39713-14e5-5c88-b2a8-4efb5721d2c2/bfa39713-14e5-5c88-b2a8-4efb5721d2c2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39101,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994417/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa39713-14e5-5c88-b2a8-4efb5721d2c2/bfa39713-14e5-5c88-b2a8-4efb5721d2c2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37247,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994425/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa39713-14e5-5c88-b2a8-4efb5721d2c2/bfa39713-14e5-5c88-b2a8-4efb5721d2c2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36078,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994438/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa39713-14e5-5c88-b2a8-4efb5721d2c2/bfa39713-14e5-5c88-b2a8-4efb5721d2c2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101552,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994466/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa39713-14e5-5c88-b2a8-4efb5721d2c2/bfa39713-14e5-5c88-b2a8-4efb5721d2c2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59450,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994497/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa39713-14e5-5c88-b2a8-4efb5721d2c2/bfa39713-14e5-5c88-b2a8-4efb5721d2c2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90545,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994519/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa39713-14e5-5c88-b2a8-4efb5721d2c2/bfa39713-14e5-5c88-b2a8-4efb5721d2c2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76671,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE55ACX/698994538/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'NISSAN MICRA 1.4 SVE Hatchback',
'transmission': 'automatic',
'trim': 'SVE',
'vin': 'SJNECAK12U2095059',
'year': 2006}
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE55%2520ACX%27 HTTP/1.1" 200 None
2026-03-28 22:06:57 [bca.uk] INFO: Saving data for FE55%20ACX: {'created_time': 1774735617.601762, 'last_price_update_time': 1774735617.601774, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FE55%2520ACX') HTTP/1.1" 204 0
2026-03-28 22:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023460/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA06YTM/42810893?sv=2020-08-04&st=2026-03-28T22%3A06%3A46Z&se=2026-03-28T22%3A31%3A46Z&sr=b&sp=r&sig=nyYfmAfMU%2Bgfo%2Fr0LXXhL%2Bloa6zNH%2FTmTn3vJ%2FzTyJM%3D)
2026-03-28 22:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188886/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK67LGN/42807095?sv=2020-08-04&st=2026-03-28T22%3A06%3A47Z&se=2026-03-28T22%3A31%3A47Z&sr=b&sp=r&sig=B%2FYHzNbkypsk9Vk4GDgw38I9t41n7LDGOKEeGLzozuo%3D)
2026-03-28 22:06:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD18RFJ/698971774/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971774>
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474e1450>
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c202ec85-ff2c-5425-bb13-378c8faf73ed/c202ec85-ff2c-5425-bb13-378c8faf73ed_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYJ63VCM%252F699253766%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253766/600 saved to cache
2026-03-28 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c202ec85-ff2c-5425-bb13-378c8faf73ed
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547665a10>
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c202ec85-ff2c-5425-bb13-378c8faf73ed/c202ec85-ff2c-5425-bb13-378c8faf73ed_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYJ63VCM%252F699253779%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253779/600 saved to cache
2026-03-28 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c202ec85-ff2c-5425-bb13-378c8faf73ed
2026-03-28 22:06:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c202ec85-ff2c-5425-bb13-378c8faf73ed, skipping ID generation
2026-03-28 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c202ec85-ff2c-5425-bb13-378c8faf73ed sending to next pipeline
2026-03-28 22:06:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c202ec85-ff2c-5425-bb13-378c8faf73ed, identifier: YJ63%20VCM
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5545570d0>
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4177a308-7aae-587d-bd3e-07268dbbb6a0/4177a308-7aae-587d-bd3e-07268dbbb6a0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK67LGN%252F699188904%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188904/600 saved to cache
2026-03-28 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4177a308-7aae-587d-bd3e-07268dbbb6a0
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54778af10>
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4177a308-7aae-587d-bd3e-07268dbbb6a0/4177a308-7aae-587d-bd3e-07268dbbb6a0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK67LGN%252F699188917%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188917/600 saved to cache
2026-03-28 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4177a308-7aae-587d-bd3e-07268dbbb6a0
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a8a490>
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4177a308-7aae-587d-bd3e-07268dbbb6a0/4177a308-7aae-587d-bd3e-07268dbbb6a0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK67LGN%252F699188933%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188933/600 saved to cache
2026-03-28 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4177a308-7aae-587d-bd3e-07268dbbb6a0
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55431b310>
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b735ecb-b987-5f51-9978-b14a854ed6a5/6b735ecb-b987-5f51-9978-b14a854ed6a5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA06YTM%252F699023538%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023538/600 saved to cache
2026-03-28 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b735ecb-b987-5f51-9978-b14a854ed6a5
2026-03-28 22:06:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c202ec85-ff2c-5425-bb13-378c8faf73ed with identifier: YJ63%20VCM
2026-03-28 22:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c202ec85-ff2c-5425-bb13-378c8faf73ed with identifier: YJ63%20VCM
2026-03-28 22:06:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c202ec85-ff2c-5425-bb13-378c8faf73ed with identifier: YJ63%20VCM to the API
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253779/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c202ec85-ff2c-5425-bb13-378c8faf73ed/c202ec85-ff2c-5425-bb13-378c8faf73ed_expert_report_file_5966b3de-4dad-4423-9806-ba274329c3cd.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YJ63%20VCM-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c202ec85-ff2c-5425-bb13-378c8faf73ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YJ63 VCM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YJ63%20VCM&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'ZAFIRA TOURER',
'odometer': 44510,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c202ec85-ff2c-5425-bb13-378c8faf73ed/c202ec85-ff2c-5425-bb13-378c8faf73ed_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39862,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253766/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c202ec85-ff2c-5425-bb13-378c8faf73ed/c202ec85-ff2c-5425-bb13-378c8faf73ed_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39572,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253773/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c202ec85-ff2c-5425-bb13-378c8faf73ed/c202ec85-ff2c-5425-bb13-378c8faf73ed_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39328,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253779/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c202ec85-ff2c-5425-bb13-378c8faf73ed/c202ec85-ff2c-5425-bb13-378c8faf73ed_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39658,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253788/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c202ec85-ff2c-5425-bb13-378c8faf73ed/c202ec85-ff2c-5425-bb13-378c8faf73ed_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37499,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253797/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c202ec85-ff2c-5425-bb13-378c8faf73ed/c202ec85-ff2c-5425-bb13-378c8faf73ed_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35215,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253804/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c202ec85-ff2c-5425-bb13-378c8faf73ed/c202ec85-ff2c-5425-bb13-378c8faf73ed_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102085,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253823/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c202ec85-ff2c-5425-bb13-378c8faf73ed/c202ec85-ff2c-5425-bb13-378c8faf73ed_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84532,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253844/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c202ec85-ff2c-5425-bb13-378c8faf73ed/c202ec85-ff2c-5425-bb13-378c8faf73ed_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92073,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253857/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c202ec85-ff2c-5425-bb13-378c8faf73ed/c202ec85-ff2c-5425-bb13-378c8faf73ed_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94715,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YJ63VCM/699253873/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VAUXHALL ZAFIRA TOURER 2.0 CDTI 165 SRI MPV',
'transmission': 'manual',
'trim': 'CDTI 165 SRI',
'vin': 'W0LPD9EN0E2004863',
'year': 2013}
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ63%2520VCM%27 HTTP/1.1" 200 None
2026-03-28 22:06:58 [bca.uk] INFO: Saving data for YJ63%20VCM: {'created_time': 1774735618.324146, 'last_price_update_time': 1774735618.324157, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YJ63%2520VCM') HTTP/1.1" 204 0
2026-03-28 22:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188862/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK67LGN/42807095?sv=2020-08-04&st=2026-03-28T22%3A06%3A47Z&se=2026-03-28T22%3A31%3A47Z&sr=b&sp=r&sig=B%2FYHzNbkypsk9Vk4GDgw38I9t41n7LDGOKEeGLzozuo%3D)
2026-03-28 22:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023442/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CA06YTM/42810893?sv=2020-08-04&st=2026-03-28T22%3A06%3A46Z&se=2026-03-28T22%3A31%3A46Z&sr=b&sp=r&sig=nyYfmAfMU%2Bgfo%2Fr0LXXhL%2Bloa6zNH%2FTmTn3vJ%2FzTyJM%3D)
2026-03-28 22:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB15DHF/698970643/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970643>
2026-03-28 22:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD17FAM/699285742/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285742>
2026-03-28 22:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ67HWW/698994593/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994593>
2026-03-28 22:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554302310>
2026-03-28 22:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4177a308-7aae-587d-bd3e-07268dbbb6a0/4177a308-7aae-587d-bd3e-07268dbbb6a0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK67LGN%252F699188868%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188868/600 saved to cache
2026-03-28 22:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4177a308-7aae-587d-bd3e-07268dbbb6a0
2026-03-28 22:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF67XMD/699332698/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699332698>
2026-03-28 22:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269147/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699269147>
2026-03-28 22:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX14XNH/42810919?sv=2020-08-04&st=2026-03-28T22%3A06%3A58Z&se=2026-03-28T22%3A31%3A58Z&sr=b&sp=r&sig=dVRR3q4L8ZyEt7o5biyfc4sTJUvvOlQj3AbiPtREwnE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LX14%20XNH-GB>
2026-03-28 22:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe556f866d0>
2026-03-28 22:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b735ecb-b987-5f51-9978-b14a854ed6a5/6b735ecb-b987-5f51-9978-b14a854ed6a5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA06YTM%252F699023460%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023460/600 saved to cache
2026-03-28 22:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b735ecb-b987-5f51-9978-b14a854ed6a5
2026-03-28 22:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a96690>
2026-03-28 22:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4177a308-7aae-587d-bd3e-07268dbbb6a0/4177a308-7aae-587d-bd3e-07268dbbb6a0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK67LGN%252F699188886%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188886/600 saved to cache
2026-03-28 22:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4177a308-7aae-587d-bd3e-07268dbbb6a0
2026-03-28 22:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269154/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND05TWY/42810553?sv=2020-08-04&st=2026-03-28T22%3A05%3A04Z&se=2026-03-28T22%3A30%3A04Z&sr=b&sp=r&sig=BZ8%2B%2FUFxkJjjZzPfJFab4MBTncPmbBPd%2BnKXlbO2wps%3D)
2026-03-28 22:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD18RFJ/698971760/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971760>
2026-03-28 22:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547397790>
2026-03-28 22:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4177a308-7aae-587d-bd3e-07268dbbb6a0/4177a308-7aae-587d-bd3e-07268dbbb6a0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK67LGN%252F699188862%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188862/600 saved to cache
2026-03-28 22:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4177a308-7aae-587d-bd3e-07268dbbb6a0
2026-03-28 22:06:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4177a308-7aae-587d-bd3e-07268dbbb6a0, skipping ID generation
2026-03-28 22:06:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4177a308-7aae-587d-bd3e-07268dbbb6a0 sending to next pipeline
2026-03-28 22:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4177a308-7aae-587d-bd3e-07268dbbb6a0, identifier: HK67%20LGN
2026-03-28 22:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54718d310>
2026-03-28 22:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b735ecb-b987-5f51-9978-b14a854ed6a5/6b735ecb-b987-5f51-9978-b14a854ed6a5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCA06YTM%252F699023442%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023442/600 saved to cache
2026-03-28 22:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b735ecb-b987-5f51-9978-b14a854ed6a5
2026-03-28 22:06:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b735ecb-b987-5f51-9978-b14a854ed6a5, skipping ID generation
2026-03-28 22:06:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b735ecb-b987-5f51-9978-b14a854ed6a5 sending to next pipeline
2026-03-28 22:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6b735ecb-b987-5f51-9978-b14a854ed6a5, identifier: CA06%20YTM
2026-03-28 22:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4177a308-7aae-587d-bd3e-07268dbbb6a0 with identifier: HK67%20LGN
2026-03-28 22:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4177a308-7aae-587d-bd3e-07268dbbb6a0 with identifier: HK67%20LGN
2026-03-28 22:06:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4177a308-7aae-587d-bd3e-07268dbbb6a0 with identifier: HK67%20LGN to the API
2026-03-28 22:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188862/600>
{'auction_title': '',
'c_o_2_emission_value': 111,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4177a308-7aae-587d-bd3e-07268dbbb6a0/4177a308-7aae-587d-bd3e-07268dbbb6a0_expert_report_file_b31a998f-0064-4f0a-af92-5a8f3b5b2d76.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK67%20LGN-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4177a308-7aae-587d-bd3e-07268dbbb6a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HK67 LGN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HK67%20LGN&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'MINI',
'model': 'COOPER',
'odometer': 58376,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4177a308-7aae-587d-bd3e-07268dbbb6a0/4177a308-7aae-587d-bd3e-07268dbbb6a0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42647,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188862/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4177a308-7aae-587d-bd3e-07268dbbb6a0/4177a308-7aae-587d-bd3e-07268dbbb6a0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41180,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188868/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4177a308-7aae-587d-bd3e-07268dbbb6a0/4177a308-7aae-587d-bd3e-07268dbbb6a0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37768,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188878/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4177a308-7aae-587d-bd3e-07268dbbb6a0/4177a308-7aae-587d-bd3e-07268dbbb6a0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39251,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188886/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4177a308-7aae-587d-bd3e-07268dbbb6a0/4177a308-7aae-587d-bd3e-07268dbbb6a0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37706,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188897/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4177a308-7aae-587d-bd3e-07268dbbb6a0/4177a308-7aae-587d-bd3e-07268dbbb6a0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36055,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188904/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4177a308-7aae-587d-bd3e-07268dbbb6a0/4177a308-7aae-587d-bd3e-07268dbbb6a0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96420,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188917/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4177a308-7aae-587d-bd3e-07268dbbb6a0/4177a308-7aae-587d-bd3e-07268dbbb6a0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70439,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188933/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4177a308-7aae-587d-bd3e-07268dbbb6a0/4177a308-7aae-587d-bd3e-07268dbbb6a0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82604,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188946/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4177a308-7aae-587d-bd3e-07268dbbb6a0/4177a308-7aae-587d-bd3e-07268dbbb6a0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89880,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK67LGN/699188963/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MINI COOPER 1.5 136 SEVEN Hatchback',
'transmission': 'manual',
'trim': '136 SEVEN',
'vin': 'WMWXS520702G54307',
'year': 2018}
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK67%2520LGN%27 HTTP/1.1" 200 None
2026-03-28 22:06:59 [bca.uk] INFO: Saving data for HK67%20LGN: {'created_time': 1774735619.176108, 'last_price_update_time': 1774735619.176121, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HK67%2520LGN') HTTP/1.1" 204 0
2026-03-28 22:06:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6b735ecb-b987-5f51-9978-b14a854ed6a5 with identifier: CA06%20YTM
2026-03-28 22:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6b735ecb-b987-5f51-9978-b14a854ed6a5 with identifier: CA06%20YTM
2026-03-28 22:06:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6b735ecb-b987-5f51-9978-b14a854ed6a5 with identifier: CA06%20YTM to the API
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:06:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023442/600>
{'auction_title': '',
'c_o_2_emission_value': 160,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b735ecb-b987-5f51-9978-b14a854ed6a5/6b735ecb-b987-5f51-9978-b14a854ed6a5_expert_report_file_1d285c6d-4ec1-4a7d-ab79-16b540e5520f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CA06%20YTM-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6b735ecb-b987-5f51-9978-b14a854ed6a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CA06 YTM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CA06%20YTM&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'NISSAN',
'model': 'MICRA C+C',
'odometer': 134246,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b735ecb-b987-5f51-9978-b14a854ed6a5/6b735ecb-b987-5f51-9978-b14a854ed6a5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40865,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023442/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b735ecb-b987-5f51-9978-b14a854ed6a5/6b735ecb-b987-5f51-9978-b14a854ed6a5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41358,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023460/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b735ecb-b987-5f51-9978-b14a854ed6a5/6b735ecb-b987-5f51-9978-b14a854ed6a5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38587,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023471/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b735ecb-b987-5f51-9978-b14a854ed6a5/6b735ecb-b987-5f51-9978-b14a854ed6a5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38775,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023481/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b735ecb-b987-5f51-9978-b14a854ed6a5/6b735ecb-b987-5f51-9978-b14a854ed6a5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36893,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023492/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b735ecb-b987-5f51-9978-b14a854ed6a5/6b735ecb-b987-5f51-9978-b14a854ed6a5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36184,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023496/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b735ecb-b987-5f51-9978-b14a854ed6a5/6b735ecb-b987-5f51-9978-b14a854ed6a5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100038,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023517/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b735ecb-b987-5f51-9978-b14a854ed6a5/6b735ecb-b987-5f51-9978-b14a854ed6a5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72507,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023538/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b735ecb-b987-5f51-9978-b14a854ed6a5/6b735ecb-b987-5f51-9978-b14a854ed6a5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89261,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023568/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b735ecb-b987-5f51-9978-b14a854ed6a5/6b735ecb-b987-5f51-9978-b14a854ed6a5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75990,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CA06YTM/699023596/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'NISSAN MICRA C+C 1.6 SPORT Convertible',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'SJN2EAK12U6016202',
'year': 2006}
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA06%2520YTM%27 HTTP/1.1" 200 None
2026-03-28 22:06:59 [bca.uk] INFO: Saving data for CA06%20YTM: {'created_time': 1774735619.556494, 'last_price_update_time': 1774735619.556504, 'auction_closing_time': 1774778400.0}
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CA06%2520YTM') HTTP/1.1" 204 0
2026-03-28 22:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB15DHF/698970664/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB15DHF/42810688?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=z80RjqPqkscTGhJimgx1YcejekegApPhOp4js7HWGmI%3D)
2026-03-28 22:06:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ67HWW/698994569/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994569>
2026-03-28 22:06:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD17FAM/699285726/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285726>
2026-03-28 22:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD18RFJ/698971774/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD18RFJ/42810641?sv=2020-08-04&st=2026-03-28T22%3A05%3A04Z&se=2026-03-28T22%3A30%3A04Z&sr=b&sp=r&sig=OeX5io3h9yL0VeL9tAHDCwF2HomNIHfIARYDa4NdS30%3D)
2026-03-28 22:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF67XMD/699332708/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF67XMD/42810564?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=DCaGeHL1U5FPXugPOzoPJN1lnR3ggJ%2BFYs5kRo3pbmM%3D)
2026-03-28 22:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LL18NDU/42800227?sv=2020-08-04&st=2026-03-28T22%3A06%3A56Z&se=2026-03-28T22%3A31%3A56Z&sr=b&sp=r&sig=6s6Bfq%2FXIKre40OElhghKlOi7vb%2BBrxhEncLEvGdU4k%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD17FAM/699285742/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD17FAM/42810230?sv=2020-08-04&st=2026-03-28T22%3A05%3A03Z&se=2026-03-28T22%3A30%3A03Z&sr=b&sp=r&sig=%2FfBqToERqV4%2B1yskCr4WrQIIYBY5obdbLLah9TxlYo4%3D)
2026-03-28 22:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ67HWW/698994593/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ67HWW/42810839?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=bCH4BiUF13obmrAOV4AiGB4NLH07S%2Bo99SNbSt0wxEM%3D)
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54778f510>
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7d66be-49b7-5d86-a859-5c899ed35afc/8f7d66be-49b7-5d86-a859-5c899ed35afc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND05TWY%252F699269154%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269154/600 saved to cache
2026-03-28 22:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f7d66be-49b7-5d86-a859-5c899ed35afc
2026-03-28 22:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB15DHF/698970643/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB15DHF/42810688?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=z80RjqPqkscTGhJimgx1YcejekegApPhOp4js7HWGmI%3D)
2026-03-28 22:06:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB15DHF/698970627/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970627>
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54778f150>
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d/d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB15DHF%252F698970664%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB15DHF/698970664/600 saved to cache
2026-03-28 22:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547391b50>
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ba24d3-8587-5eee-9f39-5a8e165a6cdc/f0ba24d3-8587-5eee-9f39-5a8e165a6cdc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD18RFJ%252F698971774%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD18RFJ/698971774/600 saved to cache
2026-03-28 22:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f0ba24d3-8587-5eee-9f39-5a8e165a6cdc
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554faa450>
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73245291-7014-5e92-9739-b929afc3bb3a/73245291-7014-5e92-9739-b929afc3bb3a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF67XMD%252F699332708%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF67XMD/699332708/600 saved to cache
2026-03-28 22:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 73245291-7014-5e92-9739-b929afc3bb3a
2026-03-28 22:06:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF67XMD/699332691/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699332691>
2026-03-28 22:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269147/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND05TWY/42810553?sv=2020-08-04&st=2026-03-28T22%3A05%3A04Z&se=2026-03-28T22%3A30%3A04Z&sr=b&sp=r&sig=BZ8%2B%2FUFxkJjjZzPfJFab4MBTncPmbBPd%2BnKXlbO2wps%3D)
2026-03-28 22:06:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269141/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699269141>
2026-03-28 22:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD18RFJ/698971760/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD18RFJ/42810641?sv=2020-08-04&st=2026-03-28T22%3A05%3A04Z&se=2026-03-28T22%3A30%3A04Z&sr=b&sp=r&sig=OeX5io3h9yL0VeL9tAHDCwF2HomNIHfIARYDa4NdS30%3D)
2026-03-28 22:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF67XMD/699332698/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF67XMD/42810564?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=DCaGeHL1U5FPXugPOzoPJN1lnR3ggJ%2BFYs5kRo3pbmM%3D)
2026-03-28 22:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX14XNH/42810919?sv=2020-08-04&st=2026-03-28T22%3A06%3A58Z&se=2026-03-28T22%3A31%3A58Z&sr=b&sp=r&sig=dVRR3q4L8ZyEt7o5biyfc4sTJUvvOlQj3AbiPtREwnE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544e1e90>
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e575391d-6903-5001-a072-5ddc281ffe3b/e575391d-6903-5001-a072-5ddc281ffe3b_expert_report_file_2371e398-b69a-4d30-b358-5398323c78fe.pdf HTTP/1.1" 201 0
2026-03-28 22:06:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e575391d-6903-5001-a072-5ddc281ffe3b
2026-03-28 22:06:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e575391d-6903-5001-a072-5ddc281ffe3b, skipping ID generation
2026-03-28 22:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e575391d-6903-5001-a072-5ddc281ffe3b
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLL18NDU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LL18NDU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554faa890>
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4494bc-d302-5d25-af44-49f73fc6f3e8/3b4494bc-d302-5d25-af44-49f73fc6f3e8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD17FAM%252F699285742%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD17FAM/699285742/600 saved to cache
2026-03-28 22:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b4494bc-d302-5d25-af44-49f73fc6f3e8
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55485a810>
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e220b51-e3aa-5dfc-97bc-648f804c494e/2e220b51-e3aa-5dfc-97bc-648f804c494e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ67HWW%252F698994593%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ67HWW/698994593/600 saved to cache
2026-03-28 22:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2e220b51-e3aa-5dfc-97bc-648f804c494e
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:06:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554318c10>
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d/d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB15DHF%252F698970643%252F600') HTTP/1.1" 204 0
2026-03-28 22:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB15DHF/698970643/600 saved to cache
2026-03-28 22:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d
2026-03-28 22:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD17FAM/699285726/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD17FAM/42810230?sv=2020-08-04&st=2026-03-28T22%3A05%3A03Z&se=2026-03-28T22%3A30%3A03Z&sr=b&sp=r&sig=%2FfBqToERqV4%2B1yskCr4WrQIIYBY5obdbLLah9TxlYo4%3D)
2026-03-28 22:06:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF67XMD/699332686/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699332686>
2026-03-28 22:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG67KMM/42808144?sv=2020-08-04&st=2026-03-28T22%3A06%3A59Z&se=2026-03-28T22%3A31%3A59Z&sr=b&sp=r&sig=dm68FyiEYzqcmz8iVlgtitpLa0XkBI%2FR5NGluMyXUn8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BG67%20KMM-GB>
2026-03-28 22:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ67HWW/698994546/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994546>
2026-03-28 22:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB15DHF/698970605/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970605>
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189065%27 HTTP/1.1" 200 None
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189065 not downloaded yet
2026-03-28 22:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ67HWW/698994569/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ67HWW/42810839?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=bCH4BiUF13obmrAOV4AiGB4NLH07S%2Bo99SNbSt0wxEM%3D)
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189071%27 HTTP/1.1" 200 None
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189071 not downloaded yet
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55428de50>
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7d66be-49b7-5d86-a859-5c899ed35afc/8f7d66be-49b7-5d86-a859-5c899ed35afc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND05TWY%252F699269147%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269147/600 saved to cache
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f7d66be-49b7-5d86-a859-5c899ed35afc
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544c92d0>
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ba24d3-8587-5eee-9f39-5a8e165a6cdc/f0ba24d3-8587-5eee-9f39-5a8e165a6cdc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD18RFJ%252F698971760%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD18RFJ/698971760/600 saved to cache
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f0ba24d3-8587-5eee-9f39-5a8e165a6cdc
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5476000d0>
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73245291-7014-5e92-9739-b929afc3bb3a/73245291-7014-5e92-9739-b929afc3bb3a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF67XMD%252F699332698%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF67XMD/699332698/600 saved to cache
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 73245291-7014-5e92-9739-b929afc3bb3a
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe555031290>
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d59c8c01-c6be-586f-86c9-6eb3a7686cc2/d59c8c01-c6be-586f-86c9-6eb3a7686cc2_expert_report_file_bb554f6f-ae5e-4c97-9cba-bc7d9ae17a80.pdf HTTP/1.1" 201 0
2026-03-28 22:07:00 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d59c8c01-c6be-586f-86c9-6eb3a7686cc2
2026-03-28 22:07:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d59c8c01-c6be-586f-86c9-6eb3a7686cc2, skipping ID generation
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d59c8c01-c6be-586f-86c9-6eb3a7686cc2
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLX14XNH-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LX14XNH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189077%27 HTTP/1.1" 200 None
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189077 not downloaded yet
2026-03-28 22:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269132/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699269132>
2026-03-28 22:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269141/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND05TWY/42810553?sv=2020-08-04&st=2026-03-28T22%3A05%3A04Z&se=2026-03-28T22%3A30%3A04Z&sr=b&sp=r&sig=BZ8%2B%2FUFxkJjjZzPfJFab4MBTncPmbBPd%2BnKXlbO2wps%3D)
2026-03-28 22:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF67XMD/699332691/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF67XMD/42810564?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=DCaGeHL1U5FPXugPOzoPJN1lnR3ggJ%2BFYs5kRo3pbmM%3D)
2026-03-28 22:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN09WAJ/42810692?sv=2020-08-04&st=2026-03-28T22%3A07%3A00Z&se=2026-03-28T22%3A32%3A00Z&sr=b&sp=r&sig=0y6PGcJo%2BaTuvoIQnL%2Bb4N76imGpiuahl3912b2j6a8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LN09%20WAJ-GB>
2026-03-28 22:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM68WZP/42810548?sv=2020-08-04&st=2026-03-28T22%3A07%3A00Z&se=2026-03-28T22%3A32%3A00Z&sr=b&sp=r&sig=r7GasWOrtr48CttU%2B7GMwf9%2FLcSoZKm1VXUj0wdFOzw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM68%20WZP-GB>
2026-03-28 22:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD18RFJ/698971729/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698971729>
2026-03-28 22:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX15ZPR/699330938/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699330938>
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011529%27 HTTP/1.1" 200 None
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011529 not downloaded yet
2026-03-28 22:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB15DHF/698970627/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB15DHF/42810688?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=z80RjqPqkscTGhJimgx1YcejekegApPhOp4js7HWGmI%3D)
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189082%27 HTTP/1.1" 200 None
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189082 not downloaded yet
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011542%27 HTTP/1.1" 200 None
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011542 not downloaded yet
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189089%27 HTTP/1.1" 200 None
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189089 not downloaded yet
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55497a750>
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4494bc-d302-5d25-af44-49f73fc6f3e8/3b4494bc-d302-5d25-af44-49f73fc6f3e8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD17FAM%252F699285726%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD17FAM/699285726/600 saved to cache
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b4494bc-d302-5d25-af44-49f73fc6f3e8
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe557f9ae50>
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e220b51-e3aa-5dfc-97bc-648f804c494e/2e220b51-e3aa-5dfc-97bc-648f804c494e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ67HWW%252F698994569%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ67HWW/698994569/600 saved to cache
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2e220b51-e3aa-5dfc-97bc-648f804c494e
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011552%27 HTTP/1.1" 200 None
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011552 not downloaded yet
2026-03-28 22:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB15DHF/698970605/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB15DHF/42810688?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=z80RjqPqkscTGhJimgx1YcejekegApPhOp4js7HWGmI%3D)
2026-03-28 22:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ67HWW/698994546/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ67HWW/42810839?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=bCH4BiUF13obmrAOV4AiGB4NLH07S%2Bo99SNbSt0wxEM%3D)
2026-03-28 22:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ67HWW/698994531/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994531>
2026-03-28 22:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD17FAM/699285703/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285703>
2026-03-28 22:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189056/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LL18NDU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB15DHF/698970590/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970590>
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189102%27 HTTP/1.1" 200 None
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189102 not downloaded yet
2026-03-28 22:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF67XMD/699332686/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF67XMD/42810564?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=DCaGeHL1U5FPXugPOzoPJN1lnR3ggJ%2BFYs5kRo3pbmM%3D)
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011560%27 HTTP/1.1" 200 None
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011560 not downloaded yet
2026-03-28 22:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG67KMM/42808144?sv=2020-08-04&st=2026-03-28T22%3A06%3A59Z&se=2026-03-28T22%3A31%3A59Z&sr=b&sp=r&sig=dm68FyiEYzqcmz8iVlgtitpLa0XkBI%2FR5NGluMyXUn8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189114%27 HTTP/1.1" 200 None
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189114 not downloaded yet
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011572%27 HTTP/1.1" 200 None
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011572 not downloaded yet
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471c0fd0>
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7d66be-49b7-5d86-a859-5c899ed35afc/8f7d66be-49b7-5d86-a859-5c899ed35afc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND05TWY%252F699269141%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269141/600 saved to cache
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f7d66be-49b7-5d86-a859-5c899ed35afc
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55428c1d0>
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73245291-7014-5e92-9739-b929afc3bb3a/73245291-7014-5e92-9739-b929afc3bb3a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF67XMD%252F699332691%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF67XMD/699332691/600 saved to cache
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73245291-7014-5e92-9739-b929afc3bb3a
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547478390>
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d/d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB15DHF%252F698970627%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB15DHF/698970627/600 saved to cache
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d
2026-03-28 22:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269132/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND05TWY/42810553?sv=2020-08-04&st=2026-03-28T22%3A05%3A04Z&se=2026-03-28T22%3A30%3A04Z&sr=b&sp=r&sig=BZ8%2B%2FUFxkJjjZzPfJFab4MBTncPmbBPd%2BnKXlbO2wps%3D)
2026-03-28 22:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX15ZPR/699330938/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX15ZPR/42810594?sv=2020-08-04&st=2026-03-28T22%3A05%3A03Z&se=2026-03-28T22%3A30%3A03Z&sr=b&sp=r&sig=4Xkg21iEljq20iTBfMl%2BtSswF985h8gnTDKxLA91BF8%3D)
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189130%27 HTTP/1.1" 200 None
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189130 not downloaded yet
2026-03-28 22:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD18RFJ/698971729/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD18RFJ/42810641?sv=2020-08-04&st=2026-03-28T22%3A05%3A04Z&se=2026-03-28T22%3A30%3A04Z&sr=b&sp=r&sig=OeX5io3h9yL0VeL9tAHDCwF2HomNIHfIARYDa4NdS30%3D)
2026-03-28 22:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011519/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LX14XNH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189071/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189071>
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011587%27 HTTP/1.1" 200 None
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011587 not downloaded yet
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189147%27 HTTP/1.1" 200 None
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189147 not downloaded yet
2026-03-28 22:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM68WZP/42810548?sv=2020-08-04&st=2026-03-28T22%3A07%3A00Z&se=2026-03-28T22%3A32%3A00Z&sr=b&sp=r&sig=r7GasWOrtr48CttU%2B7GMwf9%2FLcSoZKm1VXUj0wdFOzw%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011598%27 HTTP/1.1" 200 None
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011598 not downloaded yet
2026-03-28 22:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN09WAJ/42810692?sv=2020-08-04&st=2026-03-28T22%3A07%3A00Z&se=2026-03-28T22%3A32%3A00Z&sr=b&sp=r&sig=0y6PGcJo%2BaTuvoIQnL%2Bb4N76imGpiuahl3912b2j6a8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 22:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189077/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189077>
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471b3b50>
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d/d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB15DHF%252F698970605%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB15DHF/698970605/600 saved to cache
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b59710>
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e220b51-e3aa-5dfc-97bc-648f804c494e/2e220b51-e3aa-5dfc-97bc-648f804c494e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ67HWW%252F698994546%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ67HWW/698994546/600 saved to cache
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2e220b51-e3aa-5dfc-97bc-648f804c494e
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5474522d0>
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73245291-7014-5e92-9739-b929afc3bb3a/73245291-7014-5e92-9739-b929afc3bb3a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF67XMD%252F699332686%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF67XMD/699332686/600 saved to cache
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73245291-7014-5e92-9739-b929afc3bb3a
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54727abd0>
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74260dc8-62a0-531b-ba8b-8bfc34fc2e08/74260dc8-62a0-531b-ba8b-8bfc34fc2e08_expert_report_file_c5049739-b845-49ad-8a65-5c855b47b23e.pdf HTTP/1.1" 201 0
2026-03-28 22:07:00 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 74260dc8-62a0-531b-ba8b-8bfc34fc2e08
2026-03-28 22:07:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74260dc8-62a0-531b-ba8b-8bfc34fc2e08, skipping ID generation
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 74260dc8-62a0-531b-ba8b-8bfc34fc2e08
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBG67KMM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BG67KMM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189056/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LL18NDU/42800227?sv=2020-08-04&st=2026-03-28T22%3A06%3A56Z&se=2026-03-28T22%3A31%3A56Z&sr=b&sp=r&sig=6s6Bfq%2FXIKre40OElhghKlOi7vb%2BBrxhEncLEvGdU4k%3D)
2026-03-28 22:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD17FAM/699285703/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD17FAM/42810230?sv=2020-08-04&st=2026-03-28T22%3A05%3A03Z&se=2026-03-28T22%3A30%3A03Z&sr=b&sp=r&sig=%2FfBqToERqV4%2B1yskCr4WrQIIYBY5obdbLLah9TxlYo4%3D)
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011609%27 HTTP/1.1" 200 None
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011609 not downloaded yet
2026-03-28 22:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB15DHF/698970590/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB15DHF/42810688?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=z80RjqPqkscTGhJimgx1YcejekegApPhOp4js7HWGmI%3D)
2026-03-28 22:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ67HWW/698994531/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ67HWW/42810839?sv=2020-08-04&st=2026-03-28T22%3A05%3A02Z&se=2026-03-28T22%3A30%3A02Z&sr=b&sp=r&sig=bCH4BiUF13obmrAOV4AiGB4NLH07S%2Bo99SNbSt0wxEM%3D)
2026-03-28 22:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189089/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189089>
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208236%27 HTTP/1.1" 200 None
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208236 not downloaded yet
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699011616%27 HTTP/1.1" 200 None
2026-03-28 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011616 not downloaded yet
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554ae1ad0>
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7d66be-49b7-5d86-a859-5c899ed35afc/8f7d66be-49b7-5d86-a859-5c899ed35afc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND05TWY%252F699269132%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269132/600 saved to cache
2026-03-28 22:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f7d66be-49b7-5d86-a859-5c899ed35afc
2026-03-28 22:07:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f7d66be-49b7-5d86-a859-5c899ed35afc, skipping ID generation
2026-03-28 22:07:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f7d66be-49b7-5d86-a859-5c899ed35afc sending to next pipeline
2026-03-28 22:07:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8f7d66be-49b7-5d86-a859-5c899ed35afc, identifier: ND05%20TWY
2026-03-28 22:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471b3790>
2026-03-28 22:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_867b722d-9875-5e9c-b6b5-4614e36a0cad/867b722d-9875-5e9c-b6b5-4614e36a0cad_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPX15ZPR%252F699330938%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX15ZPR/699330938/600 saved to cache
2026-03-28 22:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 867b722d-9875-5e9c-b6b5-4614e36a0cad
2026-03-28 22:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547453ed0>
2026-03-28 22:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ba24d3-8587-5eee-9f39-5a8e165a6cdc/f0ba24d3-8587-5eee-9f39-5a8e165a6cdc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD18RFJ%252F698971729%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD18RFJ/698971729/600 saved to cache
2026-03-28 22:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f0ba24d3-8587-5eee-9f39-5a8e165a6cdc
2026-03-28 22:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554859090>
2026-03-28 22:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54b4bf4-6a42-5bbf-9d35-a64946d22272/d54b4bf4-6a42-5bbf-9d35-a64946d22272_expert_report_file_96388d2d-7750-48bc-8fad-c4412c7fa441.pdf HTTP/1.1" 201 0
2026-03-28 22:07:01 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d54b4bf4-6a42-5bbf-9d35-a64946d22272
2026-03-28 22:07:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d54b4bf4-6a42-5bbf-9d35-a64946d22272, skipping ID generation
2026-03-28 22:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d54b4bf4-6a42-5bbf-9d35-a64946d22272
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKM68WZP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KM68WZP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5476e6210>
2026-03-28 22:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6de2403-2697-5487-84b5-a97e5182e1b7/f6de2403-2697-5487-84b5-a97e5182e1b7_expert_report_file_5e75b3eb-acd4-471c-9d92-3b465d7e8df5.pdf HTTP/1.1" 201 0
2026-03-28 22:07:01 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f6de2403-2697-5487-84b5-a97e5182e1b7
2026-03-28 22:07:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6de2403-2697-5487-84b5-a97e5182e1b7, skipping ID generation
2026-03-28 22:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f6de2403-2697-5487-84b5-a97e5182e1b7
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLN09WAJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 22:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LN09WAJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208244%27 HTTP/1.1" 200 None
2026-03-28 22:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208244 not downloaded yet
2026-03-28 22:07:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8f7d66be-49b7-5d86-a859-5c899ed35afc with identifier: ND05%20TWY
2026-03-28 22:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8f7d66be-49b7-5d86-a859-5c899ed35afc with identifier: ND05%20TWY
2026-03-28 22:07:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8f7d66be-49b7-5d86-a859-5c899ed35afc with identifier: ND05%20TWY to the API
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:07:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269132/600>
{'auction_title': '',
'c_o_2_emission_value': 190,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7d66be-49b7-5d86-a859-5c899ed35afc/8f7d66be-49b7-5d86-a859-5c899ed35afc_expert_report_file_3fb740ea-e925-4813-a782-838a67d1c62c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND05%20TWY-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8f7d66be-49b7-5d86-a859-5c899ed35afc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ND05 TWY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ND05%20TWY&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'NISSAN',
'model': 'X-TRAIL',
'odometer': 43406,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7d66be-49b7-5d86-a859-5c899ed35afc/8f7d66be-49b7-5d86-a859-5c899ed35afc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43168,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269119/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7d66be-49b7-5d86-a859-5c899ed35afc/8f7d66be-49b7-5d86-a859-5c899ed35afc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40078,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269132/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7d66be-49b7-5d86-a859-5c899ed35afc/8f7d66be-49b7-5d86-a859-5c899ed35afc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38885,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269141/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7d66be-49b7-5d86-a859-5c899ed35afc/8f7d66be-49b7-5d86-a859-5c899ed35afc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39491,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269147/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7d66be-49b7-5d86-a859-5c899ed35afc/8f7d66be-49b7-5d86-a859-5c899ed35afc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36095,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269154/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7d66be-49b7-5d86-a859-5c899ed35afc/8f7d66be-49b7-5d86-a859-5c899ed35afc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35835,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269162/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7d66be-49b7-5d86-a859-5c899ed35afc/8f7d66be-49b7-5d86-a859-5c899ed35afc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107853,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269173/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7d66be-49b7-5d86-a859-5c899ed35afc/8f7d66be-49b7-5d86-a859-5c899ed35afc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83860,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269192/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7d66be-49b7-5d86-a859-5c899ed35afc/8f7d66be-49b7-5d86-a859-5c899ed35afc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92520,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269219/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7d66be-49b7-5d86-a859-5c899ed35afc/8f7d66be-49b7-5d86-a859-5c899ed35afc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82944,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND05TWY/699269246/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'NISSAN X-TRAIL 2.2 DCI 136 SPORT StationWagon',
'transmission': 'manual',
'trim': 'DCI 136 SPORT',
'vin': 'JN1TENT30U0209266',
'year': 2005}
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND05%2520TWY%27 HTTP/1.1" 200 None
2026-03-28 22:07:01 [bca.uk] INFO: Saving data for ND05%20TWY: {'created_time': 1774735621.945499, 'last_price_update_time': 1774735621.945513, 'auction_closing_time': 1774778400.0}
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ND05%2520TWY') HTTP/1.1" 204 0
2026-03-28 22:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011542/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011542>
2026-03-28 22:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011560/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011560>
2026-03-28 22:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011552/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011552>
2026-03-28 22:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011519/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX14XNH/42810919?sv=2020-08-04&st=2026-03-28T22%3A06%3A58Z&se=2026-03-28T22%3A31%3A58Z&sr=b&sp=r&sig=dVRR3q4L8ZyEt7o5biyfc4sTJUvvOlQj3AbiPtREwnE%3D)
2026-03-28 22:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189071/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LL18NDU/42800227?sv=2020-08-04&st=2026-03-28T22%3A06%3A56Z&se=2026-03-28T22%3A31%3A56Z&sr=b&sp=r&sig=6s6Bfq%2FXIKre40OElhghKlOi7vb%2BBrxhEncLEvGdU4k%3D)
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981043%27 HTTP/1.1" 200 None
2026-03-28 22:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981043 not downloaded yet
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698973867%27 HTTP/1.1" 200 None
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698973867 not downloaded yet
2026-03-28 22:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189102/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189102>
2026-03-28 22:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189114/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189114>
2026-03-28 22:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011572/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011572>
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208256%27 HTTP/1.1" 200 None
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208256 not downloaded yet
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981067%27 HTTP/1.1" 200 None
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981067 not downloaded yet
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698973884%27 HTTP/1.1" 200 None
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698973884 not downloaded yet
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208262%27 HTTP/1.1" 200 None
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208262 not downloaded yet
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549371d0>
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e575391d-6903-5001-a072-5ddc281ffe3b/e575391d-6903-5001-a072-5ddc281ffe3b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLL18NDU%252F699189056%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189056/600 saved to cache
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e575391d-6903-5001-a072-5ddc281ffe3b
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554aa6210>
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4494bc-d302-5d25-af44-49f73fc6f3e8/3b4494bc-d302-5d25-af44-49f73fc6f3e8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD17FAM%252F699285703%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD17FAM/699285703/600 saved to cache
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b4494bc-d302-5d25-af44-49f73fc6f3e8
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5541f5490>
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d/d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB15DHF%252F698970590%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB15DHF/698970590/600 saved to cache
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548938d0>
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e220b51-e3aa-5dfc-97bc-648f804c494e/2e220b51-e3aa-5dfc-97bc-648f804c494e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ67HWW%252F698994531%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ67HWW/698994531/600 saved to cache
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2e220b51-e3aa-5dfc-97bc-648f804c494e
2026-03-28 22:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189077/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LL18NDU/42800227?sv=2020-08-04&st=2026-03-28T22%3A06%3A56Z&se=2026-03-28T22%3A31%3A56Z&sr=b&sp=r&sig=6s6Bfq%2FXIKre40OElhghKlOi7vb%2BBrxhEncLEvGdU4k%3D)
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981104%27 HTTP/1.1" 200 None
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981104 not downloaded yet
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698973905%27 HTTP/1.1" 200 None
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698973905 not downloaded yet
2026-03-28 22:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189089/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LL18NDU/42800227?sv=2020-08-04&st=2026-03-28T22%3A06%3A56Z&se=2026-03-28T22%3A31%3A56Z&sr=b&sp=r&sig=6s6Bfq%2FXIKre40OElhghKlOi7vb%2BBrxhEncLEvGdU4k%3D)
2026-03-28 22:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011598/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011598>
2026-03-28 22:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189130/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189130>
2026-03-28 22:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189147/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189147>
2026-03-28 22:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011587/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011587>
2026-03-28 22:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208225/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BG67KMM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011609/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011609>
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208274%27 HTTP/1.1" 200 None
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208274 not downloaded yet
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5549afdd0>
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d59c8c01-c6be-586f-86c9-6eb3a7686cc2/d59c8c01-c6be-586f-86c9-6eb3a7686cc2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX14XNH%252F699011519%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011519/600 saved to cache
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d59c8c01-c6be-586f-86c9-6eb3a7686cc2
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54739fc90>
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e575391d-6903-5001-a072-5ddc281ffe3b/e575391d-6903-5001-a072-5ddc281ffe3b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLL18NDU%252F699189071%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189071/600 saved to cache
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e575391d-6903-5001-a072-5ddc281ffe3b
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981127%27 HTTP/1.1" 200 None
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981127 not downloaded yet
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698973915%27 HTTP/1.1" 200 None
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698973915 not downloaded yet
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208295%27 HTTP/1.1" 200 None
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208295 not downloaded yet
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981155%27 HTTP/1.1" 200 None
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981155 not downloaded yet
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698973918%27 HTTP/1.1" 200 None
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698973918 not downloaded yet
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544c9190>
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e575391d-6903-5001-a072-5ddc281ffe3b/e575391d-6903-5001-a072-5ddc281ffe3b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLL18NDU%252F699189077%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189077/600 saved to cache
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e575391d-6903-5001-a072-5ddc281ffe3b
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554f96150>
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e575391d-6903-5001-a072-5ddc281ffe3b/e575391d-6903-5001-a072-5ddc281ffe3b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLL18NDU%252F699189089%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189089/600 saved to cache
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e575391d-6903-5001-a072-5ddc281ffe3b
2026-03-28 22:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011552/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX14XNH/42810919?sv=2020-08-04&st=2026-03-28T22%3A06%3A58Z&se=2026-03-28T22%3A31%3A58Z&sr=b&sp=r&sig=dVRR3q4L8ZyEt7o5biyfc4sTJUvvOlQj3AbiPtREwnE%3D)
2026-03-28 22:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189114/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LL18NDU/42800227?sv=2020-08-04&st=2026-03-28T22%3A06%3A56Z&se=2026-03-28T22%3A31%3A56Z&sr=b&sp=r&sig=6s6Bfq%2FXIKre40OElhghKlOi7vb%2BBrxhEncLEvGdU4k%3D)
2026-03-28 22:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011542/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX14XNH/42810919?sv=2020-08-04&st=2026-03-28T22%3A06%3A58Z&se=2026-03-28T22%3A31%3A58Z&sr=b&sp=r&sig=dVRR3q4L8ZyEt7o5biyfc4sTJUvvOlQj3AbiPtREwnE%3D)
2026-03-28 22:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011560/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX14XNH/42810919?sv=2020-08-04&st=2026-03-28T22%3A06%3A58Z&se=2026-03-28T22%3A31%3A58Z&sr=b&sp=r&sig=dVRR3q4L8ZyEt7o5biyfc4sTJUvvOlQj3AbiPtREwnE%3D)
2026-03-28 22:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011572/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX14XNH/42810919?sv=2020-08-04&st=2026-03-28T22%3A06%3A58Z&se=2026-03-28T22%3A31%3A58Z&sr=b&sp=r&sig=dVRR3q4L8ZyEt7o5biyfc4sTJUvvOlQj3AbiPtREwnE%3D)
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208312%27 HTTP/1.1" 200 None
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208312 not downloaded yet
2026-03-28 22:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973839/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LN09WAJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981023/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KM68WZP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 22:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189102/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LL18NDU/42800227?sv=2020-08-04&st=2026-03-28T22%3A06%3A56Z&se=2026-03-28T22%3A31%3A56Z&sr=b&sp=r&sig=6s6Bfq%2FXIKre40OElhghKlOi7vb%2BBrxhEncLEvGdU4k%3D)
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981187%27 HTTP/1.1" 200 None
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981187 not downloaded yet
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698973932%27 HTTP/1.1" 200 None
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698973932 not downloaded yet
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208330%27 HTTP/1.1" 200 None
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208330 not downloaded yet
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981229%27 HTTP/1.1" 200 None
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981229 not downloaded yet
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698973964%27 HTTP/1.1" 200 None
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698973964 not downloaded yet
2026-03-28 22:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208225/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG67KMM/42808144?sv=2020-08-04&st=2026-03-28T22%3A06%3A59Z&se=2026-03-28T22%3A31%3A59Z&sr=b&sp=r&sig=dm68FyiEYzqcmz8iVlgtitpLa0XkBI%2FR5NGluMyXUn8%3D)
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699208352%27 HTTP/1.1" 200 None
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208352 not downloaded yet
2026-03-28 22:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011587/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX14XNH/42810919?sv=2020-08-04&st=2026-03-28T22%3A06%3A58Z&se=2026-03-28T22%3A31%3A58Z&sr=b&sp=r&sig=dVRR3q4L8ZyEt7o5biyfc4sTJUvvOlQj3AbiPtREwnE%3D)
2026-03-28 22:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011609/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX14XNH/42810919?sv=2020-08-04&st=2026-03-28T22%3A06%3A58Z&se=2026-03-28T22%3A31%3A58Z&sr=b&sp=r&sig=dVRR3q4L8ZyEt7o5biyfc4sTJUvvOlQj3AbiPtREwnE%3D)
2026-03-28 22:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189130/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LL18NDU/42800227?sv=2020-08-04&st=2026-03-28T22%3A06%3A56Z&se=2026-03-28T22%3A31%3A56Z&sr=b&sp=r&sig=6s6Bfq%2FXIKre40OElhghKlOi7vb%2BBrxhEncLEvGdU4k%3D)
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981271%27 HTTP/1.1" 200 None
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981271 not downloaded yet
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698974005%27 HTTP/1.1" 200 None
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698974005 not downloaded yet
2026-03-28 22:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011598/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX14XNH/42810919?sv=2020-08-04&st=2026-03-28T22%3A06%3A58Z&se=2026-03-28T22%3A31%3A58Z&sr=b&sp=r&sig=dVRR3q4L8ZyEt7o5biyfc4sTJUvvOlQj3AbiPtREwnE%3D)
2026-03-28 22:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973884/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698973884>
2026-03-28 22:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208262/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208262>
2026-03-28 22:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189147/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LL18NDU/42800227?sv=2020-08-04&st=2026-03-28T22%3A06%3A56Z&se=2026-03-28T22%3A31%3A56Z&sr=b&sp=r&sig=6s6Bfq%2FXIKre40OElhghKlOi7vb%2BBrxhEncLEvGdU4k%3D)
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698981296%27 HTTP/1.1" 200 None
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981296 not downloaded yet
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698974040%27 HTTP/1.1" 200 None
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698974040 not downloaded yet
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5472577d0>
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d59c8c01-c6be-586f-86c9-6eb3a7686cc2/d59c8c01-c6be-586f-86c9-6eb3a7686cc2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX14XNH%252F699011552%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011552/600 saved to cache
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d59c8c01-c6be-586f-86c9-6eb3a7686cc2
2026-03-28 22:07:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:07:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe54747ba50>
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e575391d-6903-5001-a072-5ddc281ffe3b/e575391d-6903-5001-a072-5ddc281ffe3b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLL18NDU%252F699189114%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189114/600 saved to cache
2026-03-28 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e575391d-6903-5001-a072-5ddc281ffe3b
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548ca2d0>
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d59c8c01-c6be-586f-86c9-6eb3a7686cc2/d59c8c01-c6be-586f-86c9-6eb3a7686cc2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX14XNH%252F699011542%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011542/600 saved to cache
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d59c8c01-c6be-586f-86c9-6eb3a7686cc2
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547782750>
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d59c8c01-c6be-586f-86c9-6eb3a7686cc2/d59c8c01-c6be-586f-86c9-6eb3a7686cc2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX14XNH%252F699011560%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011560/600 saved to cache
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d59c8c01-c6be-586f-86c9-6eb3a7686cc2
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b06b50>
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d59c8c01-c6be-586f-86c9-6eb3a7686cc2/d59c8c01-c6be-586f-86c9-6eb3a7686cc2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX14XNH%252F699011572%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011572/600 saved to cache
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d59c8c01-c6be-586f-86c9-6eb3a7686cc2
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548ca810>
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e575391d-6903-5001-a072-5ddc281ffe3b/e575391d-6903-5001-a072-5ddc281ffe3b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLL18NDU%252F699189102%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189102/600 saved to cache
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e575391d-6903-5001-a072-5ddc281ffe3b
2026-03-28 22:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208274/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208274>
2026-03-28 22:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973915/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698973915>
2026-03-28 22:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208295/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208295>
2026-03-28 22:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981127/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981127>
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543eb010>
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74260dc8-62a0-531b-ba8b-8bfc34fc2e08/74260dc8-62a0-531b-ba8b-8bfc34fc2e08_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG67KMM%252F699208225%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208225/600 saved to cache
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74260dc8-62a0-531b-ba8b-8bfc34fc2e08
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554322f10>
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d59c8c01-c6be-586f-86c9-6eb3a7686cc2/d59c8c01-c6be-586f-86c9-6eb3a7686cc2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX14XNH%252F699011587%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011587/600 saved to cache
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d59c8c01-c6be-586f-86c9-6eb3a7686cc2
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5476e7650>
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d59c8c01-c6be-586f-86c9-6eb3a7686cc2/d59c8c01-c6be-586f-86c9-6eb3a7686cc2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX14XNH%252F699011609%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011609/600 saved to cache
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d59c8c01-c6be-586f-86c9-6eb3a7686cc2
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5476e78d0>
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e575391d-6903-5001-a072-5ddc281ffe3b/e575391d-6903-5001-a072-5ddc281ffe3b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLL18NDU%252F699189130%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189130/600 saved to cache
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e575391d-6903-5001-a072-5ddc281ffe3b
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543eb010>
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d59c8c01-c6be-586f-86c9-6eb3a7686cc2/d59c8c01-c6be-586f-86c9-6eb3a7686cc2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX14XNH%252F699011598%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011598/600 saved to cache
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d59c8c01-c6be-586f-86c9-6eb3a7686cc2
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548cef50>
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e575391d-6903-5001-a072-5ddc281ffe3b/e575391d-6903-5001-a072-5ddc281ffe3b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLL18NDU%252F699189147%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189147/600 saved to cache
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e575391d-6903-5001-a072-5ddc281ffe3b
2026-03-28 22:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973839/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN09WAJ/42810692?sv=2020-08-04&st=2026-03-28T22%3A07%3A00Z&se=2026-03-28T22%3A32%3A00Z&sr=b&sp=r&sig=0y6PGcJo%2BaTuvoIQnL%2Bb4N76imGpiuahl3912b2j6a8%3D)
2026-03-28 22:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981023/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM68WZP/42810548?sv=2020-08-04&st=2026-03-28T22%3A07%3A00Z&se=2026-03-28T22%3A32%3A00Z&sr=b&sp=r&sig=r7GasWOrtr48CttU%2B7GMwf9%2FLcSoZKm1VXUj0wdFOzw%3D)
2026-03-28 22:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208312/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208312>
2026-03-28 22:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973905/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698973905>
2026-03-28 22:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208330/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208330>
2026-03-28 22:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973932/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698973932>
2026-03-28 22:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981229/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981229>
2026-03-28 22:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973964/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698973964>
2026-03-28 22:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973884/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN09WAJ/42810692?sv=2020-08-04&st=2026-03-28T22%3A07%3A00Z&se=2026-03-28T22%3A32%3A00Z&sr=b&sp=r&sig=0y6PGcJo%2BaTuvoIQnL%2Bb4N76imGpiuahl3912b2j6a8%3D)
2026-03-28 22:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698974005/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698974005>
2026-03-28 22:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981127/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM68WZP/42810548?sv=2020-08-04&st=2026-03-28T22%3A07%3A00Z&se=2026-03-28T22%3A32%3A00Z&sr=b&sp=r&sig=r7GasWOrtr48CttU%2B7GMwf9%2FLcSoZKm1VXUj0wdFOzw%3D)
2026-03-28 22:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981271/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981271>
2026-03-28 22:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973915/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN09WAJ/42810692?sv=2020-08-04&st=2026-03-28T22%3A07%3A00Z&se=2026-03-28T22%3A32%3A00Z&sr=b&sp=r&sig=0y6PGcJo%2BaTuvoIQnL%2Bb4N76imGpiuahl3912b2j6a8%3D)
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55496b090>
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6de2403-2697-5487-84b5-a97e5182e1b7/f6de2403-2697-5487-84b5-a97e5182e1b7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN09WAJ%252F698973839%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973839/600 saved to cache
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6de2403-2697-5487-84b5-a97e5182e1b7
2026-03-28 22:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973905/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN09WAJ/42810692?sv=2020-08-04&st=2026-03-28T22%3A07%3A00Z&se=2026-03-28T22%3A32%3A00Z&sr=b&sp=r&sig=0y6PGcJo%2BaTuvoIQnL%2Bb4N76imGpiuahl3912b2j6a8%3D)
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55456e3d0>
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54b4bf4-6a42-5bbf-9d35-a64946d22272/d54b4bf4-6a42-5bbf-9d35-a64946d22272_image_0.jpg HTTP/1.1" 201 0
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM68WZP%252F698981023%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981023/600 saved to cache
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d54b4bf4-6a42-5bbf-9d35-a64946d22272
2026-03-28 22:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981229/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM68WZP/42810548?sv=2020-08-04&st=2026-03-28T22%3A07%3A00Z&se=2026-03-28T22%3A32%3A00Z&sr=b&sp=r&sig=r7GasWOrtr48CttU%2B7GMwf9%2FLcSoZKm1VXUj0wdFOzw%3D)
2026-03-28 22:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973964/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN09WAJ/42810692?sv=2020-08-04&st=2026-03-28T22%3A07%3A00Z&se=2026-03-28T22%3A32%3A00Z&sr=b&sp=r&sig=0y6PGcJo%2BaTuvoIQnL%2Bb4N76imGpiuahl3912b2j6a8%3D)
2026-03-28 22:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208330/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG67KMM/42808144?sv=2020-08-04&st=2026-03-28T22%3A06%3A59Z&se=2026-03-28T22%3A31%3A59Z&sr=b&sp=r&sig=dm68FyiEYzqcmz8iVlgtitpLa0XkBI%2FR5NGluMyXUn8%3D)
2026-03-28 22:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973932/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN09WAJ/42810692?sv=2020-08-04&st=2026-03-28T22%3A07%3A00Z&se=2026-03-28T22%3A32%3A00Z&sr=b&sp=r&sig=0y6PGcJo%2BaTuvoIQnL%2Bb4N76imGpiuahl3912b2j6a8%3D)
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543b8250>
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6de2403-2697-5487-84b5-a97e5182e1b7/f6de2403-2697-5487-84b5-a97e5182e1b7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN09WAJ%252F698973884%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973884/600 saved to cache
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f6de2403-2697-5487-84b5-a97e5182e1b7
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543e8850>
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54b4bf4-6a42-5bbf-9d35-a64946d22272/d54b4bf4-6a42-5bbf-9d35-a64946d22272_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM68WZP%252F698981127%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981127/600 saved to cache
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d54b4bf4-6a42-5bbf-9d35-a64946d22272
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554412990>
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6de2403-2697-5487-84b5-a97e5182e1b7/f6de2403-2697-5487-84b5-a97e5182e1b7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN09WAJ%252F698973915%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973915/600 saved to cache
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f6de2403-2697-5487-84b5-a97e5182e1b7
2026-03-28 22:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208352/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208352>
2026-03-28 22:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698974040/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698974040>
2026-03-28 22:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981296/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981296>
2026-03-28 22:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698974005/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN09WAJ/42810692?sv=2020-08-04&st=2026-03-28T22%3A07%3A00Z&se=2026-03-28T22%3A32%3A00Z&sr=b&sp=r&sig=0y6PGcJo%2BaTuvoIQnL%2Bb4N76imGpiuahl3912b2j6a8%3D)
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5543e8350>
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6de2403-2697-5487-84b5-a97e5182e1b7/f6de2403-2697-5487-84b5-a97e5182e1b7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN09WAJ%252F698973905%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973905/600 saved to cache
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f6de2403-2697-5487-84b5-a97e5182e1b7
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a443d0>
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54b4bf4-6a42-5bbf-9d35-a64946d22272/d54b4bf4-6a42-5bbf-9d35-a64946d22272_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM68WZP%252F698981229%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981229/600 saved to cache
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d54b4bf4-6a42-5bbf-9d35-a64946d22272
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554824ad0>
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6de2403-2697-5487-84b5-a97e5182e1b7/f6de2403-2697-5487-84b5-a97e5182e1b7_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN09WAJ%252F698973964%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973964/600 saved to cache
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f6de2403-2697-5487-84b5-a97e5182e1b7
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a44210>
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74260dc8-62a0-531b-ba8b-8bfc34fc2e08/74260dc8-62a0-531b-ba8b-8bfc34fc2e08_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG67KMM%252F699208330%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208330/600 saved to cache
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 74260dc8-62a0-531b-ba8b-8bfc34fc2e08
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547170990>
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6de2403-2697-5487-84b5-a97e5182e1b7/f6de2403-2697-5487-84b5-a97e5182e1b7_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN09WAJ%252F698973932%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973932/600 saved to cache
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f6de2403-2697-5487-84b5-a97e5182e1b7
2026-03-28 22:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981187/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981187>
2026-03-28 22:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208262/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG67KMM/42808144?sv=2020-08-04&st=2026-03-28T22%3A06%3A59Z&se=2026-03-28T22%3A31%3A59Z&sr=b&sp=r&sig=dm68FyiEYzqcmz8iVlgtitpLa0XkBI%2FR5NGluMyXUn8%3D)
2026-03-28 22:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973918/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698973918>
2026-03-28 22:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208274/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG67KMM/42808144?sv=2020-08-04&st=2026-03-28T22%3A06%3A59Z&se=2026-03-28T22%3A31%3A59Z&sr=b&sp=r&sig=dm68FyiEYzqcmz8iVlgtitpLa0XkBI%2FR5NGluMyXUn8%3D)
2026-03-28 22:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981271/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM68WZP/42810548?sv=2020-08-04&st=2026-03-28T22%3A07%3A00Z&se=2026-03-28T22%3A32%3A00Z&sr=b&sp=r&sig=r7GasWOrtr48CttU%2B7GMwf9%2FLcSoZKm1VXUj0wdFOzw%3D)
2026-03-28 22:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208295/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG67KMM/42808144?sv=2020-08-04&st=2026-03-28T22%3A06%3A59Z&se=2026-03-28T22%3A31%3A59Z&sr=b&sp=r&sig=dm68FyiEYzqcmz8iVlgtitpLa0XkBI%2FR5NGluMyXUn8%3D)
2026-03-28 22:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208312/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG67KMM/42808144?sv=2020-08-04&st=2026-03-28T22%3A06%3A59Z&se=2026-03-28T22%3A31%3A59Z&sr=b&sp=r&sig=dm68FyiEYzqcmz8iVlgtitpLa0XkBI%2FR5NGluMyXUn8%3D)
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554978bd0>
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6de2403-2697-5487-84b5-a97e5182e1b7/f6de2403-2697-5487-84b5-a97e5182e1b7_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN09WAJ%252F698974005%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698974005/600 saved to cache
2026-03-28 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f6de2403-2697-5487-84b5-a97e5182e1b7
2026-03-28 22:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981067/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981067>
2026-03-28 22:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981104/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981104>
2026-03-28 22:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208256/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208256>
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554b580d0>
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74260dc8-62a0-531b-ba8b-8bfc34fc2e08/74260dc8-62a0-531b-ba8b-8bfc34fc2e08_image_4.jpg HTTP/1.1" 201 0
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG67KMM%252F699208262%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208262/600 saved to cache
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 74260dc8-62a0-531b-ba8b-8bfc34fc2e08
2026-03-28 22:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698974040/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN09WAJ/42810692?sv=2020-08-04&st=2026-03-28T22%3A07%3A00Z&se=2026-03-28T22%3A32%3A00Z&sr=b&sp=r&sig=0y6PGcJo%2BaTuvoIQnL%2Bb4N76imGpiuahl3912b2j6a8%3D)
2026-03-28 22:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981155/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981155>
2026-03-28 22:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973867/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698973867>
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5471b0dd0>
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74260dc8-62a0-531b-ba8b-8bfc34fc2e08/74260dc8-62a0-531b-ba8b-8bfc34fc2e08_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG67KMM%252F699208274%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208274/600 saved to cache
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 74260dc8-62a0-531b-ba8b-8bfc34fc2e08
2026-03-28 22:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973918/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN09WAJ/42810692?sv=2020-08-04&st=2026-03-28T22%3A07%3A00Z&se=2026-03-28T22%3A32%3A00Z&sr=b&sp=r&sig=0y6PGcJo%2BaTuvoIQnL%2Bb4N76imGpiuahl3912b2j6a8%3D)
2026-03-28 22:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981296/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM68WZP/42810548?sv=2020-08-04&st=2026-03-28T22%3A07%3A00Z&se=2026-03-28T22%3A32%3A00Z&sr=b&sp=r&sig=r7GasWOrtr48CttU%2B7GMwf9%2FLcSoZKm1VXUj0wdFOzw%3D)
2026-03-28 22:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981043/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698981043>
2026-03-28 22:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981187/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM68WZP/42810548?sv=2020-08-04&st=2026-03-28T22%3A07%3A00Z&se=2026-03-28T22%3A32%3A00Z&sr=b&sp=r&sig=r7GasWOrtr48CttU%2B7GMwf9%2FLcSoZKm1VXUj0wdFOzw%3D)
2026-03-28 22:07:04 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 22:07:04 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547486350>
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54b4bf4-6a42-5bbf-9d35-a64946d22272/d54b4bf4-6a42-5bbf-9d35-a64946d22272_image_8.jpg HTTP/1.1" 201 0
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM68WZP%252F698981271%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981271/600 saved to cache
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d54b4bf4-6a42-5bbf-9d35-a64946d22272
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547312c10>
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74260dc8-62a0-531b-ba8b-8bfc34fc2e08/74260dc8-62a0-531b-ba8b-8bfc34fc2e08_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG67KMM%252F699208295%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208295/600 saved to cache
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 74260dc8-62a0-531b-ba8b-8bfc34fc2e08
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe55497aa10>
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74260dc8-62a0-531b-ba8b-8bfc34fc2e08/74260dc8-62a0-531b-ba8b-8bfc34fc2e08_image_7.jpg HTTP/1.1" 201 0
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG67KMM%252F699208312%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208312/600 saved to cache
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 74260dc8-62a0-531b-ba8b-8bfc34fc2e08
2026-03-28 22:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 22:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208236/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208236>
2026-03-28 22:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208244/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699208244>
2026-03-28 22:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011616/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011616>
2026-03-28 22:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208352/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG67KMM/42808144?sv=2020-08-04&st=2026-03-28T22%3A06%3A59Z&se=2026-03-28T22%3A31%3A59Z&sr=b&sp=r&sig=dm68FyiEYzqcmz8iVlgtitpLa0XkBI%2FR5NGluMyXUn8%3D)
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5548c97d0>
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6de2403-2697-5487-84b5-a97e5182e1b7/f6de2403-2697-5487-84b5-a97e5182e1b7_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN09WAJ%252F698974040%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698974040/600 saved to cache
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f6de2403-2697-5487-84b5-a97e5182e1b7
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554a142d0>
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6de2403-2697-5487-84b5-a97e5182e1b7/f6de2403-2697-5487-84b5-a97e5182e1b7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN09WAJ%252F698973918%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973918/600 saved to cache
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f6de2403-2697-5487-84b5-a97e5182e1b7
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5544126d0>
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54b4bf4-6a42-5bbf-9d35-a64946d22272/d54b4bf4-6a42-5bbf-9d35-a64946d22272_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM68WZP%252F698981296%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981296/600 saved to cache
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d54b4bf4-6a42-5bbf-9d35-a64946d22272
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554841990>
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54b4bf4-6a42-5bbf-9d35-a64946d22272/d54b4bf4-6a42-5bbf-9d35-a64946d22272_image_6.jpg HTTP/1.1" 201 0
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM68WZP%252F698981187%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981187/600 saved to cache
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d54b4bf4-6a42-5bbf-9d35-a64946d22272
2026-03-28 22:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981067/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM68WZP/42810548?sv=2020-08-04&st=2026-03-28T22%3A07%3A00Z&se=2026-03-28T22%3A32%3A00Z&sr=b&sp=r&sig=r7GasWOrtr48CttU%2B7GMwf9%2FLcSoZKm1VXUj0wdFOzw%3D)
2026-03-28 22:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973867/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN09WAJ/42810692?sv=2020-08-04&st=2026-03-28T22%3A07%3A00Z&se=2026-03-28T22%3A32%3A00Z&sr=b&sp=r&sig=0y6PGcJo%2BaTuvoIQnL%2Bb4N76imGpiuahl3912b2j6a8%3D)
2026-03-28 22:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011529/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699011529>
2026-03-28 22:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189082/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189082>
2026-03-28 22:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981104/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM68WZP/42810548?sv=2020-08-04&st=2026-03-28T22%3A07%3A00Z&se=2026-03-28T22%3A32%3A00Z&sr=b&sp=r&sig=r7GasWOrtr48CttU%2B7GMwf9%2FLcSoZKm1VXUj0wdFOzw%3D)
2026-03-28 22:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981155/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM68WZP/42810548?sv=2020-08-04&st=2026-03-28T22%3A07%3A00Z&se=2026-03-28T22%3A32%3A00Z&sr=b&sp=r&sig=r7GasWOrtr48CttU%2B7GMwf9%2FLcSoZKm1VXUj0wdFOzw%3D)
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 22:07:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe554405790>
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74260dc8-62a0-531b-ba8b-8bfc34fc2e08/74260dc8-62a0-531b-ba8b-8bfc34fc2e08_image_9.jpg HTTP/1.1" 201 0
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG67KMM%252F699208352%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208352/600 saved to cache
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 74260dc8-62a0-531b-ba8b-8bfc34fc2e08
2026-03-28 22:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189065/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189065>
2026-03-28 22:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF67XMD/699332681/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699332681>
2026-03-28 22:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208236/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG67KMM/42808144?sv=2020-08-04&st=2026-03-28T22%3A06%3A59Z&se=2026-03-28T22%3A31%3A59Z&sr=b&sp=r&sig=dm68FyiEYzqcmz8iVlgtitpLa0XkBI%2FR5NGluMyXUn8%3D)
2026-03-28 22:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208244/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG67KMM/42808144?sv=2020-08-04&st=2026-03-28T22%3A06%3A59Z&se=2026-03-28T22%3A31%3A59Z&sr=b&sp=r&sig=dm68FyiEYzqcmz8iVlgtitpLa0XkBI%2FR5NGluMyXUn8%3D)
2026-03-28 22:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981043/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM68WZP/42810548?sv=2020-08-04&st=2026-03-28T22%3A07%3A00Z&se=2026-03-28T22%3A32%3A00Z&sr=b&sp=r&sig=r7GasWOrtr48CttU%2B7GMwf9%2FLcSoZKm1VXUj0wdFOzw%3D)
2026-03-28 22:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ET67ZTJ/42804110?sv=2020-08-04&st=2026-03-28T22%3A07%3A04Z&se=2026-03-28T22%3A32%3A04Z&sr=b&sp=r&sig=aIciBQUADqzRCpODy3SI92FhLfLn1%2BzjTexTfpP3Ykk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ET67%20ZTJ-GB>
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547748750>
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54b4bf4-6a42-5bbf-9d35-a64946d22272/d54b4bf4-6a42-5bbf-9d35-a64946d22272_image_2.jpg HTTP/1.1" 201 0
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM68WZP%252F698981067%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM68WZP/698981067/600 saved to cache
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d54b4bf4-6a42-5bbf-9d35-a64946d22272
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe547172b90>
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 22:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6de2403-2697-5487-84b5-a97e5182e1b7/f6de2403-2697-5487-84b5-a97e5182e1b7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN09WAJ%252F698973867%252F600') HTTP/1.1" 204 0
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973867/600 saved to cache
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f6de2403-2697-5487-84b5-a97e5182e1b7
2026-03-28 22:07:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6de2403-2697-5487-84b5-a97e5182e1b7, skipping ID generation
2026-03-28 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6de2403-2697-5487-84b5-a97e5182e1b7 sending to next pipeline
2026-03-28 22:07:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f6de2403-2697-5487-84b5-a97e5182e1b7, identifier: LN09%20WAJ
2026-03-28 22:07:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f6de2403-2697-5487-84b5-a97e5182e1b7 with identifier: LN09%20WAJ
2026-03-28 22:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f6de2403-2697-5487-84b5-a97e5182e1b7 with identifier: LN09%20WAJ
2026-03-28 22:07:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f6de2403-2697-5487-84b5-a97e5182e1b7 with identifier: LN09%20WAJ to the API
2026-03-28 22:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 22:07:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 22:07:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973867/600>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6de2403-2697-5487-84b5-a97e5182e1b7/f6de2403-2697-5487-84b5-a97e5182e1b7_expert_report_file_5e75b3eb-acd4-471c-9d92-3b465d7e8df5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LN09%20WAJ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f6de2403-2697-5487-84b5-a97e5182e1b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LN09 WAJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LN09%20WAJ&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'KIA',
'model': 'PICANTO',
'odometer': 54114,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6de2403-2697-5487-84b5-a97e5182e1b7/f6de2403-2697-5487-84b5-a97e5182e1b7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38749,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973839/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6de2403-2697-5487-84b5-a97e5182e1b7/f6de2403-2697-5487-84b5-a97e5182e1b7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37499,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973867/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6de2403-2697-5487-84b5-a97e5182e1b7/f6de2403-2697-5487-84b5-a97e5182e1b7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35948,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973884/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6de2403-2697-5487-84b5-a97e5182e1b7/f6de2403-2697-5487-84b5-a97e5182e1b7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36269,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973905/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6de2403-2697-5487-84b5-a97e5182e1b7/f6de2403-2697-5487-84b5-a97e5182e1b7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35699,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973915/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6de2403-2697-5487-84b5-a97e5182e1b7/f6de2403-2697-5487-84b5-a97e5182e1b7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35126,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973918/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6de2403-2697-5487-84b5-a97e5182e1b7/f6de2403-2697-5487-84b5-a97e5182e1b7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86396,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973932/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6de2403-2697-5487-84b5-a97e5182e1b7/f6de2403-2697-5487-84b5-a97e5182e1b7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72314,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698973964/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6de2403-2697-5487-84b5-a97e5182e1b7/f6de2403-2697-5487-84b5-a97e5182e1b7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88794,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698974005/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6de2403-2697-5487-84b5-a97e5182e1b7/f6de2403-2697-5487-84b5-a97e5182e1b7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57097,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN09WAJ/698974040/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'KIA PICANTO 1.0 I Hatchback',
'transmission': 'manual',
'trim': 'I',
'vin': 'KNABA24429T768894',
'year': 2009}
2026-03-28 22:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN09%2520WAJ%27 HTTP/1.1" 200 None
2026-03-28 22:07:05 [bca.uk] INFO: Saving data for LN09%20WAJ: {'created_time': 1774735625.346468, 'last_price_update_time': 1774735625.34648, 'auction_closing_time': 1774778400.0}
2026-03-28 22:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 22:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LN09%2520WAJ') HTTP/1.1" 204 0
2026-03-28 22:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG67KMM/699208256/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG67KMM/42808144?sv=2020-08-04&st=2026-03-28T22%3A06%3A59Z&se=2026-03-28T22%3A31%3A59Z&sr=b&sp=r&sig=dm68FyiEYzqcmz8iVlgtitpLa0XkBI%2FR5NGluMyXUn8%3D)
2026-03-28 22:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL18NDU/699189082/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LL18NDU/42800227?sv=2020-08-04&st=2026-03-28T22%3A06%3A56Z&se=2026-03-28T22%3A31%3A56Z&sr=b&sp=r&sig=6s6Bfq%2FXIKre40OElhghKlOi7vb%2BBrxhEncLEvGdU4k%3D)
2026-03-28 22:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX14XNH/699011529/600>